| .. |
|
attention
|
71a26f0998
chore: use pytorch sdpa backend to do naive attention for rocm
|
7 mesiacov pred |
|
common
|
76d6f49bbb
fix: modelscope downloads
|
7 mesiacov pred |
|
distributed
|
b2fd915c35
improve p2p access check
|
7 mesiacov pred |
|
endpoints
|
1d7f5c45b0
feat: add stream_options for chat completions
|
7 mesiacov pred |
|
engine
|
d7ebffe2f0
chore: re-add the graceful engine shutdown
|
7 mesiacov pred |
|
executor
|
17eb1b7eb9
chore: remove ray health check
|
7 mesiacov pred |
|
kv_quant
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
1 rok pred |
|
lora
|
c975bba905
fix: sharded state loader with lora
|
7 mesiacov pred |
|
modeling
|
b2cb5a92e9
fix: missing cache_config for dbrx
|
7 mesiacov pred |
|
multimodal
|
f2e94e2184
chore: minor llava cleanups in preparation for llava-next
|
7 mesiacov pred |
|
processing
|
3f92035bf1
fix: add `ignored_seq_groups` in `_schedule_chunked_prefill`
|
7 mesiacov pred |
|
quantization
|
e9c0a248dc
fix: support check for fp8 cutlass
|
7 mesiacov pred |
|
spec_decode
|
ec5b99d075
fix: use named args
|
7 mesiacov pred |
|
task_handler
|
c975bba905
fix: sharded state loader with lora
|
7 mesiacov pred |
|
transformers_utils
|
76d6f49bbb
fix: modelscope downloads
|
7 mesiacov pred |
|
__init__.py
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
7 mesiacov pred |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
1 rok pred |
AlpinDale
71a26f0998
chore: use pytorch sdpa backend to do naive attention for rocm