| .. |
|
attention
|
75f97bc25d
bump flash-attn to remove unnecessary copies in the backend
|
hace 7 meses |
|
common
|
237fa59aea
feat: support CPU/GPU swapping in BlockManagerV2
|
hace 7 meses |
|
distributed
|
b2fd915c35
improve p2p access check
|
hace 7 meses |
|
endpoints
|
d00a7517e6
fix: tokenizer delay with using LLM class
|
hace 7 meses |
|
engine
|
ec5b99d075
fix: use named args
|
hace 7 meses |
|
executor
|
05d6e43244
fix: `torch.compile()` with mp executor backend
|
hace 7 meses |
|
kv_quant
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
hace 1 año |
|
lora
|
5fecc6b025
when was this deprecated?
|
hace 7 meses |
|
modeling
|
39b36efabf
fix: mixtral fp8 ckpt loading
|
hace 7 meses |
|
multimodal
|
75f97bc25d
bump flash-attn to remove unnecessary copies in the backend
|
hace 7 meses |
|
processing
|
237fa59aea
feat: support CPU/GPU swapping in BlockManagerV2
|
hace 7 meses |
|
quantization
|
39b36efabf
fix: mixtral fp8 ckpt loading
|
hace 7 meses |
|
spec_decode
|
ec5b99d075
fix: use named args
|
hace 7 meses |
|
task_handler
|
e321d80e4e
fix: `prompt_logprobs==0` case
|
hace 7 meses |
|
transformers_utils
|
8d77c69cbd
feat: support image processor and add llava example
|
hace 7 meses |
|
__init__.py
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
hace 7 meses |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
hace 1 año |
AlpinDale
ec5b99d075
fix: use named args