| .. |
|
attention
|
ca6b69966d
fix: explicitly end_forward() calls to flashinfer
|
vor 7 Monaten |
|
common
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
vor 6 Monaten |
|
distributed
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
vor 6 Monaten |
|
endpoints
|
63b735bc2a
chore: optimize v2 block manager to match the performance of v1
|
vor 7 Monaten |
|
engine
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
vor 6 Monaten |
|
executor
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
vor 6 Monaten |
|
inputs
|
3a0fdf7b9b
chore: remove `image_input_type` from VLM config
|
vor 7 Monaten |
|
kv_quant
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
vor 1 Jahr |
|
lora
|
0f4a9ee77b
quantized lm_head (#582)
|
vor 6 Monaten |
|
modeling
|
0f4a9ee77b
quantized lm_head (#582)
|
vor 6 Monaten |
|
multimodal
|
dd378ea063
feat: MLPSpeculator with tensor parallel
|
vor 7 Monaten |
|
processing
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
vor 6 Monaten |
|
quantization
|
0f4a9ee77b
quantized lm_head (#582)
|
vor 6 Monaten |
|
spec_decode
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
vor 6 Monaten |
|
task_handler
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
vor 6 Monaten |
|
transformers_utils
|
3a0fdf7b9b
chore: remove `image_input_type` from VLM config
|
vor 7 Monaten |
|
__init__.py
|
a07fc83bc8
chore: proper util for aphrodite version
|
vor 7 Monaten |
|
_custom_ops.py
|
c0c336aaa3
refactor: registry for processing model inputs; quick_gelu; clip model support
|
vor 7 Monaten |
|
_ipex_ops.py
|
6a57861fca
feat: initial XPU support via intel_extension_for_pytorch (#571)
|
vor 7 Monaten |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
vor 1 Jahr |
|
version.py
|
7e54c3916d
chore: factor out epilogues from cutlass kernels
|
vor 7 Monaten |
AlpinDale
0f4a9ee77b
quantized lm_head (#582)