| .. |
|
attention
|
c8c6de64cd
fix: typo in pallas backend
|
hace 7 meses |
|
common
|
ee174ea4fd
fix: guard for lora + chunked prefill
|
hace 7 meses |
|
distributed
|
44331a4d00
chore: improve p2p cache generation
|
hace 7 meses |
|
endpoints
|
a07fc83bc8
chore: proper util for aphrodite version
|
hace 7 meses |
|
engine
|
c482c09a3a
fix: remove duplicated input processing in async engine
|
hace 7 meses |
|
executor
|
a89c9a0e92
fix: device ordinal issues with world_size and stuff
|
hace 7 meses |
|
kv_quant
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
hace 1 año |
|
lora
|
42d2ee0f43
chore: better error logging for unsupported lora weights
|
hace 7 meses |
|
modeling
|
d0cca80b8b
feat: support sharded tensorizer models
|
hace 7 meses |
|
multimodal
|
f2e94e2184
chore: minor llava cleanups in preparation for llava-next
|
hace 7 meses |
|
processing
|
f9a10145d1
fix: v2 block manager + prefix caching
|
hace 7 meses |
|
quantization
|
a33aaf3b42
chore: cleanup compressed tensors
|
hace 7 meses |
|
spec_decode
|
4d1e613804
chore: minor simplifications
|
hace 7 meses |
|
task_handler
|
34b41e0a87
chore: add coordinator to reduce code duplication in tp and pp
|
hace 7 meses |
|
transformers_utils
|
bba89fc6d3
chore: make the automatic rope scaling behave properly with rope_scaling arg, add rope theta
|
hace 7 meses |
|
__init__.py
|
a07fc83bc8
chore: proper util for aphrodite version
|
hace 7 meses |
|
_custom_ops.py
|
7e54c3916d
chore: factor out epilogues from cutlass kernels
|
hace 7 meses |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
hace 1 año |
|
version.py
|
7e54c3916d
chore: factor out epilogues from cutlass kernels
|
hace 7 meses |
AlpinDale
ee174ea4fd
fix: guard for lora + chunked prefill