| .. |
|
adapter_commons
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
attention
|
5d37ec1016
suppress tpu import warning (#696)
|
3 months ago |
|
common
|
28b6397188
chore: quant config for speculative draft models (#719)
|
3 months ago |
|
distributed
|
8878e3a63f
fix: import ray under a guard (#708)
|
3 months ago |
|
endpoints
|
561588d97d
wip
|
3 months ago |
|
engine
|
28b6397188
chore: quant config for speculative draft models (#719)
|
3 months ago |
|
executor
|
008e646c7e
chore: add support for up to 2048 block size (#715)
|
3 months ago |
|
inputs
|
0b8b407b6d
feat: support profiling with multiple multi-modal inputs per prompt (#712)
|
3 months ago |
|
kv_quant
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
9 months ago |
|
lora
|
1394008421
chore: decouple `should_modify_greedy_probs_inplace (#671)
|
4 months ago |
|
modeling
|
561588d97d
wip
|
3 months ago |
|
multimodal
|
0b8b407b6d
feat: support profiling with multiple multi-modal inputs per prompt (#712)
|
3 months ago |
|
platforms
|
5d37ec1016
suppress tpu import warning (#696)
|
3 months ago |
|
plugins
|
f76f2a5af0
feat: add aphrodite plugin system (#705)
|
3 months ago |
|
processing
|
577586309d
chore: multi-step args and sequence modifications (#713)
|
3 months ago |
|
prompt_adapter
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
quantization
|
04da8c33bd
Revert "chore: use the `compressed-tensors` library to avoid code reuse (#704)" (#706)
|
3 months ago |
|
server
|
ed9a6f97c1
fix: kill api server when pinging dead engine (#660)
|
4 months ago |
|
spec_decode
|
1394008421
chore: decouple `should_modify_greedy_probs_inplace (#671)
|
4 months ago |
|
task_handler
|
008e646c7e
chore: add support for up to 2048 block size (#715)
|
3 months ago |
|
transformers_utils
|
d5033e12fd
feat: implement mistral tokenizer mode (#711)
|
3 months ago |
|
triton_utils
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
__init__.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
_core_ext.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
_custom_ops.py
|
5d37ec1016
suppress tpu import warning (#696)
|
3 months ago |
|
_ipex_ops.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
1 year ago |
|
scalar_type.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
version.py
|
8e0d376f1c
ci: bump aphrodite to 0.6.1 (#722)
|
3 months ago |
AlpinDale
561588d97d
wip