AlpinDale 0bf916eabd Revert "feat: add support for chunked prefill + prefix caching (#871)" 3 weeks ago
..
adapter_commons 2f61644f6e SPMD optimizations (#824) 1 month ago
assets 653d1a08d4 feat: add support for audio models (#891) 3 weeks ago
attention 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) 3 weeks ago
common 132aa2abe4 spec decode: add support for EAGLE (#899) 3 weeks ago
distributed 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) 3 weeks ago
endpoints a00ab49e21 api: add client timeouts for the ZeroMQ server (#897) 3 weeks ago
engine 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) 3 weeks ago
executor 65b71f5fcc distributed: fix issue for when nodes have multiple network interfaces (#892) 3 weeks ago
inputs 908ff753a1 fix: phi_3.5_v loading (#896) 3 weeks ago
kv_quant 8a71788372 Add OLMoE (#772) 2 months ago
lora 369600855a xpu: disable punica kernels for XPU (#864) 1 month ago
modeling afc9a28aa0 chore: add AphroditeParameter support for FP8 quant (#902) 3 weeks ago
multimodal 653d1a08d4 feat: add support for audio models (#891) 3 weeks ago
platforms 81c28d2a7f fix: use nvml to get consistent device names (#739) 3 months ago
plugins 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) 3 weeks ago
processing 0bf916eabd Revert "feat: add support for chunked prefill + prefix caching (#871)" 3 weeks ago
prompt_adapter 2f61644f6e SPMD optimizations (#824) 1 month ago
quantization afc9a28aa0 chore: add AphroditeParameter support for FP8 quant (#902) 3 weeks ago
server 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) 3 weeks ago
spec_decode 132aa2abe4 spec decode: add support for EAGLE (#899) 3 weeks ago
task_handler 0bf916eabd Revert "feat: add support for chunked prefill + prefix caching (#871)" 3 weeks ago
transformers_utils 132aa2abe4 spec decode: add support for EAGLE (#899) 3 weeks ago
triton_utils f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
__init__.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
_core_ext.py 9296d4b25d feat: dynamo support for ScalarType (#733) 3 months ago
_custom_ops.py 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 1 month ago
_ipex_ops.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
connections.py c6c91edab7 ci: update & overhaul test units (#769) 1 month ago
constants.py 2f61644f6e SPMD optimizations (#824) 1 month ago
py.typed 1c988a48b2 fix logging and add py.typed 1 year ago
scalar_type.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
version.py 8b8d2ce7e2 ci: bump aphrodite version to 0.6.4.post1 (#859) 1 month ago