AlpinDale 80be38ca6f chore: expose phi3_v num_crops as an mm_processor_kwargs (#1117) vor 1 Woche
..
adapter_commons 2f61644f6e SPMD optimizations (#824) vor 2 Monaten
assets a5bfc2bc3d VLM: add support for LLaVA-Onevision model (#1100) vor 2 Wochen
attention 7fffa507ff build: build flash attention kernels inside aphrodite (#1085) vor 2 Wochen
common 5b03d67abb Core: add output streaming support to multi-step + async (#1112) vor 1 Woche
compilation 960dee2f97 torch.compile: fix functionalization (#1045) vor 1 Monat
distributed 76088aa43a distributed: allow IPv6 in APHRODITE_HOST_IP with ZMQ (#1105) vor 2 Wochen
endpoints f20f5c3491 samplers: improved DRY performance (#1108) vor 1 Woche
engine 5b03d67abb Core: add output streaming support to multi-step + async (#1112) vor 1 Woche
executor 6212072245 api: support LoRA lineage and base model metadata management (#1072) vor 1 Monat
inputs cc5e185795 VLM: support passing multimodal processor kwargs (#1102) vor 2 Wochen
kv_quant 8a71788372 Add OLMoE (#772) vor 3 Monaten
lora 6d8df254c7 LoRA: skip loading unsupported weight modules (#1109) vor 1 Woche
modeling 80be38ca6f chore: expose phi3_v num_crops as an mm_processor_kwargs (#1117) vor 1 Woche
multimodal cc5e185795 VLM: support passing multimodal processor kwargs (#1102) vor 2 Wochen
platforms f2b6dc3872 cpu: add support for W8A8 quantization via compressed-tensor (#1017) vor 1 Monat
plugins 9797d38b24 torch.compile: allow adding custom compile backends via plugins (#1041) vor 1 Monat
processing f561a54a43 core: fix async postprocessor in case of preemption (#1000) vor 1 Monat
prompt_adapter 30d02d0747 chore: remove peft as a requirement (#1006) vor 1 Monat
quantization 7c825e50be fix: correct FP8 support check on Ada+ GPUs by using compressed-tensors (#1110) vor 1 Woche
server 9a7d5514c4 feat: introduce MQAphroditeEngine (#1056) vor 1 Monat
spec_decode a0f0160b79 spec decode: remove dead code from draft bonus tokens (#1101) vor 2 Wochen
transformers_utils cc5e185795 VLM: support passing multimodal processor kwargs (#1102) vor 2 Wochen
triton_utils 4593a3b306 chore: remove dead code from triton sampling kernels (#1049) vor 1 Monat
worker 2cd6ef2d5a misc: skip dumping inputs when unpicklable vor 1 Woche
__init__.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 5 Monaten
_core_ext.py f1ea7711bd core: do not compile ScalarType for torch < 2.4.0 (#938) vor 1 Monat
_custom_ops.py 949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115) vor 1 Woche
_ipex_ops.py 6951928522 xpu: bump IPEX to 2.3, support GQA (#1042) vor 1 Monat
connections.py c6c91edab7 ci: update & overhaul test units (#769) vor 2 Monaten
constants.py 2f61644f6e SPMD optimizations (#824) vor 2 Monaten
py.typed 1c988a48b2 fix logging and add py.typed vor 1 Jahr
scalar_type.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 5 Monaten
version.py b20c4570d2 CI: bump aphrodite-engine to v0.6.6 (#1111) vor 1 Woche