AlpinDale 651678d2df VLM: use `SequenceData.from_token_counts` to create dummy data (#1093) 1 月之前
..
adapter_commons 2f61644f6e SPMD optimizations (#824) 3 月之前
assets 411ac4f405 vlm: add support for Qwen2-VL model (#1015) 2 月之前
attention 7fffa507ff build: build flash attention kernels inside aphrodite (#1085) 1 月之前
common 651678d2df VLM: use `SequenceData.from_token_counts` to create dummy data (#1093) 1 月之前
compilation 960dee2f97 torch.compile: fix functionalization (#1045) 2 月之前
distributed 193fcee016 chore: check for torch 2.4.0 when registering custom op (#1081) 2 月之前
endpoints d96c363301 api: fix admin key being required for authentication (#1091) 1 月之前
engine 86bf2cc4f3 core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080) 2 月之前
executor 6212072245 api: support LoRA lineage and base model metadata management (#1072) 2 月之前
inputs 651678d2df VLM: use `SequenceData.from_token_counts` to create dummy data (#1093) 1 月之前
kv_quant 8a71788372 Add OLMoE (#772) 4 月之前
lora 6212072245 api: support LoRA lineage and base model metadata management (#1072) 2 月之前
modeling 651678d2df VLM: use `SequenceData.from_token_counts` to create dummy data (#1093) 1 月之前
multimodal 6212072245 api: support LoRA lineage and base model metadata management (#1072) 2 月之前
platforms f2b6dc3872 cpu: add support for W8A8 quantization via compressed-tensor (#1017) 2 月之前
plugins 9797d38b24 torch.compile: allow adding custom compile backends via plugins (#1041) 2 月之前
processing f561a54a43 core: fix async postprocessor in case of preemption (#1000) 2 月之前
prompt_adapter 30d02d0747 chore: remove peft as a requirement (#1006) 2 月之前
quantization 92cee435e2 rocm: add more quants, fix _scaled_mm call (#1062) 2 月之前
server 9a7d5514c4 feat: introduce MQAphroditeEngine (#1056) 2 月之前
spec_decode 5c3b94de45 spec decode: move ops.advane_step to flash attention backend (#1005) 2 月之前
transformers_utils 7b6501bd05 tests: refactor model tests (#1078) 2 月之前
triton_utils 4593a3b306 chore: remove dead code from triton sampling kernels (#1049) 2 月之前
worker 6212072245 api: support LoRA lineage and base model metadata management (#1072) 2 月之前
__init__.py f1d0b77c92 [0.6.0] Release Candidate (#481) 6 月之前
_core_ext.py f1ea7711bd core: do not compile ScalarType for torch < 2.4.0 (#938) 2 月之前
_custom_ops.py 7fffa507ff build: build flash attention kernels inside aphrodite (#1085) 1 月之前
_ipex_ops.py 6951928522 xpu: bump IPEX to 2.3, support GQA (#1042) 2 月之前
connections.py c6c91edab7 ci: update & overhaul test units (#769) 3 月之前
constants.py 2f61644f6e SPMD optimizations (#824) 3 月之前
py.typed 1c988a48b2 fix logging and add py.typed 1 年之前
scalar_type.py f1d0b77c92 [0.6.0] Release Candidate (#481) 6 月之前
version.py cbd51a208a ci: bump to 0.6.5 (#964) 2 月之前