AlpinDale a5bfc2bc3d VLM: add support for LLaVA-Onevision model (#1100) преди 1 месец
..
adapter_commons 2f61644f6e SPMD optimizations (#824) преди 3 месеца
assets a5bfc2bc3d VLM: add support for LLaVA-Onevision model (#1100) преди 1 месец
attention 7fffa507ff build: build flash attention kernels inside aphrodite (#1085) преди 1 месец
common d44da0332c misc: rename `CudaMemoryProfiler` to `DeviceMemoryProfiler` (#1099) преди 1 месец
compilation 960dee2f97 torch.compile: fix functionalization (#1045) преди 2 месеца
distributed 193fcee016 chore: check for torch 2.4.0 when registering custom op (#1081) преди 2 месеца
endpoints d96c363301 api: fix admin key being required for authentication (#1091) преди 1 месец
engine 86bf2cc4f3 core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080) преди 2 месеца
executor 6212072245 api: support LoRA lineage and base model metadata management (#1072) преди 2 месеца
inputs 651678d2df VLM: use `SequenceData.from_token_counts` to create dummy data (#1093) преди 1 месец
kv_quant 8a71788372 Add OLMoE (#772) преди 4 месеца
lora 6212072245 api: support LoRA lineage and base model metadata management (#1072) преди 2 месеца
modeling a5bfc2bc3d VLM: add support for LLaVA-Onevision model (#1100) преди 1 месец
multimodal 6212072245 api: support LoRA lineage and base model metadata management (#1072) преди 2 месеца
platforms f2b6dc3872 cpu: add support for W8A8 quantization via compressed-tensor (#1017) преди 2 месеца
plugins 9797d38b24 torch.compile: allow adding custom compile backends via plugins (#1041) преди 2 месеца
processing f561a54a43 core: fix async postprocessor in case of preemption (#1000) преди 2 месеца
prompt_adapter 30d02d0747 chore: remove peft as a requirement (#1006) преди 2 месеца
quantization ed63c079f7 Triton: remove atomic add op from awq triton (#1094) преди 1 месец
server 9a7d5514c4 feat: introduce MQAphroditeEngine (#1056) преди 2 месеца
spec_decode 5c3b94de45 spec decode: move ops.advane_step to flash attention backend (#1005) преди 2 месеца
transformers_utils 7b6501bd05 tests: refactor model tests (#1078) преди 2 месеца
triton_utils 4593a3b306 chore: remove dead code from triton sampling kernels (#1049) преди 2 месеца
worker d44da0332c misc: rename `CudaMemoryProfiler` to `DeviceMemoryProfiler` (#1099) преди 1 месец
__init__.py f1d0b77c92 [0.6.0] Release Candidate (#481) преди 6 месеца
_core_ext.py f1ea7711bd core: do not compile ScalarType for torch < 2.4.0 (#938) преди 2 месеца
_custom_ops.py 7fffa507ff build: build flash attention kernels inside aphrodite (#1085) преди 1 месец
_ipex_ops.py 6951928522 xpu: bump IPEX to 2.3, support GQA (#1042) преди 2 месеца
connections.py c6c91edab7 ci: update & overhaul test units (#769) преди 3 месеца
constants.py 2f61644f6e SPMD optimizations (#824) преди 3 месеца
py.typed 1c988a48b2 fix logging and add py.typed преди 1 година
scalar_type.py f1d0b77c92 [0.6.0] Release Candidate (#481) преди 6 месеца
version.py cbd51a208a ci: bump to 0.6.5 (#964) преди 2 месеца