david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 653d1a08d42e93e901390c5773791856088db279

AlpinDale 653d1a08d4 feat: add support for audio models (#891)		2 달 전
..
adapter_commons	2f61644f6e SPMD optimizations (#824)	3 달 전
assets	653d1a08d4 feat: add support for audio models (#891)	2 달 전
attention	22a4cd4595 core: fix spec decode metrics and envs circular import (#889)	2 달 전
common	22a4cd4595 core: fix spec decode metrics and envs circular import (#889)	2 달 전
distributed	22a4cd4595 core: fix spec decode metrics and envs circular import (#889)	2 달 전
endpoints	653d1a08d4 feat: add support for audio models (#891)	2 달 전
engine	22a4cd4595 core: fix spec decode metrics and envs circular import (#889)	2 달 전
executor	22a4cd4595 core: fix spec decode metrics and envs circular import (#889)	2 달 전
inputs	2f61644f6e SPMD optimizations (#824)	3 달 전
kv_quant	8a71788372 Add OLMoE (#772)	4 달 전
lora	369600855a xpu: disable punica kernels for XPU (#864)	3 달 전
modeling	653d1a08d4 feat: add support for audio models (#891)	2 달 전
multimodal	653d1a08d4 feat: add support for audio models (#891)	2 달 전
platforms	81c28d2a7f fix: use nvml to get consistent device names (#739)	5 달 전
plugins	22a4cd4595 core: fix spec decode metrics and envs circular import (#889)	2 달 전
processing	abfd4465ca feat: add support for chunked prefill + prefix caching (#871)	3 달 전
prompt_adapter	2f61644f6e SPMD optimizations (#824)	3 달 전
quantization	22a4cd4595 core: fix spec decode metrics and envs circular import (#889)	2 달 전
server	22a4cd4595 core: fix spec decode metrics and envs circular import (#889)	2 달 전
spec_decode	22a4cd4595 core: fix spec decode metrics and envs circular import (#889)	2 달 전
task_handler	22a4cd4595 core: fix spec decode metrics and envs circular import (#889)	2 달 전
transformers_utils	653d1a08d4 feat: add support for audio models (#891)	2 달 전
triton_utils	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 달 전
__init__.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 달 전
_core_ext.py	9296d4b25d feat: dynamo support for ScalarType (#733)	5 달 전
_custom_ops.py	93bc863591 feat: Machete Kernels for Hopper GPUs (#842)	3 달 전
_ipex_ops.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 달 전
connections.py	c6c91edab7 ci: update & overhaul test units (#769)	3 달 전
constants.py	2f61644f6e SPMD optimizations (#824)	3 달 전
py.typed	1c988a48b2 fix logging and add py.typed	1 년 전
scalar_type.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 달 전
version.py	8b8d2ce7e2 ci: bump aphrodite version to 0.6.4.post1 (#859)	3 달 전