david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 82128ec8438f369e2926c9e685653ab4f8ddd288

AlpinDale 82128ec843 fix: over-processing with chunked prefill + prefix caching		1 kuukausi sitten
..
adapter_commons	2f61644f6e SPMD optimizations (#824)	2 kuukautta sitten
assets	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
attention	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
common	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
distributed	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
endpoints	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
engine	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
executor	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
inputs	2f61644f6e SPMD optimizations (#824)	2 kuukautta sitten
kv_quant	8a71788372 Add OLMoE (#772)	3 kuukautta sitten
lora	369600855a xpu: disable punica kernels for XPU (#864)	1 kuukausi sitten
modeling	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
multimodal	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
platforms	81c28d2a7f fix: use nvml to get consistent device names (#739)	4 kuukautta sitten
plugins	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
processing	82128ec843 fix: over-processing with chunked prefill + prefix caching	1 kuukausi sitten
prompt_adapter	2f61644f6e SPMD optimizations (#824)	2 kuukautta sitten
quantization	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
server	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
spec_decode	1405051912 attention: add `AttentionState` abstraction (#863)	1 kuukausi sitten
task_handler	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
transformers_utils	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
triton_utils	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 kuukautta sitten
__init__.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 kuukautta sitten
_core_ext.py	9296d4b25d feat: dynamo support for ScalarType (#733)	4 kuukautta sitten
_custom_ops.py	93bc863591 feat: Machete Kernels for Hopper GPUs (#842)	2 kuukautta sitten
_ipex_ops.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 kuukautta sitten
connections.py	c6c91edab7 ci: update & overhaul test units (#769)	2 kuukautta sitten
constants.py	2f61644f6e SPMD optimizations (#824)	2 kuukautta sitten
envs.py	901900854e chore: consolidate environment variables within one file (#882)	1 kuukausi sitten
py.typed	1c988a48b2 fix logging and add py.typed	1 vuosi sitten
scalar_type.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 kuukautta sitten
version.py	8b8d2ce7e2 ci: bump aphrodite version to 0.6.4.post1 (#859)	1 kuukausi sitten