david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ hunyuan

AlpinDale ba2c3fc88d feat: add Tencent Hunyuan model support		2 ماه پیش
..
adapter_commons	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 ماه پیش
attention	ba2c3fc88d feat: add Tencent Hunyuan model support	2 ماه پیش
common	ba2c3fc88d feat: add Tencent Hunyuan model support	2 ماه پیش
distributed	0f1af04cf5 frontend: minor logging improvements (#787)	2 ماه پیش
endpoints	2fa112f86b feat: update to serviceinfo v0.2 (#808)	2 ماه پیش
engine	0256ed236b feat: windows support (#790)	2 ماه پیش
executor	89a2c6dee1 chore: refactor `MultiModalConfig` initialization and profiling (#745)	3 ماه پیش
inputs	89a2c6dee1 chore: refactor `MultiModalConfig` initialization and profiling (#745)	3 ماه پیش
kv_quant	8a71788372 Add OLMoE (#772)	2 ماه پیش
lora	d9d85eeb6e chore: register lora functions as torch ops (#732)	3 ماه پیش
modeling	ba2c3fc88d feat: add Tencent Hunyuan model support	2 ماه پیش
multimodal	89a2c6dee1 chore: refactor `MultiModalConfig` initialization and profiling (#745)	3 ماه پیش
platforms	81c28d2a7f fix: use nvml to get consistent device names (#739)	3 ماه پیش
plugins	f76f2a5af0 feat: add aphrodite plugin system (#705)	4 ماه پیش
processing	577586309d chore: multi-step args and sequence modifications (#713)	3 ماه پیش
prompt_adapter	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 ماه پیش
quantization	f98e7b2f8c feat: add HQQ quantization support (#795)	2 ماه پیش
server	0256ed236b feat: windows support (#790)	2 ماه پیش
spec_decode	89a2c6dee1 chore: refactor `MultiModalConfig` initialization and profiling (#745)	3 ماه پیش
task_handler	0f1af04cf5 frontend: minor logging improvements (#787)	2 ماه پیش
transformers_utils	fb96041ae3 fix: demote skip_special_tokens assertion to logger error (#778)	2 ماه پیش
triton_utils	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 ماه پیش
__init__.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 ماه پیش
_core_ext.py	9296d4b25d feat: dynamo support for ScalarType (#733)	3 ماه پیش
_custom_ops.py	f98e7b2f8c feat: add HQQ quantization support (#795)	2 ماه پیش
_ipex_ops.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 ماه پیش
py.typed	1c988a48b2 fix logging and add py.typed	1 سال پیش
scalar_type.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 ماه پیش
version.py	f0e00f1b43 ci: bump to 0.6.3.post1 (#801)	2 ماه پیش