david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ ea0f57b23361867fef38f17f75225dd4b8679926

AlpinDale ea0f57b233 feat: allow further support for non-cuda devices (#247)		il y a 1 an
..
layers	ea0f57b233 feat: allow further support for non-cuda devices (#247)	il y a 1 an
megatron	85c92acfb3 fix: do not initialize all-reduce at world_size=1	il y a 1 an
models	d9b65e6c5f feat: DeepSeek MoE support (#237)	il y a 1 an
__init__.py	8fa608aeb7 feat: replace Ray with NCCL for control plane comms (#221)	il y a 1 an
hf_downloader.py	4faf78ba29 fix: grab correct quant config from revisions (#246)	il y a 1 an
loader.py	ea0f57b233 feat: allow further support for non-cuda devices (#247)	il y a 1 an
metadata.py	31c95011a6 feat: FP8 E5M2 KV Cache (#226)	il y a 1 an
sampling_metadata.py	1c46fa31ad feat: add quadratic sampling (#233)	il y a 1 an
utils.py	2755a48d51 merge dev branch into main (#153)	il y a 1 an