david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 5240c0da23c3ac7df244377a6613b38c269cdcf5

AlpinDale 5240c0da23 fix: avoid unnecessary ray import warnings		7 maanden geleden
..
attention	cda0e93a10 abstract away the platform for device capability	7 maanden geleden
common	5240c0da23 fix: avoid unnecessary ray import warnings	7 maanden geleden
distributed	ae04f57ec1 feat: Pipeline Parallel support (#581)	7 maanden geleden
endpoints	2ed49cdc4c fix: kobold api generation	7 maanden geleden
engine	5240c0da23 fix: avoid unnecessary ray import warnings	7 maanden geleden
executor	5240c0da23 fix: avoid unnecessary ray import warnings	7 maanden geleden
inputs	3a0fdf7b9b chore: remove `image_input_type` from VLM config	7 maanden geleden
kv_quant	e42a78381a feat: switch from pylint to ruff (#322)	1 jaar geleden
lora	cda0e93a10 abstract away the platform for device capability	7 maanden geleden
modeling	4599c98f99 feat: dynamic image size support for VLMs	7 maanden geleden
multimodal	4599c98f99 feat: dynamic image size support for VLMs	7 maanden geleden
platforms	cda0e93a10 abstract away the platform for device capability	7 maanden geleden
processing	5be90c3859 Mamba infrastrucuture support (#586)	7 maanden geleden
quantization	cda0e93a10 abstract away the platform for device capability	7 maanden geleden
spec_decode	5be90c3859 Mamba infrastrucuture support (#586)	7 maanden geleden
task_handler	4599c98f99 feat: dynamic image size support for VLMs	7 maanden geleden
transformers_utils	4599c98f99 feat: dynamic image size support for VLMs	7 maanden geleden
__init__.py	a07fc83bc8 chore: proper util for aphrodite version	7 maanden geleden
_custom_ops.py	5be90c3859 Mamba infrastrucuture support (#586)	7 maanden geleden
_ipex_ops.py	6a57861fca feat: initial XPU support via intel_extension_for_pytorch (#571)	7 maanden geleden
py.typed	1c988a48b2 fix logging and add py.typed	1 jaar geleden
version.py	7e54c3916d chore: factor out epilogues from cutlass kernels	7 maanden geleden