david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention).

AlpinDale 3bb0f07461 chore: rename `task_handler` to `worker` (#985)		hai 2 semanas
..
data	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
__init__.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
conftest.py	3bb0f07461 chore: rename `task_handler` to `worker` (#985)	hai 2 semanas
test_baichuan.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_chatglm3.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_gemma.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_layers.py	3661de812d fix: lora layer test	hai 1 mes
test_llama.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_long_context.py	3bb0f07461 chore: rename `task_handler` to `worker` (#985)	hai 2 semanas
test_lora_checkpoints.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_lora_huggingface.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_lora_manager.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_mixtral.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_phi.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_punica_sizes.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_punica_variation.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_quant_model.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_tokenizer_group.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_utils.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes
test_worker.py	3bb0f07461 chore: rename `task_handler` to `worker` (#985)	hai 2 semanas
utils.py	c6c91edab7 ci: update & overhaul test units (#769)	hai 1 mes