david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ ce66e1df56ac3cba35878821b692d101bfb0a3cf

AlpinDale ce66e1df56 fix: sync CPU delay in sampler (#93)		1 vuosi sitten
..
quantized_linear	74604eb252 fix: pylint complaints (#91)	1 vuosi sitten
__init__.py	07aa2a492f upstream: add option to specify tokenizer	1 vuosi sitten
activation.py	74604eb252 fix: pylint complaints (#91)	1 vuosi sitten
attention.py	74604eb252 fix: pylint complaints (#91)	1 vuosi sitten
layernorm.py	74604eb252 fix: pylint complaints (#91)	1 vuosi sitten
rotary_embedding.py	efc6f7fbec chore: reformats (#90)	1 vuosi sitten
sampler.py	ce66e1df56 fix: sync CPU delay in sampler (#93)	1 vuosi sitten