david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 926ccfd387e818e3dfd8f3cc5a3d3f51cc82936f

50h100a 8f5adc5a5e make function consistent with comments:		5 mesi fa
..
fused_moe	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
mamba	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
ops	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
__init__.py	07aa2a492f upstream: add option to specify tokenizer	1 anno fa
activation.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
layernorm.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
linear.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
logits_processor.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
pooler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
rejection_sampler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
rotary_embedding.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
sampler.py	8f5adc5a5e make function consistent with comments:	5 mesi fa
spec_decode_base_sampler.py	09b82f9963 feat: Add support for GPU device selection in SpecDecodeBaseSampler (#629)	5 mesi fa
typical_acceptance_sampler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa
vocab_parallel_embedding.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 mesi fa