david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ dynatempagain

50h100a 8f5adc5a5e make function consistent with comments:		4 months ago
..
fused_moe	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
mamba	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
ops	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
__init__.py	07aa2a492f upstream: add option to specify tokenizer	1 year ago
activation.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
layernorm.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
linear.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
logits_processor.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
pooler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
rejection_sampler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
rotary_embedding.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
sampler.py	8f5adc5a5e make function consistent with comments:	4 months ago
spec_decode_base_sampler.py	09b82f9963 feat: Add support for GPU device selection in SpecDecodeBaseSampler (#629)	4 months ago
typical_acceptance_sampler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
vocab_parallel_embedding.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago