david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 926ccfd387e818e3dfd8f3cc5a3d3f51cc82936f

50h100a 8f5adc5a5e make function consistent with comments:		5 maanden geleden
..
fused_moe	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
mamba	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
ops	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
__init__.py	07aa2a492f upstream: add option to specify tokenizer	1 jaar geleden
activation.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
layernorm.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
linear.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
logits_processor.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
pooler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
rejection_sampler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
rotary_embedding.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
sampler.py	8f5adc5a5e make function consistent with comments:	5 maanden geleden
spec_decode_base_sampler.py	09b82f9963 feat: Add support for GPU device selection in SpecDecodeBaseSampler (#629)	5 maanden geleden
typical_acceptance_sampler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden
vocab_parallel_embedding.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 maanden geleden