david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 926ccfd387e818e3dfd8f3cc5a3d3f51cc82936f

50h100a 8f5adc5a5e make function consistent with comments:		5 месяцев назад
..
fused_moe	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
mamba	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
ops	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
__init__.py	07aa2a492f upstream: add option to specify tokenizer	1 год назад
activation.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
layernorm.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
linear.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
logits_processor.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
pooler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
rejection_sampler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
rotary_embedding.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
sampler.py	8f5adc5a5e make function consistent with comments:	5 месяцев назад
spec_decode_base_sampler.py	09b82f9963 feat: Add support for GPU device selection in SpecDecodeBaseSampler (#629)	5 месяцев назад
typical_acceptance_sampler.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад
vocab_parallel_embedding.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	5 месяцев назад