david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention).

AlpinDale 2150bb5019 sampler: add range parameter for DRY (#855)		1 month ago
..
__init__.py	c6c91edab7 ci: update & overhaul test units (#769)	1 month ago
test_beam_search.py	9b317aa26a feat: finish up tests and workflows (#87)	1 year ago
test_ignore_eos.py	c6c91edab7 ci: update & overhaul test units (#769)	1 month ago
test_logits_processor.py	c6c91edab7 ci: update & overhaul test units (#769)	1 month ago
test_logprobs.py	32a37e8107 tests: partially fix tensorizer and logprobs tests	1 month ago
test_ranks.py	c6c91edab7 ci: update & overhaul test units (#769)	1 month ago
test_rejection_sampling.py	c6c91edab7 ci: update & overhaul test units (#769)	1 month ago
test_sampler.py	2150bb5019 sampler: add range parameter for DRY (#855)	1 month ago
test_seeded_generate.py	c6c91edab7 ci: update & overhaul test units (#769)	1 month ago
test_typical_acceptance_sampler.py	c6c91edab7 ci: update & overhaul test units (#769)	1 month ago