david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ c3b15f0926dd24885d9f780f01a451d26fd52653

AlpinDale a788ca33bf hack in custom bias for attention kernels		9 сар өмнө
..
__init__.py	a788ca33bf hack in custom bias for attention kernels	9 сар өмнө
baichuan.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
bloom.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
chatglm.py	e31c6f0b45 feat: refactor modeling logic and support more models (#274)	10 сар өмнө
cohere.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
decilm.py	e31c6f0b45 feat: refactor modeling logic and support more models (#274)	10 сар өмнө
deepseek.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
falcon.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
gemma.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
gpt2.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
gpt_bigcode.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
gpt_j.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
gpt_neox.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
internlm2.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
llama.py	6ebac34dc1 chore: cleaner pre-llamafied Yi implementation (#352)	9 сар өмнө
mixtral.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
mixtral_quant.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
mpt.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
olmo.py	e42a78381a feat: switch from pylint to ruff (#322)	10 сар өмнө
opt.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
phi.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
qwen.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
qwen2.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
stablelm.py	da223153c6 feat&fix: cohere support and missing GPU blocks (#333)	9 сар өмнө
t5.py	f009f94ffd update modeling code	9 сар өмнө