david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ feat/tree-attention

sgsdxzy a3b1602391 fix: rope scaling for cohere and qwen (#436)		9 månader sedan
..
__init__.py	c2aaaefd57 allow out-of-tree model registry	9 månader sedan
baichuan.py	50c2434267 move megatron to a top-level directory	9 månader sedan
bloom.py	50c2434267 move megatron to a top-level directory	9 månader sedan
chatglm.py	50c2434267 move megatron to a top-level directory	9 månader sedan
cohere.py	a3b1602391 fix: rope scaling for cohere and qwen (#436)	9 månader sedan
dbrx.py	50c2434267 move megatron to a top-level directory	9 månader sedan
decilm.py	e31c6f0b45 feat: refactor modeling logic and support more models (#274)	11 månader sedan
deepseek.py	50c2434267 move megatron to a top-level directory	9 månader sedan
falcon.py	50c2434267 move megatron to a top-level directory	9 månader sedan
gemma.py	0d0c6b313c fix: linear bias of qkv layers in models (#430)	9 månader sedan
gpt2.py	50c2434267 move megatron to a top-level directory	9 månader sedan
gpt_bigcode.py	50c2434267 move megatron to a top-level directory	9 månader sedan
gpt_j.py	50c2434267 move megatron to a top-level directory	9 månader sedan
gpt_neox.py	50c2434267 move megatron to a top-level directory	9 månader sedan
internlm2.py	50c2434267 move megatron to a top-level directory	9 månader sedan
llama.py	0d0c6b313c fix: linear bias of qkv layers in models (#430)	9 månader sedan
llava.py	4d33ce60da feat: Triton flash attention backend for ROCm (#407)	9 månader sedan
mixtral.py	50c2434267 move megatron to a top-level directory	9 månader sedan
mpt.py	50c2434267 move megatron to a top-level directory	9 månader sedan
olmo.py	50c2434267 move megatron to a top-level directory	9 månader sedan
opt.py	50c2434267 move megatron to a top-level directory	9 månader sedan
phi.py	50c2434267 move megatron to a top-level directory	9 månader sedan
qwen.py	a3b1602391 fix: rope scaling for cohere and qwen (#436)	9 månader sedan
qwen2.py	a3b1602391 fix: rope scaling for cohere and qwen (#436)	9 månader sedan
qwen2moe.py	a3b1602391 fix: rope scaling for cohere and qwen (#436)	9 månader sedan
stablelm.py	0d0c6b313c fix: linear bias of qkv layers in models (#430)	9 månader sedan