david/flash-attention

réplica de https://github.com/Dao-AILab/flash-attention

Autor	SHA1 Mensaxe	Data
Tri Dao	f1a73d0740 Run isort and black on python files	hai 1 ano
Tri Dao	96d10f6545 Implement LLaMa	hai 1 ano
Tri Dao	4d87e4d875 Implement GPT-J	hai 1 ano
Tri Dao	78b7a1dc18 [OPT] Load fp16 weights on CPU before moving to GPU	hai 1 ano
Tri Dao	ff34123bd4 Reorder LN in Block, support OPT	hai 1 ano