david/flash-attention

kopia lustrzana https://github.com/Dao-AILab/flash-attention

Autor	SHA1 Wiadomość	Data
Tri Dao	d0032700d1 Add tests for Pythia, GPT-JT, and RedPajama models	1 rok temu
Tri Dao	8a733cbd53 [Gen] Fix calling update_graph_cache in tests	1 rok temu
Tri Dao	0e8c46ae08 Run isort and black on test files	1 rok temu
Tri Dao	96d10f6545 Implement LLaMa	1 rok temu
Tri Dao	393882bc08 [LayerNorm] Implement LN with parallel residual, support dim 8k	1 rok temu
Tri Dao	993d12448e Implement GPT-NeoX	1 rok temu