david/flash-attention

mirror of https://github.com/Dao-AILab/flash-attention

Author	SHA1 Message	Date
Tri Dao	d0032700d1 Add tests for Pythia, GPT-JT, and RedPajama models	1 year ago
Tri Dao	8a733cbd53 [Gen] Fix calling update_graph_cache in tests	1 year ago
Tri Dao	0e8c46ae08 Run isort and black on test files	1 year ago
Tri Dao	96d10f6545 Implement LLaMa	1 year ago
Tri Dao	393882bc08 [LayerNorm] Implement LN with parallel residual, support dim 8k	1 year ago
Tri Dao	993d12448e Implement GPT-NeoX	1 year ago