david/flash-attention

miroir de https://github.com/Dao-AILab/flash-attention

Auteur	SHA1 Message	Date
Tri Dao	d0032700d1 Add tests for Pythia, GPT-JT, and RedPajama models	il y a 1 an
Tri Dao	8a733cbd53 [Gen] Fix calling update_graph_cache in tests	il y a 1 an
Tri Dao	0e8c46ae08 Run isort and black on test files	il y a 1 an
Tri Dao	96d10f6545 Implement LLaMa	il y a 1 an
Tri Dao	393882bc08 [LayerNorm] Implement LN with parallel residual, support dim 8k	il y a 1 an
Tri Dao	993d12448e Implement GPT-NeoX	il y a 1 an