david/flash-attention

mirror of https://github.com/Dao-AILab/flash-attention

Author	SHA1 Message	Date
Tri Dao	f1a73d0740 Run isort and black on python files	1 year ago
Tri Dao	96d10f6545 Implement LLaMa	1 year ago
Tri Dao	393882bc08 [LayerNorm] Implement LN with parallel residual, support dim 8k	1 year ago
Tri Dao	eb33e587e9 [LayerNorm] Rename x1 -> residual	1 year ago
Tri Dao	6738d9477d [LayerNorm] Implement RMS Norm	2 years ago