david/flash-attention

miroir de https://github.com/Dao-AILab/flash-attention

Auteur	SHA1 Message	Date
Tri Dao	f1a73d0740 Run isort and black on python files	il y a 1 an
Tri Dao	96d10f6545 Implement LLaMa	il y a 1 an
Tri Dao	393882bc08 [LayerNorm] Implement LN with parallel residual, support dim 8k	il y a 1 an
Tri Dao	eb33e587e9 [LayerNorm] Rename x1 -> residual	il y a 2 ans
Tri Dao	6738d9477d [LayerNorm] Implement RMS Norm	il y a 2 ans