david/flash-attention

spogulis no https://github.com/Dao-AILab/flash-attention

Autors	SHA1 Ziņojums	Datums
Tri Dao	0e8c46ae08 Run isort and black on test files	1 gadu atpakaļ
Tri Dao	93383bd55b [TP] Implement TensorParallel without sequence parallel	1 gadu atpakaļ
Tri Dao	1e712ea8b0 Implement TensorParallel for MHA	2 gadi atpakaļ