david/flash-attention

miroir de https://github.com/Dao-AILab/flash-attention

Auteur	SHA1 Message	Date
Tri Dao	0e8c46ae08 Run isort and black on test files	il y a 1 an
Tri Dao	88173a1aaf [FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP	il y a 1 an
Tri Dao	93383bd55b [TP] Implement TensorParallel without sequence parallel	il y a 1 an
Tri Dao	b4018a5028 Implement Tensor Parallel for GPT model	il y a 2 ans
Tri Dao	a8cfe51551 Implement Tensor Parallel for transformer Block	il y a 2 ans