david/flash-attention

-ын хуулбар https://github.com/Dao-AILab/flash-attention

Эзэн	SHA1 Мессеж	Огноо
Tri Dao	3b6ac2b954 Use compile time constants in local mask	1 сар өмнө
Tri Dao	bfbaafd043 Fix bwd reading out of out LSE	1 сар өмнө
Tri Dao	3ed79742fb Add option to shuffle LSE and dPsum in the bwd	1 сар өмнө
Tri Dao	7fccac78ce Fix Mask	2 сар өмнө
Tri Dao	a65af55f4a Move mask_fn and load_Q into separate functions	2 сар өмнө