david/flash-attention

peilaus alkaen https://github.com/Dao-AILab/flash-attention

Tekijä	SHA1 Viesti	Päivämäärä
Tri Dao	a157cc8c9b [FT] Implement MQA/GQA	1 vuosi sitten
Tri Dao	62e9814466 [Rotary] Make sure frequency calculation is in fp32	1 vuosi sitten
Tri Dao	48bc6eacd6 [Gen] Add rotary base as an argument to FT attention kernel	1 vuosi sitten
Tri Dao	a01d1213d7 [Gen] Add kernel from FasterTransformer for benchmarking	2 vuotta sitten