david/flash-attention

réplica de https://github.com/Dao-AILab/flash-attention

Autor	SHA1 Mensaxe	Data
Tri Dao	82dc825759 Don't use the unsafe convert_type function	hai 2 meses
Tri Dao	fe412d6b36 Redo rotary when contiguous	hai 2 meses
Tri Dao	bc8a001d8d Load cos/sin by splitting the work among threads on the same row	hai 2 meses
Tri Dao	0c49ac9a07 Implement rotary non-interleaved	hai 2 meses
Tri Dao	b2d3fe92ff Move rotary to a separate file	hai 2 meses
Tri Dao	9f82a326ad Implement rotary for attn decode	hai 2 meses