david/flash-attention

réplica de https://github.com/Dao-AILab/flash-attention

Autor	SHA1 Mensaxe	Data
Tri Dao	94657af3e8 Add option for not doing intra-WG overlapping of gemm and softmax	hai 1 mes
Tri Dao	fe412d6b36 Redo rotary when contiguous	hai 1 mes
Tri Dao	b2d3fe92ff Move rotary to a separate file	hai 1 mes
Tri Dao	4d00645c76 Implement appending new KV to KV cache	hai 1 mes
Tri Dao	d00b88ee05 Move PagedKV to a separate file	hai 1 mes