david/flash-attention

-ын хуулбар https://github.com/Dao-AILab/flash-attention

Эзэн	SHA1 Мессеж	Огноо
Tri Dao	94657af3e8 Add option for not doing intra-WG overlapping of gemm and softmax	1 сар өмнө
Tri Dao	fe412d6b36 Redo rotary when contiguous	1 сар өмнө
Tri Dao	b2d3fe92ff Move rotary to a separate file	2 сар өмнө
Tri Dao	4d00645c76 Implement appending new KV to KV cache	2 сар өмнө
Tri Dao	d00b88ee05 Move PagedKV to a separate file	2 сар өмнө