david/flash-attention

réplica de https://github.com/Dao-AILab/flash-attention

Autor	SHA1 Mensaxe	Data
sclarkson	1feb711f46 Fix compilation with clang on ARM64 (#1285)	hai 2 meses
Tri Dao	e45a46a5b7 [Rotary] Implement GPT-J style (interleaved) rotary	hai 1 ano
Tri Dao	1e712ea8b0 Implement TensorParallel for MHA	%!s(int64=2) %!d(string=hai) anos
Tri Dao	ca81f32e04 Implement rotary embedding in CUDA	%!s(int64=2) %!d(string=hai) anos