 jayhshah
|
a5a75274bc
FA3 kvcache + split kv + gqa parallelization (#1236)
|
hace 2 meses |
 Ying Zhang
|
a3a257c71d
Fix out-of-bound writes for var-seq-len zero-length KVs
|
hace 4 meses |
 Ying Zhang
|
3669b25206
bwd benchmark + small fixes (#1129)
|
hace 4 meses |
|
jayhshah
|
5018ac6ac5
Fp8 kernel with "in-kernel" transpose of V in producer (#1100)
|
hace 4 meses |
 Tri Dao
|
3aae9c18c1
Revert "Changes For FP8 (#1075)"
|
hace 4 meses |
 ganeshcolfax
|
1899c970c8
Changes For FP8 (#1075)
|
hace 4 meses |
|
Ying Zhang
|
dfe1a59e4b
Add var-seq-len to FA3 fp16 / bf16 fwd (#1072)
|
hace 4 meses |
|
Tri Dao
|
74b0761ff7
[FA3] BF16 forward
|
hace 5 meses |
|
Tri Dao
|
7f67966cc7
FA3 initial code release
|
hace 5 meses |
