 Tri Dao
|
a93359a2bf
If PackGQA, use producer threads instead of Mma threads to load Q
|
пре 4 недеља |
|
Tri Dao
|
84f1287e42
Rename bool_constant<true> to true_type, same w bool_constant<false>
|
пре 4 недеља |
|
Tri Dao
|
7bc3f031a4
Compile for both Sm80 and Sm90
|
пре 1 месец |
|
Tri Dao
|
7a802796e1
Big refactor and update
|
пре 1 месец |
 Kai Londenberg
|
0823cf7b5d
Fix FA3 Varlen Performance regression (#1361)
|
пре 2 месеци |
 Kai Londenberg
|
b443207c1f
Paged Attention support for FA3 (#1268)
|
пре 2 месеци |
 jayhshah
|
a5a75274bc
FA3 kvcache + split kv + gqa parallelization (#1236)
|
пре 3 месеци |
 Ying Zhang
|
dff976a84a
fixes
|
пре 5 месеци |
|
Ying Zhang
|
7b4e68e04f
hopper local attention
|
пре 5 месеци |
|
jayhshah
|
c92ca63268
FA3 FP8 qkv descales + restore max offset for h128 causal + added sync for producer WG (#1173)
|
пре 5 месеци |
|
jayhshah
|
5018ac6ac5
Fp8 kernel with "in-kernel" transpose of V in producer (#1100)
|
пре 6 месеци |
|
Tri Dao
|
3aae9c18c1
Revert "Changes For FP8 (#1075)"
|
пре 6 месеци |
 ganeshcolfax
|
1899c970c8
Changes For FP8 (#1075)
|
пре 6 месеци |
 Ying Zhang
|
dfe1a59e4b
Add var-seq-len to FA3 fp16 / bf16 fwd (#1072)
|
пре 6 месеци |
|
Tri Dao
|
74b0761ff7
[FA3] BF16 forward
|
пре 6 месеци |
|
Tri Dao
|
7f67966cc7
FA3 initial code release
|
пре 7 месеци |
