 Tri Dao
|
ae3c1fb3e0
Simplify bwd by setting NumdQWarpGroups = NumMmaWarpGroups
|
hai 4 semanas |
|
Tri Dao
|
2c996ca25f
Use SeqlenInfo for bwd and epilogue
|
hai 1 mes |
|
Tri Dao
|
3b6ac2b954
Use compile time constants in local mask
|
hai 1 mes |
|
Tri Dao
|
bfbaafd043
Fix bwd reading out of out LSE
|
hai 1 mes |
|
Tri Dao
|
29cdfedd80
Use Bulk reduce instead of TMA for dQaccum, split across WGs
|
hai 1 mes |
|
Tri Dao
|
e8a1edbeb2
Clean up some #include
|
hai 1 mes |
|
Tri Dao
|
3ed79742fb
Add option to shuffle LSE and dPsum in the bwd
|
hai 1 mes |
|
Tri Dao
|
82dc825759
Don't use the unsafe convert_type function
|
hai 1 mes |
|
Tri Dao
|
df96486c31
Decode: varlen, paged KV, leftpad
|
hai 1 mes |
|
Tri Dao
|
ea7a98f15d
Fix backward with softcap
|
hai 2 meses |
|
Tri Dao
|
6e8b25e426
Refactor
|
hai 3 meses |
 Ying Zhang
|
1c9717d699
address comments
|
hai 3 meses |
|
Ying Zhang
|
dff976a84a
fixes
|
hai 4 meses |
|
Ying Zhang
|
7b4e68e04f
hopper local attention
|
hai 4 meses |
|
Ying Zhang
|
db80387343
Add seqused_q in fwd / bwd and seqused_k in bwd.
|
hai 4 meses |
|
Tri Dao
|
bafe253042
[FA3] Bwd
|
hai 5 meses |
