 Tri Dao
|
2c996ca25f
Use SeqlenInfo for bwd and epilogue
|
hace 1 semana |
|
Tri Dao
|
29cdfedd80
Use Bulk reduce instead of TMA for dQaccum, split across WGs
|
hace 1 semana |
|
Tri Dao
|
82dc825759
Don't use the unsafe convert_type function
|
hace 2 semanas |
|
Tri Dao
|
df96486c31
Decode: varlen, paged KV, leftpad
|
hace 1 mes |
|
Tri Dao
|
6e8b25e426
Refactor
|
hace 2 meses |
 Ying Zhang
|
db80387343
Add seqused_q in fwd / bwd and seqused_k in bwd.
|
hace 3 meses |
 Cameron Shinn
|
3cea2fb6ee
Add ArchTag to pre/postprocess bwd kernels (#1180)
|
hace 3 meses |
|
Tri Dao
|
bafe253042
[FA3] Bwd
|
hace 4 meses |
|
Tri Dao
|
7f67966cc7
FA3 initial code release
|
hace 5 meses |
