 Tri Dao
|
0890032358
Implement backward pass for Sm80
|
2 weeks ago |
|
Tri Dao
|
14894c5717
Make BwdPostprocessKernel work with Sm80
|
3 weeks ago |
|
Tri Dao
|
2c996ca25f
Use SeqlenInfo for bwd and epilogue
|
1 month ago |
|
Tri Dao
|
29cdfedd80
Use Bulk reduce instead of TMA for dQaccum, split across WGs
|
1 month ago |
|
Tri Dao
|
82dc825759
Don't use the unsafe convert_type function
|
2 months ago |
|
Tri Dao
|
6e8b25e426
Refactor
|
3 months ago |
 Ying Zhang
|
db80387343
Add seqused_q in fwd / bwd and seqused_k in bwd.
|
5 months ago |
 Cameron Shinn
|
3cea2fb6ee
Add ArchTag to pre/postprocess bwd kernels (#1180)
|
5 months ago |
|
Tri Dao
|
bafe253042
[FA3] Bwd
|
5 months ago |
