 Tri Dao
|
6807b1ea37
Longest-processing-time-first scheduler for causal
|
il y a 1 jour |
|
Tri Dao
|
fb9c9cbbe9
Support qkv_descale of shape (batch_size, nheads_kv)
|
il y a 3 jours |
|
Tri Dao
|
6293008748
Add option for Mma0_is_RS and Mma1_is_RS in attn fwd
|
il y a 1 semaine |
|
Tri Dao
|
88fdffc16e
Fix test for softcap FP8
|
il y a 1 semaine |
|
Tri Dao
|
f5e89ff136
Tune tile size for bwd softcap
|
il y a 1 semaine |
|
Tri Dao
|
29cdfedd80
Use Bulk reduce instead of TMA for dQaccum, split across WGs
|
il y a 1 semaine |
|
Tri Dao
|
9c954f7021
Use num_split_heuristics in fwd and fwd_varlen
|
il y a 1 semaine |
|
Tri Dao
|
199c82052c
Fix test for has_batch_idx
|
il y a 2 semaines |
|
Tri Dao
|
42fc4962f0
Uncomment tanh softcapping
|
il y a 2 semaines |
|
Tri Dao
|
3248babb9e
QOL: Use env var to selectively disable features
|
il y a 2 semaines |
|
Tri Dao
|
c9c40eba83
Uncomment local attn
|
il y a 2 semaines |
|
Tri Dao
|
94657af3e8
Add option for not doing intra-WG overlapping of gemm and softmax
|
il y a 3 semaines |
|
Tri Dao
|
f0b5a6ec4c
Wait for barrier_O at load_tail to avoid Cluster error
|
il y a 3 semaines |
|
Tri Dao
|
fc2fd95a18
Renable FP8 kernels
|
il y a 3 semaines |
|
Tri Dao
|
3d0d147940
Early stop on actual num_splits in mha_combine kernel
|
il y a 3 semaines |
|
Tri Dao
|
1dc3364774
Consolidate seqlen info into a struct
|
il y a 3 semaines |
|
Tri Dao
|
0c49ac9a07
Implement rotary non-interleaved
|
il y a 3 semaines |
|
Tri Dao
|
9f82a326ad
Implement rotary for attn decode
|
il y a 4 semaines |
|
Tri Dao
|
4d00645c76
Implement appending new KV to KV cache
|
il y a 1 mois |
|
Tri Dao
|
82c1aa3514
Move PackGQA epilogue code to pack_gqa.h
|
il y a 1 mois |
|
Tri Dao
|
df96486c31
Decode: varlen, paged KV, leftpad
|
il y a 1 mois |
|
Tri Dao
|
ea7a98f15d
Fix backward with softcap
|
il y a 2 mois |
|
Tri Dao
|
6e8b25e426
Refactor
|
il y a 2 mois |
 Ying Zhang
|
be6c1b98c4
small fixes
|
il y a 3 mois |
|
Ying Zhang
|
dff976a84a
fixes
|
il y a 3 mois |
|
Ying Zhang
|
8cbc8a042f
small fixes
|
il y a 3 mois |
|
Ying Zhang
|
db80387343
Add seqused_q in fwd / bwd and seqused_k in bwd.
|
il y a 3 mois |
 jayhshah
|
c92ca63268
FA3 FP8 qkv descales + restore max offset for h128 causal + added sync for producer WG (#1173)
|
il y a 3 mois |
|
Ying Zhang
|
53537da422
add a unittest
|
il y a 4 mois |
|
Tri Dao
|
c33de664a1
Fix import in test
|
il y a 4 mois |
