 Tri Dao
|
76f14c61c9
Tune fwd tile sizes for Sm86 and Sm89
|
hai 1 mes |
|
Tri Dao
|
c3cdc0fd88
Add sm_margin as an option for overlapping with communication
|
hai 1 mes |
|
Tri Dao
|
3e5d77a102
Group instantiations for different hdims together
|
hai 1 mes |
|
Tri Dao
|
fb9c9cbbe9
Support qkv_descale of shape (batch_size, nheads_kv)
|
hai 1 mes |
|
Tri Dao
|
9c954f7021
Use num_split_heuristics in fwd and fwd_varlen
|
hai 2 meses |
|
Tri Dao
|
9fd6b977bb
Precompute the pointers in mha_combine kernel
|
hai 2 meses |
|
Tri Dao
|
64d92bce53
Split PagedKV into separate .cu files to speed up compilation
|
hai 2 meses |
|
Tri Dao
|
018b9af683
Move .cu files to instantiations, use generate_kernels.py
|
hai 2 meses |
|
Tri Dao
|
9f82a326ad
Implement rotary for attn decode
|
hai 2 meses |
|
Tri Dao
|
4d00645c76
Implement appending new KV to KV cache
|
hai 2 meses |
|
Tri Dao
|
a65af55f4a
Move mask_fn and load_Q into separate functions
|
hai 2 meses |
|
Tri Dao
|
df96486c31
Decode: varlen, paged KV, leftpad
|
hai 2 meses |
|
Tri Dao
|
6e8b25e426
Refactor
|
hai 4 meses |
 Ying Zhang
|
7b4e68e04f
hopper local attention
|
hai 5 meses |
|
Ying Zhang
|
db80387343
Add seqused_q in fwd / bwd and seqused_k in bwd.
|
hai 5 meses |
 jayhshah
|
c92ca63268
FA3 FP8 qkv descales + restore max offset for h128 causal + added sync for producer WG (#1173)
|
hai 5 meses |
|
Tri Dao
|
bafe253042
[FA3] Bwd
|
hai 6 meses |
 Ying Zhang
|
dfe1a59e4b
Add var-seq-len to FA3 fp16 / bf16 fwd (#1072)
|
hai 6 meses |
 Cameron Shinn
|
cb516f855b
Remove torchlib dependency from cpp files (#1083)
|
hai 6 meses |
|
Tri Dao
|
74b0761ff7
[FA3] BF16 forward
|
hai 6 meses |
|
Tri Dao
|
7f67966cc7
FA3 initial code release
|
hai 7 meses |
