 Tri Dao
|
4d00645c76
Implement appending new KV to KV cache
|
2 months ago |
|
Tri Dao
|
82c1aa3514
Move PackGQA epilogue code to pack_gqa.h
|
2 months ago |
|
Tri Dao
|
df96486c31
Decode: varlen, paged KV, leftpad
|
2 months ago |
|
Tri Dao
|
ea7a98f15d
Fix backward with softcap
|
3 months ago |
|
Tri Dao
|
6e8b25e426
Refactor
|
3 months ago |
 Ying Zhang
|
be6c1b98c4
small fixes
|
4 months ago |
|
Ying Zhang
|
dff976a84a
fixes
|
4 months ago |
|
Ying Zhang
|
8cbc8a042f
small fixes
|
4 months ago |
|
Ying Zhang
|
db80387343
Add seqused_q in fwd / bwd and seqused_k in bwd.
|
5 months ago |
 jayhshah
|
c92ca63268
FA3 FP8 qkv descales + restore max offset for h128 causal + added sync for producer WG (#1173)
|
5 months ago |
|
Ying Zhang
|
53537da422
add a unittest
|
5 months ago |
|
Tri Dao
|
c33de664a1
Fix import in test
|
5 months ago |
|
Tri Dao
|
bafe253042
[FA3] Bwd
|
5 months ago |
|
jayhshah
|
5018ac6ac5
Fp8 kernel with "in-kernel" transpose of V in producer (#1100)
|
6 months ago |
|
Tri Dao
|
3aae9c18c1
Revert "Changes For FP8 (#1075)"
|
6 months ago |
 ganeshcolfax
|
1899c970c8
Changes For FP8 (#1075)
|
6 months ago |
 Ying Zhang
|
dfe1a59e4b
Add var-seq-len to FA3 fp16 / bf16 fwd (#1072)
|
6 months ago |
|
Tri Dao
|
74b0761ff7
[FA3] BF16 forward
|
6 months ago |
|
Tri Dao
|
7f67966cc7
FA3 initial code release
|
6 months ago |
