 Jay Shah
|
b3d60fa3a5
prune more dead code
|
пре 4 месеци |
|
Jay Shah
|
c06cc0ba9f
change cu_seqlens_k to seqused_k for kv cache api
|
пре 4 месеци |
|
Jay Shah
|
7c1473e0e5
remove Is_batch_dynamic from seqlen traits and handle fp8 perf regression using smem boolean
|
пре 4 месеци |
|
Jay Shah
|
8374e1fa78
remove test code
|
пре 4 месеци |
|
Jay Shah
|
35f3542442
refactor names
|
пре 4 месеци |
|
Jay Shah
|
d437d3dd5c
remove smem usage for when rmem -> gmem epilogue is used
|
пре 4 месеци |
|
Jay Shah
|
81d402463e
prune unused code
|
пре 5 месеци |
|
Jay Shah
|
6111666130
consolidate nblock min max methods
|
пре 5 месеци |
|
Jay Shah
|
b5cac6d586
rebase with Is_local disabled temporarily
|
пре 5 месеци |
|
Jay Shah
|
2472e5e0b4
add 'in principle' fp8 kv cache support
|
пре 5 месеци |
|
Jay Shah
|
e36e004cb3
change fp8 code path to allow for split kernel and kv cache without perf regression
|
пре 5 месеци |
|
Jay Shah
|
f3e5bd47cb
update parameters
|
пре 5 месеци |
|
Jay Shah
|
68ff3f7bee
add 1 mma warpgroup option, enable splitkv for hdim 256
|
пре 6 месеци |
|
Jay Shah
|
0a1a0c22b6
refactor for split kv
|
пре 6 месеци |
|
Jay Shah
|
0c4cea947b
add in lse writeout and store zero
|
пре 6 месеци |
|
Jay Shah
|
64a9cfb0fe
add causal logic
|
пре 6 месеци |
|
Jay Shah
|
5704a1f424
fix some errors
|
пре 6 месеци |
|
Jay Shah
|
535b8279bb
complete gqa parallel changes for non-causal
|
пре 6 месеци |
|
Jay Shah
|
fc8f704f28
decouple types of seqlen traits q and k
|
пре 6 месеци |
|
Jay Shah
|
74f160ba43
change template parameter for SeqLenTraits for ease of further extension
|
пре 6 месеци |
 Ying Zhang
|
7b4e68e04f
hopper local attention
|
пре 6 месеци |
|
jayhshah
|
c92ca63268
FA3 FP8 qkv descales + restore max offset for h128 causal + added sync for producer WG (#1173)
|
пре 6 месеци |
|
Ying Zhang
|
a3a257c71d
Fix out-of-bound writes for var-seq-len zero-length KVs
|
пре 6 месеци |
|
jayhshah
|
5018ac6ac5
Fp8 kernel with "in-kernel" transpose of V in producer (#1100)
|
пре 7 месеци |
 Ying Zhang
|
dfe1a59e4b
Add var-seq-len to FA3 fp16 / bf16 fwd (#1072)
|
пре 7 месеци |
 Tri Dao
|
74b0761ff7
[FA3] BF16 forward
|
пре 7 месеци |
|
Tri Dao
|
7f67966cc7
FA3 initial code release
|
пре 7 месеци |
