 Tri Dao
|
6807b1ea37
Longest-processing-time-first scheduler for causal
|
hace 1 mes |
|
Tri Dao
|
29cdfedd80
Use Bulk reduce instead of TMA for dQaccum, split across WGs
|
hace 1 mes |
|
Tri Dao
|
314b9edfc0
Don't need to link to cuda lib anymore
|
hace 1 mes |
|
Tri Dao
|
f11624b746
Disable --split-compile due to ptxas register allocation failure
|
hace 1 mes |
|
Tri Dao
|
e8a1edbeb2
Clean up some #include
|
hace 1 mes |
|
Tri Dao
|
8ae77ea17c
Download nvcc 12.3 to compile for best perf
|
hace 1 mes |
|
Tri Dao
|
42fc4962f0
Uncomment tanh softcapping
|
hace 1 mes |
|
Tri Dao
|
6bc55b571c
Use --split-compile to speed up compilation
|
hace 1 mes |
|
Tri Dao
|
9553b2728f
More env vars to disable features
|
hace 1 mes |
|
Tri Dao
|
3248babb9e
QOL: Use env var to selectively disable features
|
hace 1 mes |
|
Tri Dao
|
94657af3e8
Add option for not doing intra-WG overlapping of gemm and softmax
|
hace 1 mes |
|
Tri Dao
|
fc2fd95a18
Renable FP8 kernels
|
hace 1 mes |
|
Tri Dao
|
64d92bce53
Split PagedKV into separate .cu files to speed up compilation
|
hace 1 mes |
|
Tri Dao
|
018b9af683
Move .cu files to instantiations, use generate_kernels.py
|
hace 1 mes |
|
Tri Dao
|
82c1aa3514
Move PackGQA epilogue code to pack_gqa.h
|
hace 2 meses |
|
Tri Dao
|
df96486c31
Decode: varlen, paged KV, leftpad
|
hace 2 meses |
|
Tri Dao
|
6e8b25e426
Refactor
|
hace 3 meses |
 hlky
|
8476986721
Fix FAv3 compilation with MSVC (#1240)
|
hace 4 meses |
 Ying Zhang
|
dff976a84a
fixes
|
hace 4 meses |
|
Tri Dao
|
bafe253042
[FA3] Bwd
|
hace 5 meses |
 jayhshah
|
5018ac6ac5
Fp8 kernel with "in-kernel" transpose of V in producer (#1100)
|
hace 5 meses |
|
Tri Dao
|
3aae9c18c1
Revert "Changes For FP8 (#1075)"
|
hace 5 meses |
 ganeshcolfax
|
1899c970c8
Changes For FP8 (#1075)
|
hace 5 meses |
 janEbert
|
3c4053b75c
Make FA3 externally importable (#1053)
|
hace 5 meses |
|
Tri Dao
|
74b0761ff7
[FA3] BF16 forward
|
hace 6 meses |
|
Tri Dao
|
7f67966cc7
FA3 initial code release
|
hace 6 meses |
