 Tri Dao
|
22c0358f4b
Fix nvcc_from_env not found
|
vor 1 Woche |
|
Tri Dao
|
e94f7e89dc
Always enable PackGQA is Split to reduce compilation and binary size
|
vor 1 Woche |
|
Tri Dao
|
40fa35acd8
Always enable PackGQA if PagedKV to reduce compilation and bin size
|
vor 1 Woche |
|
Tri Dao
|
a84a237d2a
Split bwd softcap compilation units for Sm80
|
vor 1 Woche |
|
Tri Dao
|
518e919a60
Fix softcap compilation
|
vor 1 Woche |
|
Tri Dao
|
ea8cd7fe7b
Ungroup hdim and group softcap for Sm80 compilation
|
vor 1 Woche |
|
Tri Dao
|
df5fe55264
Change tile sizes for Sm8x to reduce stack frame
|
vor 1 Woche |
|
Tri Dao
|
8dd0b479d5
Always enable PackGQA for Sm8x to reduce compilation and binary size
|
vor 1 Woche |
|
Tri Dao
|
9b0f19cc5c
Only use nvcc 12.3 for Sm90, use standard nvcc for Sm80
|
vor 1 Woche |
|
Tri Dao
|
5f525322ec
Only pass sm_90a compile flag to Sm90 kernels, same w Sm89 kernels
|
vor 1 Woche |
|
Tri Dao
|
180ff782dd
Template for Sm86
|
vor 1 Woche |
|
Tri Dao
|
7bc3f031a4
Compile for both Sm80 and Sm90
|
vor 1 Woche |
|
Tri Dao
|
7a802796e1
Big refactor and update
|
vor 1 Woche |
 jayhshah
|
a5a75274bc
FA3 kvcache + split kv + gqa parallelization (#1236)
|
vor 3 Monaten |
 hlky
|
8476986721
Fix FAv3 compilation with MSVC (#1240)
|
vor 4 Monaten |
 Ying Zhang
|
dff976a84a
fixes
|
vor 4 Monaten |
|
Tri Dao
|
bafe253042
[FA3] Bwd
|
vor 5 Monaten |
|
jayhshah
|
5018ac6ac5
Fp8 kernel with "in-kernel" transpose of V in producer (#1100)
|
vor 5 Monaten |
|
Tri Dao
|
3aae9c18c1
Revert "Changes For FP8 (#1075)"
|
vor 5 Monaten |
 ganeshcolfax
|
1899c970c8
Changes For FP8 (#1075)
|
vor 5 Monaten |
 janEbert
|
3c4053b75c
Make FA3 externally importable (#1053)
|
vor 6 Monaten |
|
Tri Dao
|
74b0761ff7
[FA3] BF16 forward
|
vor 6 Monaten |
|
Tri Dao
|
7f67966cc7
FA3 initial code release
|
vor 6 Monaten |
