Tri Dao
|
a157cc8c9b
[FT] Implement MQA/GQA
|
1 год назад |
Tri Dao
|
62e9814466
[Rotary] Make sure frequency calculation is in fp32
|
1 год назад |
Tri Dao
|
48bc6eacd6
[Gen] Add rotary base as an argument to FT attention kernel
|
1 год назад |
Tri Dao
|
a01d1213d7
[Gen] Add kernel from FasterTransformer for benchmarking
|
1 год назад |