 AlpinDale
|
d8c4193704
feat: Speculative Decoding using a draft model (#432)
|
9 hónapja |
 AlpinDale
|
083ba7b452
roll back chunked prefill changes to SDPA, isolate cpu worker
|
10 hónapja |
|
AlpinDale
|
8c67b37131
fix docstrings
|
10 hónapja |
|
AlpinDale
|
50c2434267
move megatron to a top-level directory
|
10 hónapja |
|
AlpinDale
|
4d33ce60da
feat: Triton flash attention backend for ROCm (#407)
|
10 hónapja |
|
AlpinDale
|
9e9057a614
separate init_distributed_environment from worker
|
10 hónapja |
|
AlpinDale
|
a304f76d89
feat: Intel CPU support (#403)
|
10 hónapja |
