 AlpinDale
|
b3f9ab3b72
quant: add tensor parallel support for bitsandbytes (#1052)
|
пре 1 месец |
|
AlpinDale
|
f2b6dc3872
cpu: add support for W8A8 quantization via compressed-tensor (#1017)
|
пре 1 месец |
|
AlpinDale
|
6bdff60aab
quant: support pre-quanted bitsandbytes checkpoints (#961)
|
пре 1 месец |
|
AlpinDale
|
64c05b969a
fix: `ShardedStateLoader` with fp8 quant (#900)
|
пре 1 месец |
|
AlpinDale
|
0f1af04cf5
frontend: minor logging improvements (#787)
|
пре 3 месеци |
 50h100a
|
1a5e612eaf
pass tensor progress bar as weight iterator
|
пре 3 месеци |
|
50h100a
|
a061d7578d
gather estimated weight bytes alongside iterator and pass it to model.load_weights
|
пре 3 месеци |
|
AlpinDale
|
7222b84582
feat: ministral support (#776)
|
пре 3 месеци |
|
AlpinDale
|
89a2c6dee1
chore: refactor `MultiModalConfig` initialization and profiling (#745)
|
пре 4 месеци |
|
AlpinDale
|
0b8b407b6d
feat: support profiling with multiple multi-modal inputs per prompt (#712)
|
пре 4 месеци |
|
AlpinDale
|
3693028340
feat: support for Audio modality (#698)
|
пре 4 месеци |
|
AlpinDale
|
5d37ec1016
suppress tpu import warning (#696)
|
пре 4 месеци |
|
AlpinDale
|
3f49a55f82
feat: add INT8 W8A16 quant for TPU (#663)
|
пре 4 месеци |
|
AlpinDale
|
30d7effc7c
feat: add siglip encoder for llava family (#626)
|
пре 5 месеци |
|
AlpinDale
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
пре 5 месеци |
