| .. |
|
__init__.py
|
89a2c6dee1
chore: refactor `MultiModalConfig` initialization and profiling (#745)
|
4 mesi fa |
|
loader.py
|
349a612338
chore: bump bitsandbytes version to latest; enable cuda graphs for 4bit bnb (#1123)
|
5 giorni fa |
|
neuron.py
|
145e554a4d
neuron: add 8bit quantization for Neuron (#994)
|
1 mese fa |
|
openvino.py
|
0dfa6b60ec
core: support logprobs with multi-step scheduling (#963)
|
1 mese fa |
|
tensorizer.py
|
5b03d67abb
Core: add output streaming support to multi-step + async (#1112)
|
2 settimane fa |
|
utils.py
|
9f3e7c86e2
feat: add fused Marlin MoE kernel (#934)
|
1 mese fa |
|
weight_utils.py
|
3e6addcc2c
LLM: enable batched inference for llm.chat() API (#1120)
|
5 giorni fa |
AlpinDale
349a612338
chore: bump bitsandbytes version to latest; enable cuda graphs for 4bit bnb (#1123)