| .. |
|
adapter_commons
|
99680b2d23
feat: soft prompts (#589)
|
hai 4 meses |
|
attention
|
fa15bad2ea
chore: minor AMD fixes
|
hai 4 meses |
|
common
|
ba371fbbbd
feat: AWQ marlin kernels (#603)
|
hai 4 meses |
|
distributed
|
f91991f584
fix: f-string fixes
|
hai 4 meses |
|
endpoints
|
f91991f584
fix: f-string fixes
|
hai 4 meses |
|
engine
|
a4cbcfe59f
feat: disable logprob serialization to CPU for spec decode
|
hai 4 meses |
|
executor
|
45a004874c
chore: allow specifying custom Executor
|
hai 4 meses |
|
inputs
|
4f7d212b70
feat: remove vision language config
|
hai 4 meses |
|
kv_quant
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
hai 10 meses |
|
lora
|
f91991f584
fix: f-string fixes
|
hai 4 meses |
|
modeling
|
709628a74d
fix
|
hai 4 meses |
|
multimodal
|
f91991f584
fix: f-string fixes
|
hai 4 meses |
|
platforms
|
a3e26391e4
chore: add a wrapper for torch.inference_mode decorator
|
hai 4 meses |
|
processing
|
6ac658b0d6
some small performance improvements
|
hai 4 meses |
|
prompt_adapter
|
f91991f584
fix: f-string fixes
|
hai 4 meses |
|
quantization
|
ba371fbbbd
feat: AWQ marlin kernels (#603)
|
hai 4 meses |
|
spec_decode
|
a4cbcfe59f
feat: disable logprob serialization to CPU for spec decode
|
hai 4 meses |
|
task_handler
|
f91991f584
fix: f-string fixes
|
hai 4 meses |
|
transformers_utils
|
45a004874c
chore: allow specifying custom Executor
|
hai 4 meses |
|
triton_utils
|
c8d398a4ae
feat: add custom triton cache manager
|
hai 4 meses |
|
__init__.py
|
0c17c2a8a7
chore: add commit hash, clean up engine logs
|
hai 4 meses |
|
_custom_ops.py
|
815736fc54
feat: add cuda kernels for sampling
|
hai 4 meses |
|
_ipex_ops.py
|
9d7beaa5b9
chore: separate kv_scale into k_scale and v_scale
|
hai 4 meses |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
hai 1 ano |
|
version.py
|
9038dea2df
fix: short commit hash import error
|
hai 4 meses |
AlpinDale
709628a74d
fix