| .. |
|
adapter_commons
|
6b1fdd07bd
chore: add isort and refactor formatting script and utils
|
hace 4 meses |
|
attention
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
|
common
|
2b85ffb1a5
chore: minor cleanups
|
hace 4 meses |
|
distributed
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
|
endpoints
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
|
engine
|
28946766fb
fix: allow loading GGUF model without .gguf extension
|
hace 4 meses |
|
executor
|
87694c8aba
feat: add RPC server and client via ZMQ (#615)
|
hace 4 meses |
|
inputs
|
1ab2dad198
Refactor prompt processing (#605)
|
hace 4 meses |
|
kv_quant
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
hace 10 meses |
|
lora
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
|
modeling
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
|
multimodal
|
705e50f4bd
fix: broadcasting logic for multi_modal_kwargs
|
hace 4 meses |
|
platforms
|
a3e26391e4
chore: add a wrapper for torch.inference_mode decorator
|
hace 4 meses |
|
processing
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
|
prompt_adapter
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
|
quantization
|
208cd5405f
fix: cpu offloading with gptq
|
hace 4 meses |
|
server
|
040e5af52b
refactor: factor out code for running uvicorn again
|
hace 4 meses |
|
spec_decode
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
|
task_handler
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
|
transformers_utils
|
28946766fb
fix: allow loading GGUF model without .gguf extension
|
hace 4 meses |
|
triton_utils
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
|
__init__.py
|
0c17c2a8a7
chore: add commit hash, clean up engine logs
|
hace 4 meses |
|
_core_ext.py
|
141672a0d4
kernels: disambiguate quantized types via a new ScalarType
|
hace 4 meses |
|
_custom_ops.py
|
0e6c400b13
feat: re-add GGUF (#600)
|
hace 4 meses |
|
_ipex_ops.py
|
9d7beaa5b9
chore: separate kv_scale into k_scale and v_scale
|
hace 4 meses |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
hace 1 año |
|
scalar_type.py
|
141672a0d4
kernels: disambiguate quantized types via a new ScalarType
|
hace 4 meses |
|
version.py
|
c1c37c755d
bump version to 0.6.0
|
hace 4 meses |
AlpinDale
c1c37c755d
bump version to 0.6.0