| .. |
|
adapter_commons
|
99680b2d23
feat: soft prompts (#589)
|
vor 6 Monaten |
|
attention
|
a2d476183f
fix: remove scipy and re-implement CSR matrix
|
vor 6 Monaten |
|
common
|
ddb28a80a3
fix: bump torch for rocm, unify CUDA_VISIBLE_DEVICES for cuda and rocm
|
vor 6 Monaten |
|
distributed
|
cc6399792f
fix: keep consistent with how pytorch finds libcudart.so
|
vor 6 Monaten |
|
endpoints
|
a3b56353fa
fix: another one missed
|
vor 6 Monaten |
|
engine
|
63becc67c0
fix: prompt logprob detokenization
|
vor 6 Monaten |
|
executor
|
4501ae5f15
fix: neuron executor for adapters
|
vor 6 Monaten |
|
inputs
|
4f7d212b70
feat: remove vision language config
|
vor 6 Monaten |
|
kv_quant
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
vor 1 Jahr |
|
lora
|
99680b2d23
feat: soft prompts (#589)
|
vor 6 Monaten |
|
modeling
|
05e45aeb53
fix: dtype mismatch for paligemma
|
vor 6 Monaten |
|
multimodal
|
c11a8bdaad
fix: calculate max number of multi-modal tokens automatically
|
vor 6 Monaten |
|
platforms
|
1a40bf438b
fix: incorrect gpu capability when used mixed gpus
|
vor 6 Monaten |
|
processing
|
99680b2d23
feat: soft prompts (#589)
|
vor 6 Monaten |
|
prompt_adapter
|
99680b2d23
feat: soft prompts (#589)
|
vor 6 Monaten |
|
quantization
|
500f3b654f
fix: support bias term in compressed-tensors quant
|
vor 6 Monaten |
|
spec_decode
|
16dff9babc
chore: enable bonus token in spec decoding for KV cache based models
|
vor 6 Monaten |
|
task_handler
|
ddb28a80a3
fix: bump torch for rocm, unify CUDA_VISIBLE_DEVICES for cuda and rocm
|
vor 6 Monaten |
|
transformers_utils
|
63becc67c0
fix: prompt logprob detokenization
|
vor 6 Monaten |
|
__init__.py
|
a07fc83bc8
chore: proper util for aphrodite version
|
vor 7 Monaten |
|
_custom_ops.py
|
ad24e74a99
feat: FP8 weight-only quantization support for Ampere GPUs
|
vor 6 Monaten |
|
_ipex_ops.py
|
6a57861fca
feat: initial XPU support via intel_extension_for_pytorch (#571)
|
vor 7 Monaten |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
vor 1 Jahr |
|
version.py
|
7e54c3916d
chore: factor out epilogues from cutlass kernels
|
vor 7 Monaten |
AlpinDale
05e45aeb53
fix: dtype mismatch for paligemma