| .. |
|
adapter_commons
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 mesiacov pred |
|
attention
|
7a313483f1
chore: move update_flash_attn_metadata to attn backend (#731)
|
5 mesiacov pred |
|
common
|
8a71788372
Add OLMoE (#772)
|
4 mesiacov pred |
|
distributed
|
ef3a0f4cb1
fix: `custom_ar` check (#737)
|
5 mesiacov pred |
|
endpoints
|
8a71788372
Add OLMoE (#772)
|
4 mesiacov pred |
|
engine
|
73177656ed
feat: quant_llm support (#755)
|
5 mesiacov pred |
|
executor
|
89a2c6dee1
chore: refactor `MultiModalConfig` initialization and profiling (#745)
|
5 mesiacov pred |
|
inputs
|
89a2c6dee1
chore: refactor `MultiModalConfig` initialization and profiling (#745)
|
5 mesiacov pred |
|
kv_quant
|
8a71788372
Add OLMoE (#772)
|
4 mesiacov pred |
|
lora
|
d9d85eeb6e
chore: register lora functions as torch ops (#732)
|
5 mesiacov pred |
|
modeling
|
8a71788372
Add OLMoE (#772)
|
4 mesiacov pred |
|
multimodal
|
89a2c6dee1
chore: refactor `MultiModalConfig` initialization and profiling (#745)
|
5 mesiacov pred |
|
platforms
|
81c28d2a7f
fix: use nvml to get consistent device names (#739)
|
5 mesiacov pred |
|
plugins
|
f76f2a5af0
feat: add aphrodite plugin system (#705)
|
6 mesiacov pred |
|
processing
|
577586309d
chore: multi-step args and sequence modifications (#713)
|
6 mesiacov pred |
|
prompt_adapter
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 mesiacov pred |
|
quantization
|
8a71788372
Add OLMoE (#772)
|
4 mesiacov pred |
|
server
|
ed9a6f97c1
fix: kill api server when pinging dead engine (#660)
|
6 mesiacov pred |
|
spec_decode
|
89a2c6dee1
chore: refactor `MultiModalConfig` initialization and profiling (#745)
|
5 mesiacov pred |
|
task_handler
|
81c5f196eb
chore: various TPU fixes and optimizations (#746)
|
5 mesiacov pred |
|
transformers_utils
|
8a71788372
Add OLMoE (#772)
|
4 mesiacov pred |
|
triton_utils
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 mesiacov pred |
|
__init__.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 mesiacov pred |
|
_core_ext.py
|
9296d4b25d
feat: dynamo support for ScalarType (#733)
|
5 mesiacov pred |
|
_custom_ops.py
|
73177656ed
feat: quant_llm support (#755)
|
5 mesiacov pred |
|
_ipex_ops.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 mesiacov pred |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
1 rok pred |
|
scalar_type.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 mesiacov pred |
|
version.py
|
0e0bd02b52
ci: bump version to 0.6.2 (#758)
|
5 mesiacov pred |
Fizz~
8a71788372
Add OLMoE (#772)