| .. |
|
adapter_commons
|
2f61644f6e
SPMD optimizations (#824)
|
3 months ago |
|
assets
|
653d1a08d4
feat: add support for audio models (#891)
|
2 months ago |
|
attention
|
f7f3fed265
feat: add async postprocessor (#925)
|
2 months ago |
|
common
|
f7f3fed265
feat: add async postprocessor (#925)
|
2 months ago |
|
distributed
|
2940da2c7b
distributed: fix custom allreduce p2p cache file generation (#922)
|
2 months ago |
|
endpoints
|
53d0ba7c7c
api: add endpoint for loading and unloading the model (#926)
|
2 months ago |
|
engine
|
f7f3fed265
feat: add async postprocessor (#925)
|
2 months ago |
|
executor
|
0c6d90dade
neuron: add support for tensor parallelism (#923)
|
2 months ago |
|
inputs
|
908ff753a1
fix: phi_3.5_v loading (#896)
|
2 months ago |
|
kv_quant
|
8a71788372
Add OLMoE (#772)
|
5 months ago |
|
lora
|
369600855a
xpu: disable punica kernels for XPU (#864)
|
3 months ago |
|
modeling
|
5cb2e998d8
quants: update compressed tensors lifecycle to remove `prefix` from `create_weights` (#924)
|
2 months ago |
|
multimodal
|
653d1a08d4
feat: add support for audio models (#891)
|
2 months ago |
|
platforms
|
81c28d2a7f
fix: use nvml to get consistent device names (#739)
|
5 months ago |
|
plugins
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
2 months ago |
|
processing
|
f7f3fed265
feat: add async postprocessor (#925)
|
2 months ago |
|
prompt_adapter
|
2f61644f6e
SPMD optimizations (#824)
|
3 months ago |
|
quantization
|
f7f3fed265
feat: add async postprocessor (#925)
|
2 months ago |
|
server
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
2 months ago |
|
spec_decode
|
3b684a8a54
spec decode: streamline batch expansion tensor manipulation (#918)
|
2 months ago |
|
task_handler
|
f7f3fed265
feat: add async postprocessor (#925)
|
2 months ago |
|
transformers_utils
|
132aa2abe4
spec decode: add support for EAGLE (#899)
|
2 months ago |
|
triton_utils
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 months ago |
|
__init__.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 months ago |
|
_core_ext.py
|
9296d4b25d
feat: dynamo support for ScalarType (#733)
|
5 months ago |
|
_custom_ops.py
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
3 months ago |
|
_ipex_ops.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 months ago |
|
connections.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
3 months ago |
|
constants.py
|
2f61644f6e
SPMD optimizations (#824)
|
3 months ago |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
1 year ago |
|
scalar_type.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 months ago |
|
version.py
|
8b8d2ce7e2
ci: bump aphrodite version to 0.6.4.post1 (#859)
|
3 months ago |
AlpinDale
53d0ba7c7c
api: add endpoint for loading and unloading the model (#926)