| .. |
|
adapter_commons
|
2f61644f6e
SPMD optimizations (#824)
|
hace 3 meses |
|
assets
|
653d1a08d4
feat: add support for audio models (#891)
|
hace 2 meses |
|
attention
|
d6cbbba95f
Revert "fix: issues with flashinfer fp8 kv (#950)" (#956)
|
hace 2 meses |
|
common
|
5bec8fbb1b
tpu: add support for async postprocessing (#968)
|
hace 2 meses |
|
compilation
|
0e5cf7f840
tpu: avoid dynamo guard eval overhead (#949)
|
hace 2 meses |
|
distributed
|
2940da2c7b
distributed: fix custom allreduce p2p cache file generation (#922)
|
hace 2 meses |
|
endpoints
|
39b2e83ac3
api: optimize zeromq frontend performance (#951)
|
hace 2 meses |
|
engine
|
0dfa6b60ec
core: support logprobs with multi-step scheduling (#963)
|
hace 2 meses |
|
executor
|
0dfa6b60ec
core: support logprobs with multi-step scheduling (#963)
|
hace 2 meses |
|
inputs
|
908ff753a1
fix: phi_3.5_v loading (#896)
|
hace 2 meses |
|
kv_quant
|
8a71788372
Add OLMoE (#772)
|
hace 5 meses |
|
lora
|
bf4a4d8516
fix: do not register punica with torch if using older torch (#948)
|
hace 2 meses |
|
modeling
|
a8bdd488b9
distributed: support pipeline parallelism for internvl and internlm2 (#965)
|
hace 2 meses |
|
multimodal
|
2aabf8fcf7
vlm: fix errors on ragged NestedTensors (#953)
|
hace 2 meses |
|
platforms
|
9f3e7c86e2
feat: add fused Marlin MoE kernel (#934)
|
hace 2 meses |
|
plugins
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
hace 2 meses |
|
processing
|
5be6225f38
core: support multi-step scheduling w/ async post-processor (#955)
|
hace 2 meses |
|
prompt_adapter
|
2f61644f6e
SPMD optimizations (#824)
|
hace 3 meses |
|
quantization
|
0dfa6b60ec
core: support logprobs with multi-step scheduling (#963)
|
hace 2 meses |
|
server
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
hace 2 meses |
|
spec_decode
|
0dfa6b60ec
core: support logprobs with multi-step scheduling (#963)
|
hace 2 meses |
|
task_handler
|
5bec8fbb1b
tpu: add support for async postprocessing (#968)
|
hace 2 meses |
|
transformers_utils
|
9f3e7c86e2
feat: add fused Marlin MoE kernel (#934)
|
hace 2 meses |
|
triton_utils
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hace 6 meses |
|
__init__.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hace 6 meses |
|
_core_ext.py
|
f1ea7711bd
core: do not compile ScalarType for torch < 2.4.0 (#938)
|
hace 2 meses |
|
_custom_ops.py
|
fcfcfc65e1
quants: add triton kernels for AWQ (#946)
|
hace 2 meses |
|
_ipex_ops.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hace 6 meses |
|
connections.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
hace 3 meses |
|
constants.py
|
2f61644f6e
SPMD optimizations (#824)
|
hace 3 meses |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
hace 1 año |
|
scalar_type.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hace 6 meses |
|
version.py
|
cbd51a208a
ci: bump to 0.6.5 (#964)
|
hace 2 meses |
AlpinDale
5bec8fbb1b
tpu: add support for async postprocessing (#968)