AlpinDale adb6982090 models: add support for IBM Granite (PowerLM) models (#978) преди 2 седмици
..
adapter_commons 2f61644f6e SPMD optimizations (#824) преди 1 месец
assets 653d1a08d4 feat: add support for audio models (#891) преди 3 седмици
attention 032974a28a tpu: fix TPU type api (#975) преди 2 седмици
common b3f6eeb1d2 vlm: increase the default `max_num_batched_tokens` for multimodal models (#973) преди 2 седмици
compilation 0e5cf7f840 tpu: avoid dynamo guard eval overhead (#949) преди 2 седмици
distributed 61103b92d4 tpu: support single and multi-host TPUs on GKE and RayServe (#970) преди 2 седмици
endpoints 0f72141ca2 api: support multiple input images преди 2 седмици
engine d4e78a428b fix: crash when cancelling a request with multi-step (#977) преди 2 седмици
executor 61103b92d4 tpu: support single and multi-host TPUs on GKE and RayServe (#970) преди 2 седмици
inputs 908ff753a1 fix: phi_3.5_v loading (#896) преди 3 седмици
kv_quant 8a71788372 Add OLMoE (#772) преди 2 месеца
lora bf4a4d8516 fix: do not register punica with torch if using older torch (#948) преди 2 седмици
modeling adb6982090 models: add support for IBM Granite (PowerLM) models (#978) преди 2 седмици
multimodal 2aabf8fcf7 vlm: fix errors on ragged NestedTensors (#953) преди 2 седмици
platforms 9f3e7c86e2 feat: add fused Marlin MoE kernel (#934) преди 2 седмици
plugins 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) преди 3 седмици
processing 5be6225f38 core: support multi-step scheduling w/ async post-processor (#955) преди 2 седмици
prompt_adapter 2f61644f6e SPMD optimizations (#824) преди 1 месец
quantization 201db10f02 models: add support for Phi3 MoE преди 2 седмици
server 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) преди 3 седмици
spec_decode 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) преди 2 седмици
task_handler b3f6eeb1d2 vlm: increase the default `max_num_batched_tokens` for multimodal models (#973) преди 2 седмици
transformers_utils adb6982090 models: add support for IBM Granite (PowerLM) models (#978) преди 2 седмици
triton_utils f1d0b77c92 [0.6.0] Release Candidate (#481) преди 4 месеца
__init__.py f1d0b77c92 [0.6.0] Release Candidate (#481) преди 4 месеца
_core_ext.py f1ea7711bd core: do not compile ScalarType for torch < 2.4.0 (#938) преди 2 седмици
_custom_ops.py fcfcfc65e1 quants: add triton kernels for AWQ (#946) преди 2 седмици
_ipex_ops.py f1d0b77c92 [0.6.0] Release Candidate (#481) преди 4 месеца
connections.py c6c91edab7 ci: update & overhaul test units (#769) преди 1 месец
constants.py 2f61644f6e SPMD optimizations (#824) преди 1 месец
py.typed 1c988a48b2 fix logging and add py.typed преди 1 година
scalar_type.py f1d0b77c92 [0.6.0] Release Candidate (#481) преди 4 месеца
version.py cbd51a208a ci: bump to 0.6.5 (#964) преди 2 седмици