AlpinDale 7b6501bd05 tests: refactor model tests (#1078) 1 dzień temu
..
async_aphrodite 055c8905a3 api: add sampling/engine option to return only deltas or final output (#1035) 1 tydzień temu
basic_correctness 7b6501bd05 tests: refactor model tests (#1078) 1 dzień temu
benchmarks 9a7d5514c4 feat: introduce MQAphroditeEngine (#1056) 1 tydzień temu
compile 239a8cae25 torch.compile: register all-reduce operations as custom ops (#1050) 1 tydzień temu
core f7f3fed265 feat: add async postprocessor (#925) 2 tygodni temu
distributed 7b6501bd05 tests: refactor model tests (#1078) 1 dzień temu
encoder_decoder a985143768 core: add cuda graph support for encoder-decoder models (#1051) 1 tydzień temu
endpoints 6212072245 api: support LoRA lineage and base model metadata management (#1072) 4 dni temu
engine 3bb0f07461 chore: rename `task_handler` to `worker` (#985) 2 tygodni temu
kernels 7b6501bd05 tests: refactor model tests (#1078) 1 dzień temu
lora 3bb0f07461 chore: rename `task_handler` to `worker` (#985) 2 tygodni temu
metrics c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
modeling c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
models 7b6501bd05 tests: refactor model tests (#1078) 1 dzień temu
multi_step 58aff3771d core: support prompt logprobs in multi-step (#1060) 6 dni temu
multimodal 2aabf8fcf7 vlm: fix errors on ragged NestedTensors (#953) 2 tygodni temu
plugins c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
prefix_caching 6212072245 api: support LoRA lineage and base model metadata management (#1072) 4 dni temu
prompt_adapter c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
prompts e1f3fd1e02 fix: test units (#201) 11 miesięcy temu
quantization 6bdff60aab quant: support pre-quanted bitsandbytes checkpoints (#961) 2 tygodni temu
samplers 2150bb5019 sampler: add range parameter for DRY (#855) 1 miesiąc temu
spec_decode 0859dc3bc0 tests: refactor speculative decoding tests to remove the async engine (#1021) 1 tydzień temu
tensorizer_loader 673621a3d2 xpu: refactor the model runner for tensor parallelism (#910) 3 tygodni temu
tokenization c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
tool_use 0191c5efd1 tools: fix tool calls to more strictly follow OpenAI format (#1003) 1 tydzień temu
tpu ea59784f59 tpu: remove torch._dynamo.reset() (#952) 2 tygodni temu
weight_loading c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
worker 314fa7f7d9 fix: encoder-decoder models for beam search (#1064) 5 dni temu
__init__.py 2755a48d51 merge dev branch into main (#153) 1 rok temu
conftest.py 7b6501bd05 tests: refactor model tests (#1078) 1 dzień temu
test_cache_block_hashing.py c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
test_config.py c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
test_embedded_commit.py c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
test_inputs.py c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
test_logits_processor.py c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
test_regression.py c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
test_sampling_params.py c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
test_scalartype.py c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
test_sequence.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 2 tygodni temu
test_sharded_state_loader.py c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
test_utils.py c6c91edab7 ci: update & overhaul test units (#769) 1 miesiąc temu
utils.py 7b6501bd05 tests: refactor model tests (#1078) 1 dzień temu