AlpinDale 7b6501bd05 tests: refactor model tests (#1078) il y a 1 jour
..
async_aphrodite 055c8905a3 api: add sampling/engine option to return only deltas or final output (#1035) il y a 1 semaine
basic_correctness 7b6501bd05 tests: refactor model tests (#1078) il y a 1 jour
benchmarks 9a7d5514c4 feat: introduce MQAphroditeEngine (#1056) il y a 1 semaine
compile 239a8cae25 torch.compile: register all-reduce operations as custom ops (#1050) il y a 1 semaine
core f7f3fed265 feat: add async postprocessor (#925) il y a 2 semaines
distributed 7b6501bd05 tests: refactor model tests (#1078) il y a 1 jour
encoder_decoder a985143768 core: add cuda graph support for encoder-decoder models (#1051) il y a 1 semaine
endpoints 6212072245 api: support LoRA lineage and base model metadata management (#1072) il y a 4 jours
engine 3bb0f07461 chore: rename `task_handler` to `worker` (#985) il y a 2 semaines
kernels 7b6501bd05 tests: refactor model tests (#1078) il y a 1 jour
lora 3bb0f07461 chore: rename `task_handler` to `worker` (#985) il y a 2 semaines
metrics c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
modeling c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
models 7b6501bd05 tests: refactor model tests (#1078) il y a 1 jour
multi_step 58aff3771d core: support prompt logprobs in multi-step (#1060) il y a 6 jours
multimodal 2aabf8fcf7 vlm: fix errors on ragged NestedTensors (#953) il y a 2 semaines
plugins c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
prefix_caching 6212072245 api: support LoRA lineage and base model metadata management (#1072) il y a 4 jours
prompt_adapter c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
prompts e1f3fd1e02 fix: test units (#201) il y a 11 mois
quantization 6bdff60aab quant: support pre-quanted bitsandbytes checkpoints (#961) il y a 2 semaines
samplers 2150bb5019 sampler: add range parameter for DRY (#855) il y a 1 mois
spec_decode 0859dc3bc0 tests: refactor speculative decoding tests to remove the async engine (#1021) il y a 1 semaine
tensorizer_loader 673621a3d2 xpu: refactor the model runner for tensor parallelism (#910) il y a 3 semaines
tokenization c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
tool_use 0191c5efd1 tools: fix tool calls to more strictly follow OpenAI format (#1003) il y a 1 semaine
tpu ea59784f59 tpu: remove torch._dynamo.reset() (#952) il y a 2 semaines
weight_loading c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
worker 314fa7f7d9 fix: encoder-decoder models for beam search (#1064) il y a 5 jours
__init__.py 2755a48d51 merge dev branch into main (#153) il y a 1 an
conftest.py 7b6501bd05 tests: refactor model tests (#1078) il y a 1 jour
test_cache_block_hashing.py c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
test_config.py c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
test_embedded_commit.py c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
test_inputs.py c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
test_logits_processor.py c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
test_regression.py c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
test_sampling_params.py c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
test_scalartype.py c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
test_sequence.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) il y a 2 semaines
test_sharded_state_loader.py c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
test_utils.py c6c91edab7 ci: update & overhaul test units (#769) il y a 1 mois
utils.py 7b6501bd05 tests: refactor model tests (#1078) il y a 1 jour