AlpinDale 1fac86c325 core: factor out common code in SequenceData (#1083) 2 veckor sedan
..
async_aphrodite 055c8905a3 api: add sampling/engine option to return only deltas or final output (#1035) 4 veckor sedan
basic_correctness 7b6501bd05 tests: refactor model tests (#1078) 2 veckor sedan
benchmarks 86bf2cc4f3 core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080) 2 veckor sedan
compile 239a8cae25 torch.compile: register all-reduce operations as custom ops (#1050) 3 veckor sedan
core f7f3fed265 feat: add async postprocessor (#925) 1 månad sedan
distributed 7b6501bd05 tests: refactor model tests (#1078) 2 veckor sedan
encoder_decoder a985143768 core: add cuda graph support for encoder-decoder models (#1051) 3 veckor sedan
endpoints 6212072245 api: support LoRA lineage and base model metadata management (#1072) 3 veckor sedan
engine 3bb0f07461 chore: rename `task_handler` to `worker` (#985) 1 månad sedan
kernels 7b6501bd05 tests: refactor model tests (#1078) 2 veckor sedan
lora 3bb0f07461 chore: rename `task_handler` to `worker` (#985) 1 månad sedan
metrics c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
modeling c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
models 86bf2cc4f3 core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080) 2 veckor sedan
mq_aphrodite_engine 86bf2cc4f3 core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080) 2 veckor sedan
multi_step 58aff3771d core: support prompt logprobs in multi-step (#1060) 3 veckor sedan
multimodal 2aabf8fcf7 vlm: fix errors on ragged NestedTensors (#953) 1 månad sedan
plugins c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
prefix_caching 6212072245 api: support LoRA lineage and base model metadata management (#1072) 3 veckor sedan
prompt_adapter c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
prompts e1f3fd1e02 fix: test units (#201) 1 år sedan
quantization 6bdff60aab quant: support pre-quanted bitsandbytes checkpoints (#961) 1 månad sedan
samplers 1fac86c325 core: factor out common code in SequenceData (#1083) 2 veckor sedan
spec_decode 1fac86c325 core: factor out common code in SequenceData (#1083) 2 veckor sedan
tensorizer_loader 673621a3d2 xpu: refactor the model runner for tensor parallelism (#910) 1 månad sedan
tokenization c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
tool_use 0191c5efd1 tools: fix tool calls to more strictly follow OpenAI format (#1003) 4 veckor sedan
tpu ea59784f59 tpu: remove torch._dynamo.reset() (#952) 1 månad sedan
weight_loading c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
worker 1fac86c325 core: factor out common code in SequenceData (#1083) 2 veckor sedan
__init__.py 2755a48d51 merge dev branch into main (#153) 1 år sedan
conftest.py 7b6501bd05 tests: refactor model tests (#1078) 2 veckor sedan
test_cache_block_hashing.py c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
test_config.py c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
test_embedded_commit.py c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
test_inputs.py c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
test_logits_processor.py 1fac86c325 core: factor out common code in SequenceData (#1083) 2 veckor sedan
test_regression.py c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
test_sampling_params.py c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
test_scalartype.py c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
test_sequence.py 1fac86c325 core: factor out common code in SequenceData (#1083) 2 veckor sedan
test_sharded_state_loader.py c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
test_utils.py c6c91edab7 ci: update & overhaul test units (#769) 2 månader sedan
utils.py 7b6501bd05 tests: refactor model tests (#1078) 2 veckor sedan