| .. |
|
async_aphrodite
|
055c8905a3
api: add sampling/engine option to return only deltas or final output (#1035)
|
1 месяц назад |
|
basic_correctness
|
304e1e5a8a
core: dump model runner inputs during crash (#1023)
|
1 месяц назад |
|
benchmarks
|
9a7d5514c4
feat: introduce MQAphroditeEngine (#1056)
|
3 недель назад |
|
compile
|
239a8cae25
torch.compile: register all-reduce operations as custom ops (#1050)
|
1 месяц назад |
|
core
|
f7f3fed265
feat: add async postprocessor (#925)
|
1 месяц назад |
|
distributed
|
4d14bd1fe5
vlm: add multi-input support for LLaVA and InternVL models (#1002)
|
1 месяц назад |
|
encoder_decoder
|
a985143768
core: add cuda graph support for encoder-decoder models (#1051)
|
4 недель назад |
|
endpoints
|
6212072245
api: support LoRA lineage and base model metadata management (#1072)
|
3 недель назад |
|
engine
|
3bb0f07461
chore: rename `task_handler` to `worker` (#985)
|
1 месяц назад |
|
kernels
|
61aed092a5
rocm: add support for FP8 KV cache in the custom paged attention kkernels (#1066)
|
3 недель назад |
|
lora
|
3bb0f07461
chore: rename `task_handler` to `worker` (#985)
|
1 месяц назад |
|
metrics
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
modeling
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
models
|
58aff3771d
core: support prompt logprobs in multi-step (#1060)
|
3 недель назад |
|
multi_step
|
58aff3771d
core: support prompt logprobs in multi-step (#1060)
|
3 недель назад |
|
multimodal
|
2aabf8fcf7
vlm: fix errors on ragged NestedTensors (#953)
|
1 месяц назад |
|
plugins
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
prefix_caching
|
6212072245
api: support LoRA lineage and base model metadata management (#1072)
|
3 недель назад |
|
prompt_adapter
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
prompts
|
e1f3fd1e02
fix: test units (#201)
|
1 год назад |
|
quantization
|
6bdff60aab
quant: support pre-quanted bitsandbytes checkpoints (#961)
|
1 месяц назад |
|
samplers
|
2150bb5019
sampler: add range parameter for DRY (#855)
|
1 месяц назад |
|
spec_decode
|
0859dc3bc0
tests: refactor speculative decoding tests to remove the async engine (#1021)
|
1 месяц назад |
|
tensorizer_loader
|
673621a3d2
xpu: refactor the model runner for tensor parallelism (#910)
|
1 месяц назад |
|
tokenization
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
tool_use
|
0191c5efd1
tools: fix tool calls to more strictly follow OpenAI format (#1003)
|
1 месяц назад |
|
tpu
|
ea59784f59
tpu: remove torch._dynamo.reset() (#952)
|
1 месяц назад |
|
weight_loading
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
worker
|
314fa7f7d9
fix: encoder-decoder models for beam search (#1064)
|
3 недель назад |
|
__init__.py
|
2755a48d51
merge dev branch into main (#153)
|
1 год назад |
|
conftest.py
|
58aff3771d
core: support prompt logprobs in multi-step (#1060)
|
3 недель назад |
|
test_cache_block_hashing.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
test_config.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
test_embedded_commit.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
test_inputs.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
test_logits_processor.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
test_regression.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
test_sampling_params.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
test_scalartype.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
test_sequence.py
|
0dfa6b60ec
core: support logprobs with multi-step scheduling (#963)
|
1 месяц назад |
|
test_sharded_state_loader.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
test_utils.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
2 месяцев назад |
|
utils.py
|
58aff3771d
core: support prompt logprobs in multi-step (#1060)
|
3 недель назад |
AlpinDale
6212072245
api: support LoRA lineage and base model metadata management (#1072)