| .. |
|
async_aphrodite
|
055c8905a3
api: add sampling/engine option to return only deltas or final output (#1035)
|
il y a 1 mois |
|
basic_correctness
|
7b6501bd05
tests: refactor model tests (#1078)
|
il y a 1 mois |
|
benchmarks
|
86bf2cc4f3
core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080)
|
il y a 1 mois |
|
compile
|
239a8cae25
torch.compile: register all-reduce operations as custom ops (#1050)
|
il y a 1 mois |
|
core
|
be0b0c13ca
tests: update scheduler tests (#1113)
|
il y a 2 semaines |
|
distributed
|
c90abcc603
VLM: add pipeline parallelism support for Qwen2-VL (#1103)
|
il y a 2 semaines |
|
encoder_decoder
|
a985143768
core: add cuda graph support for encoder-decoder models (#1051)
|
il y a 1 mois |
|
endpoints
|
3e6addcc2c
LLM: enable batched inference for llm.chat() API (#1120)
|
il y a 1 semaine |
|
engine
|
cc5e185795
VLM: support passing multimodal processor kwargs (#1102)
|
il y a 2 semaines |
|
kernels
|
172dee2573
(2/N) Triton Backend: integrate Triton activation kernels (#1126)
|
il y a 6 jours |
|
lora
|
69cf654901
LoRA: add assertions for SGMV kernels to avoid incorrect results (#1104)
|
il y a 2 semaines |
|
metrics
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
modeling
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
models
|
80be38ca6f
chore: expose phi3_v num_crops as an mm_processor_kwargs (#1117)
|
il y a 2 semaines |
|
mq_aphrodite_engine
|
86bf2cc4f3
core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080)
|
il y a 1 mois |
|
multi_step
|
58aff3771d
core: support prompt logprobs in multi-step (#1060)
|
il y a 1 mois |
|
multimodal
|
cc5e185795
VLM: support passing multimodal processor kwargs (#1102)
|
il y a 2 semaines |
|
plugins
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
prefix_caching
|
6212072245
api: support LoRA lineage and base model metadata management (#1072)
|
il y a 1 mois |
|
prompt_adapter
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
prompts
|
e1f3fd1e02
fix: test units (#201)
|
il y a 1 an |
|
quantization
|
349a612338
chore: bump bitsandbytes version to latest; enable cuda graphs for 4bit bnb (#1123)
|
il y a 1 semaine |
|
samplers
|
eb1ffacf74
Spec Decoding: fix typical acceptance sampler with correct recovered tok IDs (#1106)
|
il y a 2 semaines |
|
spec_decode
|
1fac86c325
core: factor out common code in SequenceData (#1083)
|
il y a 1 mois |
|
tensorizer_loader
|
673621a3d2
xpu: refactor the model runner for tensor parallelism (#910)
|
il y a 1 mois |
|
tokenization
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
tool_use
|
0191c5efd1
tools: fix tool calls to more strictly follow OpenAI format (#1003)
|
il y a 1 mois |
|
tpu
|
ea59784f59
tpu: remove torch._dynamo.reset() (#952)
|
il y a 1 mois |
|
weight_loading
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
worker
|
1fac86c325
core: factor out common code in SequenceData (#1083)
|
il y a 1 mois |
|
__init__.py
|
2755a48d51
merge dev branch into main (#153)
|
il y a 1 an |
|
conftest.py
|
7b6501bd05
tests: refactor model tests (#1078)
|
il y a 1 mois |
|
test_cache_block_hashing.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
test_config.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
test_embedded_commit.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
test_inputs.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
test_logits_processor.py
|
1fac86c325
core: factor out common code in SequenceData (#1083)
|
il y a 1 mois |
|
test_regression.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
test_sampling_params.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
test_scalartype.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
test_sequence.py
|
1fac86c325
core: factor out common code in SequenceData (#1083)
|
il y a 1 mois |
|
test_sharded_state_loader.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
test_utils.py
|
c6c91edab7
ci: update & overhaul test units (#769)
|
il y a 2 mois |
|
utils.py
|
5b03d67abb
Core: add output streaming support to multi-step + async (#1112)
|
il y a 2 semaines |
AlpinDale
172dee2573
(2/N) Triton Backend: integrate Triton activation kernels (#1126)