AlpinDale f7f3fed265 feat: add async postprocessor (#925) 2 kuukautta sitten
..
async_aphrodite c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
basic_correctness f7f3fed265 feat: add async postprocessor (#925) 2 kuukautta sitten
benchmarks f7f3fed265 feat: add async postprocessor (#925) 2 kuukautta sitten
compile c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
core f7f3fed265 feat: add async postprocessor (#925) 2 kuukautta sitten
distributed d69273bd2b ray: better error when placement group topology is incorrect (#906) 3 kuukautta sitten
endpoints 0c162c8dad api: use fp32 for base64 embeddings (#919) 2 kuukautta sitten
engine f7f3fed265 feat: add async postprocessor (#925) 2 kuukautta sitten
kernels 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 3 kuukautta sitten
lora 68f050129d fix: lora worker manager test import 3 kuukautta sitten
metrics c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
modeling c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
models fce970a846 feat: multi-image input support for Phi3V (#917) 2 kuukautta sitten
multi_step f7f3fed265 feat: add async postprocessor (#925) 2 kuukautta sitten
multimodal c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
plugins c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
prefix_caching 3d83e64f8e feat: add metrics for prefix cache hit rate (#829) 3 kuukautta sitten
prompt_adapter c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
prompts e1f3fd1e02 fix: test units (#201) 1 vuosi sitten
quantization 7f1c9af5e2 fix: fp8 quant test 3 kuukautta sitten
samplers 2150bb5019 sampler: add range parameter for DRY (#855) 3 kuukautta sitten
spec_decode 3b684a8a54 spec decode: streamline batch expansion tensor manipulation (#918) 2 kuukautta sitten
tensorizer_loader 673621a3d2 xpu: refactor the model runner for tensor parallelism (#910) 2 kuukautta sitten
tokenization c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
weight_loading c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
worker 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) 3 kuukautta sitten
__init__.py 2755a48d51 merge dev branch into main (#153) 1 vuosi sitten
conftest.py 653d1a08d4 feat: add support for audio models (#891) 3 kuukautta sitten
test_cache_block_hashing.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
test_config.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
test_embedded_commit.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
test_inputs.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
test_logits_processor.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
test_regression.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
test_sampling_params.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
test_scalartype.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
test_sequence.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
test_sharded_state_loader.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
test_utils.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten
utils.py c6c91edab7 ci: update & overhaul test units (#769) 3 kuukautta sitten