AlpinDale d46e70ac98 api: add inline model loading (#928) 3 weken geleden
..
__init__.py 07aa2a492f upstream: add option to specify tokenizer 1 jaar geleden
block.py 7df7b8ca53 optimization: reduce end-to-end overhead from python obj allocation (#666) 4 maanden geleden
config.py 8d9f1fd4e6 feat: add single user mode (#927) 3 weken geleden
connections.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 maanden geleden
envs.py d46e70ac98 api: add inline model loading (#928) 3 weken geleden
grammar.py 8a71788372 Add OLMoE (#772) 2 maanden geleden
logger.py 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) 3 weken geleden
logits_processor.py 8a71788372 Add OLMoE (#772) 2 maanden geleden
outputs.py 0e558e9b2f fix: loading chameleon model with TP>1 (#695) 4 maanden geleden
pooling_params.py 2f61644f6e SPMD optimizations (#824) 1 maand geleden
sampling_params.py 8d9f1fd4e6 feat: add single user mode (#927) 3 weken geleden
sequence.py f7f3fed265 feat: add async postprocessor (#925) 3 weken geleden
test_utils.py 8a71788372 Add OLMoE (#772) 2 maanden geleden
utils.py 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) 3 weken geleden