AlpinDale d46e70ac98 api: add inline model loading (#928) vor 2 Wochen
..
__init__.py 07aa2a492f upstream: add option to specify tokenizer vor 1 Jahr
block.py 7df7b8ca53 optimization: reduce end-to-end overhead from python obj allocation (#666) vor 4 Monaten
config.py 8d9f1fd4e6 feat: add single user mode (#927) vor 2 Wochen
connections.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 4 Monaten
envs.py d46e70ac98 api: add inline model loading (#928) vor 2 Wochen
grammar.py 8a71788372 Add OLMoE (#772) vor 2 Monaten
logger.py 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) vor 3 Wochen
logits_processor.py 8a71788372 Add OLMoE (#772) vor 2 Monaten
outputs.py 0e558e9b2f fix: loading chameleon model with TP>1 (#695) vor 4 Monaten
pooling_params.py 2f61644f6e SPMD optimizations (#824) vor 1 Monat
sampling_params.py 8d9f1fd4e6 feat: add single user mode (#927) vor 2 Wochen
sequence.py f7f3fed265 feat: add async postprocessor (#925) vor 2 Wochen
test_utils.py 8a71788372 Add OLMoE (#772) vor 2 Monaten
utils.py 22a4cd4595 core: fix spec decode metrics and envs circular import (#889) vor 3 Wochen