AlpinDale ea0f57b233 feat: allow further support for non-cuda devices (#247) 1 year ago
..
__init__.py 07aa2a492f upstream: add option to specify tokenizer 1 year ago
block.py 8fa608aeb7 feat: replace Ray with NCCL for control plane comms (#221) 1 year ago
config.py ea0f57b233 feat: allow further support for non-cuda devices (#247) 1 year ago
grammar.py 0adab894fe feat: grammar support (#206) 1 year ago
logger.py 8834ecf9de chore: clean up refactor endpoints (#98) 1 year ago
logits_processor.py 53a9c60442 fix: logit processor declarations and application (#242) 1 year ago
outputs.py c0aac15421 feat: S-LoRA support (#222) 1 year ago
prefix.py c0aac15421 feat: S-LoRA support (#222) 1 year ago
sampling_params.py 53a9c60442 fix: logit processor declarations and application (#242) 1 year ago
sequence.py d2db4143fa feat: add grafana for metrics (#240) 1 year ago
test_utils.py 641bb0f6e9 feat: add custom allreduce kernels (#224) 1 year ago
utils.py ea0f57b233 feat: allow further support for non-cuda devices (#247) 1 year ago