AlpinDale 145e554a4d neuron: add 8bit quantization for Neuron (#994) vor 2 Wochen
..
arctic_inference.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 4 Monaten
cached_prefix_inference.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 4 Monaten
embedding_inference.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 4 Monaten
encoder_decoder_inference.py 62111fab17 feat: allow serving encoder-decoder models in the API server (#664) vor 4 Monaten
gguf_inference.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 4 Monaten
lora_aphrodite_engine.py 673621a3d2 xpu: refactor the model runner for tensor parallelism (#910) vor 3 Wochen
lora_async_aphrodite.py 673621a3d2 xpu: refactor the model runner for tensor parallelism (#910) vor 3 Wochen
mlpspeculator_inference.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 4 Monaten
neuron_inference.py ba6d798784 neuron: support for context length and token bucketing (#960) vor 2 Wochen
neuron_int8_quantization.py 145e554a4d neuron: add 8bit quantization for Neuron (#994) vor 2 Wochen
offline_inference.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 4 Monaten
ray_distributed_inference.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 4 Monaten
soft_prompt_inference.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 4 Monaten
tpu_inference.py 436d8fa0f1 core: do not compile for profiling (#931) vor 2 Wochen