| .. |
|
arctic_inference.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
il y a 4 mois |
|
cached_prefix_inference.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
il y a 4 mois |
|
embedding_inference.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
il y a 4 mois |
|
encoder_decoder_inference.py
|
62111fab17
feat: allow serving encoder-decoder models in the API server (#664)
|
il y a 4 mois |
|
gguf_inference.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
il y a 4 mois |
|
lora_aphrodite_engine.py
|
673621a3d2
xpu: refactor the model runner for tensor parallelism (#910)
|
il y a 3 semaines |
|
lora_async_aphrodite.py
|
673621a3d2
xpu: refactor the model runner for tensor parallelism (#910)
|
il y a 3 semaines |
|
mlpspeculator_inference.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
il y a 4 mois |
|
neuron_inference.py
|
ba6d798784
neuron: support for context length and token bucketing (#960)
|
il y a 2 semaines |
|
neuron_int8_quantization.py
|
145e554a4d
neuron: add 8bit quantization for Neuron (#994)
|
il y a 2 semaines |
|
offline_inference.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
il y a 4 mois |
|
ray_distributed_inference.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
il y a 4 mois |
|
soft_prompt_inference.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
il y a 4 mois |
|
tpu_inference.py
|
436d8fa0f1
core: do not compile for profiling (#931)
|
il y a 2 semaines |
AlpinDale
145e554a4d
neuron: add 8bit quantization for Neuron (#994)