 AlpinDale
|
ec45d7a502
build: add jinja2 to requirements file
|
il y a 1 mois |
 AlpinDale
|
9094a8a2a3
xpu: refactor XPU worker & executor (#861)
|
il y a 1 mois |
|
AlpinDale
|
8b8d2ce7e2
ci: bump aphrodite version to 0.6.4.post1 (#859)
|
il y a 1 mois |
|
AlpinDale
|
3392b81bf9
sampler: allow parsing sampler order using strings (#858)
|
il y a 1 mois |
|
AlpinDale
|
0035dc42ed
sampler: optimize DRY performance using z-algorithm (#856)
|
il y a 1 mois |
|
AlpinDale
|
2150bb5019
sampler: add range parameter for DRY (#855)
|
il y a 1 mois |
|
AlpinDale
|
72c505ad84
sampler: fix dry concurrency issue (#852)
|
il y a 1 mois |
 Selali
|
14ac216498
sampler: add output_tokens to DRY sampler (#849)
|
il y a 1 mois |
 Luke Harold Miles
|
d486d7ac01
docs: add linux arm64/aarch64/GH200 installation tips (#851)
|
il y a 1 mois |
|
AlpinDale
|
d2971a6831
ci: bump version to 0.6.4 (#845)
|
il y a 1 mois |
|
AlpinDale
|
538471f76e
chore: bump mistral_common to 1.5.0 (#844)
|
il y a 1 mois |
|
AlpinDale
|
483c9e6e59
fix: disable awq_marlin override for awq models (#843)
|
il y a 1 mois |
|
AlpinDale
|
dfa34d1b24
feat: add sampler_priorty (#837)
|
il y a 1 mois |
|
AlpinDale
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
il y a 1 mois |
|
AlpinDale
|
563e8f7ac8
fix: latency and serving benchmarks (#841)
|
il y a 1 mois |
|
AlpinDale
|
7c7ec12f36
chore: refactor executor classes for easier inheritance (#840)
|
il y a 1 mois |
|
AlpinDale
|
16b587c104
fix: hidden states handling in batch expansion for spec decoding (#839)
|
il y a 1 mois |
|
AlpinDale
|
60f7b828d5
feat: add skew sampling (#834)
|
il y a 2 mois |
|
AlpinDale
|
ba9d8f631a
feat: add no_repeat_ngram sampler (#832)
|
il y a 2 mois |
|
Selali
|
4c4a365f77
feat: Add DRY (Don't Repeat Yourself) sampling (#827)
|
il y a 2 mois |
|
AlpinDale
|
48a8693aed
feat: multi-step scheduling (#831)
|
il y a 2 mois |
|
AlpinDale
|
2242cb25dc
fix: unbound tokenizer error
|
il y a 2 mois |
|
AlpinDale
|
3d83e64f8e
feat: add metrics for prefix cache hit rate (#829)
|
il y a 2 mois |
|
AlpinDale
|
22425b689d
fix: XPU build
|
il y a 2 mois |
|
AlpinDale
|
bfc8988116
feat: add cuda sampling kernels for top_k and top_p (#828)
|
il y a 2 mois |
|
AlpinDale
|
22427602eb
feat: add top-nsigma sampling method
|
il y a 2 mois |
|
AlpinDale
|
22429e4a10
fix: sampler test with new transformers version
|
il y a 2 mois |
|
AlpinDale
|
2f61644f6e
SPMD optimizations (#824)
|
il y a 2 mois |
|
AlpinDale
|
32a37e8107
tests: partially fix tensorizer and logprobs tests
|
il y a 2 mois |
|
AlpinDale
|
7f1c9af5e2
fix: fp8 quant test
|
il y a 2 mois |
