 AlpinDale
|
d9d287a288
rocm: enable multi-step scheduling for rocm (#1071)
|
há 2 meses atrás |
|
AlpinDale
|
ec17b6c4d0
fix: Phi3.5 Mini and MoE LoRA inference (#1070)
|
há 2 meses atrás |
|
AlpinDale
|
acc0c727c8
vlm: add support for molmo vision model (#1069)
|
há 2 meses atrás |
|
AlpinDale
|
7dd001ec2d
build: guard against changes in cuda library name (#1068)
|
há 2 meses atrás |
|
AlpinDale
|
ca7028d5ca
sampler: simplify logits resort in _apply_top_k_top_p (#1067)
|
há 2 meses atrás |
|
AlpinDale
|
61aed092a5
rocm: add support for FP8 KV cache in the custom paged attention kkernels (#1066)
|
há 2 meses atrás |
|
AlpinDale
|
12b0059b47
api: enable MQAphroditeEngine for embedding models (#1065)
|
há 2 meses atrás |
|
AlpinDale
|
314fa7f7d9
fix: encoder-decoder models for beam search (#1064)
|
há 2 meses atrás |
|
AlpinDale
|
34cf9b74f0
api: non-zero exit code if MQ engine startup fails (#1063)
|
há 2 meses atrás |
|
AlpinDale
|
92cee435e2
rocm: add more quants, fix _scaled_mm call (#1062)
|
há 2 meses atrás |
 AlpinDale
|
b12d5c0507
readme: add attribution to Ruliad
|
há 2 meses atrás |
|
AlpinDale
|
f81e7d7010
distributed: bind only to 127.0.0.1 for local-only usage (#1061)
|
há 2 meses atrás |
|
AlpinDale
|
58aff3771d
core: support prompt logprobs in multi-step (#1060)
|
há 2 meses atrás |
|
AlpinDale
|
9a7d5514c4
feat: introduce MQAphroditeEngine (#1056)
|
há 2 meses atrás |
|
AlpinDale
|
0b5588de5c
fix: add missing logit index increment in sampling metadata prep (#1059)
|
há 2 meses atrás |
|
AlpinDale
|
525edc1283
build: fix compilation for causal_conv1d_fwd kernel signature (#1057)
|
há 2 meses atrás |
|
AlpinDale
|
9bdf8d5bfa
mamba: enable continuous batching for mamba kernels (#1055)
|
há 2 meses atrás |
|
AlpinDale
|
11f49b5341
fix: granite logit scale in logit computation (#1054)
|
há 2 meses atrás |
|
AlpinDale
|
1264e0b5d8
api: add mistral function calling format to all models loaded with "mistral" format (#1053)
|
há 2 meses atrás |
|
AlpinDale
|
b3f9ab3b72
quant: add tensor parallel support for bitsandbytes (#1052)
|
há 2 meses atrás |
|
AlpinDale
|
a985143768
core: add cuda graph support for encoder-decoder models (#1051)
|
há 2 meses atrás |
|
AlpinDale
|
239a8cae25
torch.compile: register all-reduce operations as custom ops (#1050)
|
há 2 meses atrás |
|
AlpinDale
|
4593a3b306
chore: remove dead code from triton sampling kernels (#1049)
|
há 2 meses atrás |
|
AlpinDale
|
8976805f90
kernel: asymmetric AQ AZP quantization kernels (#1048)
|
há 2 meses atrás |
|
AlpinDale
|
638c08d9dc
fix: clean shutdown issues (#1047)
|
há 2 meses atrás |
|
AlpinDale
|
4b1b658855
tpu: implement multi-step scheduling (#1046)
|
há 2 meses atrás |
|
AlpinDale
|
960dee2f97
torch.compile: fix functionalization (#1045)
|
há 2 meses atrás |
|
AlpinDale
|
ce7b602f03
model: add support for MiniCPM-3 (#1044)
|
há 2 meses atrás |
|
AlpinDale
|
4a7cb8f232
rocm: add custom paged attention kernels for ROCm (#1043)
|
há 2 meses atrás |
|
AlpinDale
|
6951928522
xpu: bump IPEX to 2.3, support GQA (#1042)
|
há 2 meses atrás |
