 AlpinDale
|
a985143768
core: add cuda graph support for encoder-decoder models (#1051)
|
3 weeks ago |
|
AlpinDale
|
239a8cae25
torch.compile: register all-reduce operations as custom ops (#1050)
|
3 weeks ago |
|
AlpinDale
|
4593a3b306
chore: remove dead code from triton sampling kernels (#1049)
|
3 weeks ago |
|
AlpinDale
|
8976805f90
kernel: asymmetric AQ AZP quantization kernels (#1048)
|
3 weeks ago |
|
AlpinDale
|
638c08d9dc
fix: clean shutdown issues (#1047)
|
3 weeks ago |
|
AlpinDale
|
4b1b658855
tpu: implement multi-step scheduling (#1046)
|
4 weeks ago |
|
AlpinDale
|
960dee2f97
torch.compile: fix functionalization (#1045)
|
4 weeks ago |
|
AlpinDale
|
ce7b602f03
model: add support for MiniCPM-3 (#1044)
|
4 weeks ago |
|
AlpinDale
|
4a7cb8f232
rocm: add custom paged attention kernels for ROCm (#1043)
|
4 weeks ago |
|
AlpinDale
|
6951928522
xpu: bump IPEX to 2.3, support GQA (#1042)
|
4 weeks ago |
|
AlpinDale
|
9797d38b24
torch.compile: allow adding custom compile backends via plugins (#1041)
|
4 weeks ago |
|
AlpinDale
|
e3f5bae2cc
fix: skip loading extra bias for Qwen2-VL GPTQ (#1040)
|
4 weeks ago |
 AlpinDale
|
18acf7eaa0
tests: map physical device indices for test utils
|
4 weeks ago |
|
AlpinDale
|
05be6085ec
core: factor out input preprocessing into a separate class (#1039)
|
4 weeks ago |
|
AlpinDale
|
fd07406a19
fix: grouped_topk return type (#1038)
|
4 weeks ago |
|
AlpinDale
|
271879a4a5
fix: disable chunked prefill and prefix caching for multimodal models (#1037)
|
4 weeks ago |
|
AlpinDale
|
c951a54d21
fix: multi-step + flashinfer with cuda graphs (#1036)
|
4 weeks ago |
|
AlpinDale
|
055c8905a3
api: add sampling/engine option to return only deltas or final output (#1035)
|
4 weeks ago |
|
AlpinDale
|
1390915778
multi-step: add support for flashinfer attention backend (#1033)
|
4 weeks ago |
|
AlpinDale
|
a56bce4c94
fix: remove duplicate assignment in Hermes2ProToolParser
|
4 weeks ago |
|
AlpinDale
|
c6e8cb058b
fix: lazy init _copy_stream (#1032)
|
4 weeks ago |
|
AlpinDale
|
3d72d8212a
chore: remove accidental commit
|
4 weeks ago |
|
AlpinDale
|
8d5d87e687
vlm: support multiple images for qwen-vl (#1031)
|
4 weeks ago |
|
AlpinDale
|
41ceb754a6
vlm: fix internvl2 inference with various num_patches (#1030)
|
4 weeks ago |
|
AlpinDale
|
6f59024522
torch.compile: hide slicing under custom op for inductor (#1029)
|
4 weeks ago |
|
AlpinDale
|
d51720114b
chore: use RoPE cache for MRoPE method (#1028)
|
4 weeks ago |
|
AlpinDale
|
65a59bbb6b
cpu: raise error if using encoder-decoder models (#1027)
|
4 weeks ago |
|
AlpinDale
|
b33cf04386
quants: add bitsandbytes support for gemma2 model (#1026)
|
4 weeks ago |
|
AlpinDale
|
7d5feaa037
api: fix logic for deciding if tool parser is used (#1025)
|
4 weeks ago |
|
AlpinDale
|
ddaefd8d38
chore: remove engine_use_ray (#1024)
|
4 weeks ago |
