 AlpinDale
|
0c17c2a8a7
chore: add commit hash, clean up engine logs
|
vor 4 Monaten |
 AlpinDale
|
0886c361f4
feat: OpenVINO CPU backend (#576)
|
vor 5 Monaten |
|
AlpinDale
|
6a57861fca
feat: initial XPU support via intel_extension_for_pytorch (#571)
|
vor 5 Monaten |
|
AlpinDale
|
a07fc83bc8
chore: proper util for aphrodite version
|
vor 5 Monaten |
|
AlpinDale
|
fe21123a1c
feat: TPU support (#570)
|
vor 5 Monaten |
|
AlpinDale
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
vor 5 Monaten |
|
AlpinDale
|
00acf371f9
rocm: fused topk softmax
|
vor 5 Monaten |
|
AlpinDale
|
54f4f1e7f3
allow the cutlass kernels to take scales that reside on the GPU
|
vor 5 Monaten |
|
AlpinDale
|
52474b8fa9
build: parallelize all build extensions
|
vor 5 Monaten |
|
AlpinDale
|
7194047318
remove vllm-nccl
|
vor 5 Monaten |
|
AlpinDale
|
f6250c5516
move dockerfiles to root; fix cpu build
|
vor 5 Monaten |
|
AlpinDale
|
c6a501f682
add multiprocessing executor; make ray optional
|
vor 5 Monaten |
|
AlpinDale
|
0cea453d36
automatically detect tensorized models
|
vor 5 Monaten |
|
AlpinDale
|
e3f2ea4850
make punica kernels work with rocm
|
vor 5 Monaten |
|
AlpinDale
|
d11d68f4e6
switch to vllm-flash-attn
|
vor 5 Monaten |
|
AlpinDale
|
c4a9784795
properly exclude tests
|
vor 5 Monaten |
|
AlpinDale
|
69f37f5806
skip compilation properly
|
vor 5 Monaten |
|
AlpinDale
|
1b6bc0f379
upgrade tensorizer
|
vor 5 Monaten |
|
AlpinDale
|
e87c32bed3
feat: full tensor parallel for LoRA layers (#545)
|
vor 5 Monaten |
 Naomiusearch
|
893158a4ed
fix: quants installation on ROCm (#469)
|
vor 8 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
|
AlpinDale
|
9534fcfb7b
fix: build error
|
vor 9 Monaten |
|
AlpinDale
|
29c241c115
fix: explicitly disallow installation on non-linux platforms (#373)
|
vor 9 Monaten |
|
AlpinDale
|
3d6695cfbb
feat: add approximate gelu activation kernels (#370)
|
vor 9 Monaten |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
vor 9 Monaten |
|
AlpinDale
|
e120404436
Revert "feat: CMake Build System Generator (#332)"
|
vor 9 Monaten |
|
AlpinDale
|
ad6802690f
feat: CMake Build System Generator (#332)
|
vor 9 Monaten |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
vor 10 Monaten |
|
AlpinDale
|
c41462cfcd
feat: exllamav2 quantization (#305)
|
vor 10 Monaten |
 sgsdxzy
|
94c1543cae
fix: typo in marlin kernel path (#295)
|
vor 10 Monaten |
