 AlpinDale
|
3bb0f07461
chore: rename `task_handler` to `worker` (#985)
|
il y a 2 semaines |
|
AlpinDale
|
0256ed236b
feat: windows support (#790)
|
il y a 2 mois |
|
AlpinDale
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
il y a 4 mois |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
il y a 8 mois |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
il y a 9 mois |
|
AlpinDale
|
9810daa699
feat: INT8 KV Cache (#298)
|
il y a 10 mois |
|
AlpinDale
|
8e1cd54497
fix: do not include fp8 for rocm (#271)
|
il y a 10 mois |
|
AlpinDale
|
31c95011a6
feat: FP8 E5M2 KV Cache (#226)
|
il y a 11 mois |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
il y a 11 mois |
 AlpinDale
|
53d391e1f2
merge 'dev' into 'main'
|
il y a 1 an |
|
AlpinDale
|
15a0454172
feat: FP8 KV Cache (#185)
|
il y a 1 an |
|
AlpinDale
|
b9b295d74e
chore: backlogs 1 (#191)
|
il y a 1 an |
|
AlpinDale
|
f013d714c0
chore: merge dev branch into main (#177)
|
il y a 1 an |
|
AlpinDale
|
7d91e9e0f2
feat: CUDA graphs (#172)
|
il y a 1 an |
|
AlpinDale
|
02f3ab3501
fix: replace head_mapping with num_kv_heads (#161)
|
il y a 1 an |
|
AlpinDale
|
2755a48d51
merge dev branch into main (#153)
|
il y a 1 an |
|
AlpinDale
|
1334a833a4
feat: AMD ROCm support (#95)
|
il y a 1 an |
|
AlpinDale
|
4e71bd1d12
feat: add PagedAttention V2 kernels (#76)
|
il y a 1 an |
|
AlpinDale
|
b7918ad45f
fix: attention kernel attribute (#52)
|
il y a 1 an |
|
AlpinDale
|
0495c50a3e
GPTQ+exllama support (#21)
|
il y a 1 an |
|
AlpinDale
|
75c27d3e65
massive overhaul
|
il y a 1 an |
|
AlpinDale
|
45f6d9f923
initial refactor commit
|
il y a 1 an |
|
AlpinDale
|
23389d0108
zero out a variable instead of vector in kernels
|
il y a 1 an |
|
AlpinDale
|
ed540c3c87
fix: typo in attention kernel
|
il y a 1 an |
|
AlpinDale
|
fffb9f2dac
chore: attention kernel optimizations
|
il y a 1 an |
|
AlpinDale
|
24c78e7306
optimization: multi-query attention kernel
|
il y a 1 an |
|
AlpinDale
|
081545bde6
fix: various CUDA kernel tweaks
|
il y a 1 an |
|
AlpinDale
|
05d0a7e763
feat: adapt the attention kernels
|
il y a 1 an |
