 AlpinDale
|
69204736de
Revert "fix: sync CPU delay in sampler (#93)"
|
vor 1 Jahr |
 AlpinDale
|
ce66e1df56
fix: sync CPU delay in sampler (#93)
|
vor 1 Jahr |
|
AlpinDale
|
efc6f7fbec
chore: reformats (#90)
|
vor 1 Jahr |
|
AlpinDale
|
3d72f05c7b
feat: flattened 1D tensor -> 2D tensor (#85)
|
vor 1 Jahr |
|
AlpinDale
|
e6be0118c9
feat: prompt logprobs and batched samplers (#77)
|
vor 1 Jahr |
|
AlpinDale
|
3bf6197afb
fix: prompt processing delay introduced by #66 (#71)
|
vor 1 Jahr |
|
AlpinDale
|
c1fa7e8567
chore: fix datatype check (#65)
|
vor 1 Jahr |
|
AlpinDale
|
0495c50a3e
GPTQ+exllama support (#21)
|
vor 1 Jahr |
|
AlpinDale
|
cbeeabeb9a
feat: mistral support (#20)
|
vor 1 Jahr |
|
AlpinDale
|
70dbf7de03
imports in sampler
|
vor 1 Jahr |
|
AlpinDale
|
75c27d3e65
massive overhaul
|
vor 1 Jahr |
|
AlpinDale
|
45f6d9f923
initial refactor commit
|
vor 1 Jahr |
|
AlpinDale
|
76b2e4a445
Merge dev branch into main (#7)
|
vor 1 Jahr |
|
AlpinDale
|
c9e3db7d0d
chore: update the worker code
|
vor 1 Jahr |
|
AlpinDale
|
54b6f5becf
feat: add GPU worker class
|
vor 1 Jahr |
