 AlpinDale
|
c20073824a
cleanup
|
vor 7 Monaten |
|
AlpinDale
|
85a865cc00
feat: fp8 quant
|
vor 7 Monaten |
|
AlpinDale
|
8be299e78b
fix: lora load check
|
vor 7 Monaten |
|
AlpinDale
|
096d9eb6c5
enhance nvlink detection
|
vor 7 Monaten |
|
AlpinDale
|
fb7825df8f
squash logprobs
|
vor 7 Monaten |
|
AlpinDale
|
66b7bc4415
sliding window in prefix kernel
|
vor 7 Monaten |
|
AlpinDale
|
42998e423c
better quant verification
|
vor 7 Monaten |
|
AlpinDale
|
483c95a2f8
fix ops in gptq and awq
|
vor 7 Monaten |
|
AlpinDale
|
8f9cb7235c
chore: allow multiple served model names
|
vor 7 Monaten |
|
AlpinDale
|
fc80f57967
fix: correct file name for qwen2 moe
|
vor 7 Monaten |
|
AlpinDale
|
f894f7b176
Revert "reduce dedupe by wrapping in general worker class"
|
vor 8 Monaten |
|
AlpinDale
|
082b0b03bc
Revert "actually run the workers"
|
vor 8 Monaten |
|
AlpinDale
|
36cf32649d
actually run the workers
|
vor 8 Monaten |
|
AlpinDale
|
9fff6fb507
reduce dedupe by wrapping in general worker class
|
vor 8 Monaten |
|
AlpinDale
|
b92bddafe9
time.monotonic() -> time.time()
|
vor 8 Monaten |
 AlpinDale
|
0178b4d976
docker: add AWS Neuron Docker image
|
vor 8 Monaten |
|
AlpinDale
|
949f0445de
readme: update installation command
|
vor 8 Monaten |
 Naomiusearch
|
893158a4ed
fix: quants installation on ROCm (#469)
|
vor 8 Monaten |
|
AlpinDale
|
5ee79a1692
readme: update for 0.5.3
|
vor 8 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
 Krovius
|
205c8e4106
fix: kobold api /tokencount (#424)
|
vor 9 Monaten |
 50h100a
|
f663d3fccc
Merge pull request #397 from 50h100a/pr_samplerasserts
|
vor 9 Monaten |
 50h100a
|
85ae23ac3c
Missed .items() and assert
|
vor 9 Monaten |
|
50h100a
|
43c9858854
Merge pull request #244 from PygmalionAI/faster_topk
|
vor 9 Monaten |
|
50h100a
|
1da7fd64bc
Merge pull request #396 from 50h100a/pr_notneuron
|
vor 9 Monaten |
|
50h100a
|
0634b8a3a6
fix memory pinning conditional
|
vor 9 Monaten |
|
50h100a
|
a0b21a3e42
Merge pull request #358 from 50h100a/pr_samplers
|
vor 9 Monaten |
|
50h100a
|
bd564148e2
Merge branch 'main' of https://github.com/PygmalionAI/aphrodite-engine into ffs
|
vor 9 Monaten |
|
50h100a
|
d3dd170a7d
merge main
|
vor 9 Monaten |
|
AlpinDale
|
78d66f16d1
Chunked Prefill Part 1 (#384)
|
vor 9 Monaten |
