 AlpinDale
|
624f592d7e
remove triton from common requirements
|
7 months ago |
|
AlpinDale
|
573feadae5
fix: imports for neuron
|
7 months ago |
|
AlpinDale
|
7ad8ffdc08
feat: add async neuron execturo
|
7 months ago |
 AlpinDale
|
0178b4d976
docker: add AWS Neuron Docker image
|
7 months ago |
|
AlpinDale
|
949f0445de
readme: update installation command
|
8 months ago |
 Naomiusearch
|
893158a4ed
fix: quants installation on ROCm (#469)
|
8 months ago |
|
AlpinDale
|
5ee79a1692
readme: update for 0.5.3
|
8 months ago |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |
 Krovius
|
205c8e4106
fix: kobold api /tokencount (#424)
|
8 months ago |
 50h100a
|
f663d3fccc
Merge pull request #397 from 50h100a/pr_samplerasserts
|
9 months ago |
 50h100a
|
85ae23ac3c
Missed .items() and assert
|
9 months ago |
|
50h100a
|
43c9858854
Merge pull request #244 from PygmalionAI/faster_topk
|
9 months ago |
|
50h100a
|
1da7fd64bc
Merge pull request #396 from 50h100a/pr_notneuron
|
9 months ago |
|
50h100a
|
0634b8a3a6
fix memory pinning conditional
|
9 months ago |
|
50h100a
|
a0b21a3e42
Merge pull request #358 from 50h100a/pr_samplers
|
9 months ago |
|
50h100a
|
bd564148e2
Merge branch 'main' of https://github.com/PygmalionAI/aphrodite-engine into ffs
|
9 months ago |
|
50h100a
|
d3dd170a7d
merge main
|
9 months ago |
|
AlpinDale
|
78d66f16d1
Chunked Prefill Part 1 (#384)
|
9 months ago |
|
AlpinDale
|
9181fa0396
feat: Triton kernels for sampling (#383)
|
9 months ago |
|
AlpinDale
|
e3252edd07
fix: remove event and stream, add typing (#382)
|
9 months ago |
|
AlpinDale
|
375f24ccca
fix: optimize context shift performance (#380)
|
9 months ago |
|
AlpinDale
|
33b3786175
fix: cache neuron checks (#379)
|
9 months ago |
|
AlpinDale
|
8c9cabf4c8
fix: display error in ray before deadlock (#378)
|
9 months ago |
|
50h100a
|
dc09dc2b4d
Merge branch 'main' into pr_samplers
|
9 months ago |
|
AlpinDale
|
f587953f46
fix: yapf
|
9 months ago |
|
AlpinDale
|
4b99ac15b7
fix: do not deepcopy metadata
|
9 months ago |
|
AlpinDale
|
17b034613d
chore: make metadata a dataclass (#377)
|
9 months ago |
|
AlpinDale
|
9534fcfb7b
fix: build error
|
9 months ago |
|
AlpinDale
|
0b35176089
feat: add context-free grammars (#376)
|
9 months ago |
|
AlpinDale
|
feb5840f2a
feat: async tokenization (#374)
|
9 months ago |
