 AlpinDale
|
6145deab4a
frontend: enable kobold api by default (#803)
|
2 months ago |
|
AlpinDale
|
f0e00f1b43
ci: bump to 0.6.3.post1 (#801)
|
2 months ago |
|
AlpinDale
|
5b0eabe0e8
fix: compilation of gptq_marlin_gemm object (#800)
|
2 months ago |
 dependabot[bot]
|
7e2d2e7ae7
build(deps): bump rollup from 4.21.0 to 4.24.3 in /docs (#796)
|
2 months ago |
|
AlpinDale
|
76c05c5591
ci: bump version to 0.6.3 (#799)
|
2 months ago |
|
AlpinDale
|
0f1af04cf5
frontend: minor logging improvements (#787)
|
2 months ago |
|
AlpinDale
|
f98e7b2f8c
feat: add HQQ quantization support (#795)
|
2 months ago |
|
AlpinDale
|
43965f7bd9
fix: kobold lite embedded UI on windows (#797)
|
2 months ago |
|
AlpinDale
|
2d97f4014e
fix: windows wheel url (#794)
|
2 months ago |
|
AlpinDale
|
0256ed236b
feat: windows support (#790)
|
2 months ago |
 AlpinDale
|
dcb794a340
fix: revert incorrect commit
|
2 months ago |
|
AlpinDale
|
76367b5ae7
wip
|
2 months ago |
 50h100a
|
be4fa5b4cc
Merge pull request #785 from 50h100a/loadfix
|
2 months ago |
 50h100a
|
9022c6d869
remove progress_bar imports
|
2 months ago |
|
50h100a
|
9576096b9d
iterate over weights normally
|
2 months ago |
|
50h100a
|
1a5e612eaf
pass tensor progress bar as weight iterator
|
2 months ago |
|
50h100a
|
1ca5f47075
use tensor progress bar
|
2 months ago |
|
50h100a
|
a061d7578d
gather estimated weight bytes alongside iterator and pass it to model.load_weights
|
2 months ago |
|
50h100a
|
371d57af82
filesize-driven progress bar for loading tensors
|
2 months ago |
|
AlpinDale
|
4d3d819507
ci: bump version to 0.6.2.post1 (#779)
|
2 months ago |
|
AlpinDale
|
fb96041ae3
fix: demote skip_special_tokens assertion to logger error (#778)
|
2 months ago |
|
AlpinDale
|
4d781b22d3
docker: apply AMD patch in the dockerfile (#777)
|
2 months ago |
 Naomiusearch
|
eee3cf5dab
fix: make AMD usable (#775)
|
2 months ago |
|
AlpinDale
|
7222b84582
feat: ministral support (#776)
|
2 months ago |
 Fizz~
|
8a71788372
Add OLMoE (#772)
|
2 months ago |
|
50h100a
|
5795565e4b
Merge pull request #766 from 50h100a/simplifymeta
|
3 months ago |
 Pyroserenus
|
ee5964465d
chore: max_num_seqs in throughput benchmark (#770)
|
3 months ago |
|
Pyroserenus
|
99fc6f4697
fix: crash in token bans (#764)
|
3 months ago |
|
AlpinDale
|
a604ab69c4
fix: kobold api for horde (#763)
|
3 months ago |
|
50h100a
|
ed87b5dd32
remove special-case values for prompt sequences
|
3 months ago |
