AlpinDale
|
dec1133812
feat: phi 1.5 support (#121)
|
1 year ago |
AlpinDale
|
7c1e00f51b
fix: GH actions for dev branch
|
1 year ago |
AlpinDale
|
f49cb1ffe1
fix: duplication in engine step (#120)
|
1 year ago |
AlpinDale
|
1323b5456c
parse torch.dtype properly (#119)
|
1 year ago |
AlpinDale
|
9edc6a74ec
readme: update for dev branch
|
1 year ago |
AlpinDale
|
a792c34b84
readme: add dev branch notice
|
1 year ago |
AlpinDale
|
e7b6a2d5a0
chore: tensor parallel refactors part 2 (#116)
|
1 year ago |
AlpinDale
|
7e8483c6d7
chore: rope refactors (#114)
|
1 year ago |
AlpinDale
|
5175605f8d
fix: yarn (#112)
|
1 year ago |
AlpinDale
|
d5abc36994
fix: assertion error in gpt-j
|
1 year ago |
AlpinDale
|
e648ec604e
readme: add new sampling params and API examples
|
1 year ago |
AlpinDale
|
9a47d6fc1a
chore: add authorization bearer support for OAI endpoint (#109)
|
1 year ago |
miku448
|
3d450e19b4
Add logit_bias support for OpenAI API endpoint (#108)
|
1 year ago |
AlpinDale
|
69fef6fbe6
bump version to 0.4.2
|
1 year ago |
AlpinDale
|
8b97b86cb1
add mirostat and minP for OpenAI endpoint
|
1 year ago |
AlpinDale
|
5a436fdc25
TopK alias for compatibility
|
1 year ago |
AlpinDale
|
d81da690d0
chore: api keys for OAI server (#107)
|
1 year ago |
Stefan Gligorijevic
|
a5255901c6
feat: min_p sampling (#106)
|
1 year ago |
Kristian Polso
|
23993655b4
fix: docker port (#105)
|
1 year ago |
AlpinDale
|
3c512ef982
fix docker container and add klite embd to wheel
|
1 year ago |
AlpinDale
|
989df2d84b
add Yi to quantized models
|
1 year ago |
AlpinDale
|
78175e0910
yi: fix column parallel name
|
1 year ago |
AlpinDale
|
e59e7f0a99
feat: yi support (#104)
|
1 year ago |
g4rg
|
28fa4ae213
fix: cpu memory limit detection for containers (#103)
|
1 year ago |
sandwichdoge
|
99293aaff0
fix: correct auto ntk scaling_factor for 4k ctx case (#101)
|
1 year ago |
AlpinDale
|
6f472e06ee
slightly bump version for pypi re-release
|
1 year ago |
AlpinDale
|
83f766dfa8
fix errors (#102)
|
1 year ago |
AlpinDale
|
a660c69b48
bump version to 0.4
|
1 year ago |
AlpinDale
|
f384f3ae60
fix: force v2 for ctxlen larger than 8192 (#100)
|
1 year ago |
AlpinDale
|
035878898f
bug: minor ray issue
|
1 year ago |