 AlpinDale
|
6dfca19dda
fix: gpt-j loading
|
1 year ago |
|
AlpinDale
|
d6f705d90b
readme: more info on usage
|
1 year ago |
|
AlpinDale
|
89c7f0469f
fix: calculate the key/value outputs with kvhead
|
1 year ago |
|
AlpinDale
|
06e71fc492
feat: add GPT-NeoX support for testing purposes
|
1 year ago |
|
AlpinDale
|
38e7b98bec
readme: typo
|
1 year ago |
|
AlpinDale
|
751f759649
readme: more detailed install instructions
|
1 year ago |
|
AlpinDale
|
97bb098066
fix: typo lol
|
1 year ago |
|
AlpinDale
|
14e73807e6
fix: typo
|
1 year ago |
|
AlpinDale
|
35ec43f478
fix: remove aria2 for now
|
1 year ago |
|
AlpinDale
|
24c78e7306
optimization: multi-query attention kernel
|
1 year ago |
|
AlpinDale
|
6de30f43a4
fix: typos and refactors for llama
|
1 year ago |
|
AlpinDale
|
cd17af7bc4
chore: clean up gpt-j and remove cross_attention
|
1 year ago |
|
AlpinDale
|
76162fe366
chore: optimize sampler for gpt-j
|
1 year ago |
 AlpinDale
|
0b11ce1e62
Merge pull request #3 from PygmalionAI/feat/alibi
|
1 year ago |
|
AlpinDale
|
c0116835c2
feat: add alibi bias attention
|
1 year ago |
|
AlpinDale
|
bcf0cb132b
docs: swiglu shape
|
1 year ago |
|
AlpinDale
|
34295abec4
chore: use xformers attention bias and add docs
|
1 year ago |
|
AlpinDale
|
267c73c5d3
chore: minor tokenizer tweaks
|
1 year ago |
|
AlpinDale
|
979af00f44
chore: various OAI API fixes
|
1 year ago |
|
AlpinDale
|
8934263a4d
chore: minor tweaks
|
1 year ago |
|
AlpinDale
|
388d7545dd
fix: circular import
|
1 year ago |
|
AlpinDale
|
e2ecc9f936
chore: add args for ray and minor refactors
|
1 year ago |
|
AlpinDale
|
90f0b4a47e
chore: minor tweaks and fixes to the async engine
|
1 year ago |
|
AlpinDale
|
6620b0e2b8
chore: add args to main engine and minor refactors
|
1 year ago |
|
AlpinDale
|
f4bb602b74
chore: remove redundant import and minor refactor
|
1 year ago |
|
AlpinDale
|
aa9da0d749
chore: added args and simple refactors
|
1 year ago |
|
AlpinDale
|
b05d288015
fix: typo and add comments
|
1 year ago |
|
AlpinDale
|
4d35c7d936
fix: just because
|
1 year ago |
|
AlpinDale
|
84d08d84ea
chore: minor refactoring and changes to the config
|
1 year ago |
|
AlpinDale
|
5eefbcee26
chore: double-checked the token blocks
|
1 year ago |
