AlpinDale
|
11af9b796e
bump version to 0.4.5
|
1 year ago |
AlpinDale
|
3736d831f2
fix klite embed
|
1 year ago |
AlpinDale
|
81d7a8d323
bump version to 0.4.4
|
1 year ago |
AlpinDale
|
f013d714c0
chore: merge dev branch into main (#177)
|
1 year ago |
AlpinDale
|
6eb0b926fd
chore: make openai api key optional (#176)
|
1 year ago |
g4rg
|
fe57bb7ad2
feat: add rope scaling to mixtral (#174)
|
1 year ago |
AlpinDale
|
7d91e9e0f2
feat: CUDA graphs (#172)
|
1 year ago |
AlpinDale
|
725be3e0de
feat: mixtral HF with expert parallelism (#167)
|
1 year ago |
AlpinDale
|
6c50f5b067
chore: include stop strings in output (#168)
|
1 year ago |
g4rg
|
2aab3da9bd
chore: fix Python 3.8+ compatibility (#170)
|
1 year ago |
AlpinDale
|
7c6fdea535
fix: GPTQ warnings and exllama states (#171)
|
1 year ago |
AlpinDale
|
f5f9bc6a7c
fix: memory profiling (#166)
|
1 year ago |
AlpinDale
|
730357c7d5
chore: implement lazy module loader for models (#165)
|
1 year ago |
AlpinDale
|
35e9cf707c
chore: force pt for mixtral (#164)
|
1 year ago |
AlpinDale
|
ae57df0f44
fix: sliding window for mistral/mixtral (#163)
|
1 year ago |
AlpinDale
|
844aec2544
fix: prompt logprobs (#162)
|
1 year ago |
AlpinDale
|
02f3ab3501
fix: replace head_mapping with num_kv_heads (#161)
|
1 year ago |
AlpinDale
|
a92f63d8c0
fix: OpenAI chat - reference before assignment (#160)
|
1 year ago |
AlpinDale
|
dc5aedcfa7
fix: llama keyerror (#159)
|
1 year ago |
AlpinDale
|
980673ffb7
fix: fractional gpus (#157)
|
1 year ago |
AlpinDale
|
4ec78676b9
feat: implement Deci-LM (#158)
|
1 year ago |
AlpinDale
|
ef04ab5c4d
chore: implement torch native layers (#156)
|
1 year ago |
AlpinDale
|
cb9beb32b0
merge main
|
1 year ago |
AlpinDale
|
b9df8734d1
remove megablocks as a dependency
|
1 year ago |
AlpinDale
|
23a54389c8
bump torch
|
1 year ago |
AlpinDale
|
4a016fcbd9
limit number of processes to prevent OOM in CI
|
1 year ago |
AlpinDale
|
282675e4a1
bump version to 0.4.3
|
1 year ago |
AlpinDale
|
2755a48d51
merge dev branch into main (#153)
|
1 year ago |
AlpinDale
|
7dfcac677d
update readme
|
1 year ago |
AlpinDale
|
87277c76e4
feat: Mixtral 8x7B support (#155)
|
1 year ago |