 AlpinDale
|
801eda0b7a
feat: support GPTQ 2, 3, and 8bit quants (#181)
|
il y a 1 an |
|
AlpinDale
|
b9b295d74e
chore: backlogs 1 (#191)
|
il y a 1 an |
 AlpinDale
|
17cdc5ac23
yapf
|
il y a 1 an |
 KaraKaraWitch
|
9a0b5a197d
fix: set CPU Affinity (#187)
|
il y a 1 an |
|
AlpinDale
|
68c2083adb
fix includes in wheel
|
il y a 1 an |
|
AlpinDale
|
6eb0b926fd
chore: make openai api key optional (#176)
|
il y a 1 an |
 g4rg
|
fe57bb7ad2
feat: add rope scaling to mixtral (#174)
|
il y a 1 an |
|
AlpinDale
|
7d91e9e0f2
feat: CUDA graphs (#172)
|
il y a 1 an |
|
AlpinDale
|
725be3e0de
feat: mixtral HF with expert parallelism (#167)
|
il y a 1 an |
|
AlpinDale
|
6c50f5b067
chore: include stop strings in output (#168)
|
il y a 1 an |
|
g4rg
|
2aab3da9bd
chore: fix Python 3.8+ compatibility (#170)
|
il y a 1 an |
|
AlpinDale
|
7c6fdea535
fix: GPTQ warnings and exllama states (#171)
|
il y a 1 an |
|
AlpinDale
|
f5f9bc6a7c
fix: memory profiling (#166)
|
il y a 1 an |
|
AlpinDale
|
730357c7d5
chore: implement lazy module loader for models (#165)
|
il y a 1 an |
|
AlpinDale
|
35e9cf707c
chore: force pt for mixtral (#164)
|
il y a 1 an |
|
AlpinDale
|
ae57df0f44
fix: sliding window for mistral/mixtral (#163)
|
il y a 1 an |
|
AlpinDale
|
844aec2544
fix: prompt logprobs (#162)
|
il y a 1 an |
|
AlpinDale
|
02f3ab3501
fix: replace head_mapping with num_kv_heads (#161)
|
il y a 1 an |
|
AlpinDale
|
a92f63d8c0
fix: OpenAI chat - reference before assignment (#160)
|
il y a 1 an |
|
AlpinDale
|
dc5aedcfa7
fix: llama keyerror (#159)
|
il y a 1 an |
|
AlpinDale
|
980673ffb7
fix: fractional gpus (#157)
|
il y a 1 an |
|
AlpinDale
|
4ec78676b9
feat: implement Deci-LM (#158)
|
il y a 1 an |
|
AlpinDale
|
ef04ab5c4d
chore: implement torch native layers (#156)
|
il y a 1 an |
|
AlpinDale
|
cb9beb32b0
merge main
|
il y a 1 an |
|
AlpinDale
|
b9df8734d1
remove megablocks as a dependency
|
il y a 1 an |
|
AlpinDale
|
23a54389c8
bump torch
|
il y a 1 an |
|
AlpinDale
|
4a016fcbd9
limit number of processes to prevent OOM in CI
|
il y a 1 an |
|
AlpinDale
|
282675e4a1
bump version to 0.4.3
|
il y a 1 an |
|
AlpinDale
|
2755a48d51
merge dev branch into main (#153)
|
il y a 1 an |
|
AlpinDale
|
7dfcac677d
update readme
|
il y a 1 an |
