 Stefan Daniel Schwarz
|
8e259ee7cf
chore: hf_transfer for faster downloads (#339)
|
9 months ago |
 AlpinDale
|
ed225f59cb
fix: transformers in requirements
|
9 months ago |
|
AlpinDale
|
e120404436
Revert "feat: CMake Build System Generator (#332)"
|
9 months ago |
 AlpinDale
|
ad6802690f
feat: CMake Build System Generator (#332)
|
9 months ago |
|
AlpinDale
|
da223153c6
feat&fix: cohere support and missing GPU blocks (#333)
|
9 months ago |
|
AlpinDale
|
89c32b40ec
chore: add new imatrix quants (#320)
|
10 months ago |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
10 months ago |
|
AlpinDale
|
e0c35bb353
feat: bitsandbytes and `--load-in{4,8}bit` support (#294)
|
10 months ago |
|
AlpinDale
|
657aec0cbd
refactor: OpenAI endpoint (#261)
|
10 months ago |
|
AlpinDale
|
4b80b42362
fix: memory leaks due to nccl cuda graphs (#275)
|
10 months ago |
|
AlpinDale
|
842912d022
feat: on-the-fly gguf conversion (#250)
|
11 months ago |
|
AlpinDale
|
d2db4143fa
feat: add grafana for metrics (#240)
|
11 months ago |
|
AlpinDale
|
bb158b6282
fix: bump torch to 2.2.0 (#234)
|
11 months ago |
|
AlpinDale
|
1c46fa31ad
feat: add quadratic sampling (#233)
|
11 months ago |
|
AlpinDale
|
f0dacc17dd
fix: remove fast-hadamard-transform in requirements
|
11 months ago |
|
AlpinDale
|
c3a221eb02
feat: GGUF, QuIP#, and Marlin support (#228)
|
11 months ago |
|
AlpinDale
|
0adab894fe
feat: grammar support (#206)
|
11 months ago |
|
AlpinDale
|
339c6aec53
chore: bump ray version
|
11 months ago |
|
AlpinDale
|
641bb0f6e9
feat: add custom allreduce kernels (#224)
|
11 months ago |
|
AlpinDale
|
fe70c6e8d5
feat: bump cuda and pytorch (#205)
|
1 year ago |
|
AlpinDale
|
7e72ce0a73
feat: mixtral tensor parallelism (#193)
|
1 year ago |
|
AlpinDale
|
7d91e9e0f2
feat: CUDA graphs (#172)
|
1 year ago |
|
AlpinDale
|
b9df8734d1
remove megablocks as a dependency
|
1 year ago |
|
AlpinDale
|
23a54389c8
bump torch
|
1 year ago |
|
AlpinDale
|
2755a48d51
merge dev branch into main (#153)
|
1 year ago |
|
AlpinDale
|
887e03669a
feat: add exllamav2 for GPTQ (#99)
|
1 year ago |
|
AlpinDale
|
161a69d2e0
Update requirements.txt
|
1 year ago |
|
AlpinDale
|
41341b220a
requirements: pin pydantic version
|
1 year ago |
|
AlpinDale
|
9b317aa26a
feat: finish up tests and workflows (#87)
|
1 year ago |
|
AlpinDale
|
28db67fd78
fix: mistral support
|
1 year ago |
