 AlpinDale
|
0f4a9ee77b
quantized lm_head (#582)
|
5 months ago |
|
AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
5 months ago |
 AlpinDale
|
656459fd84
make fp8_e4m3 work on nvidia
|
6 months ago |
|
AlpinDale
|
50b7c13db0
refactor: attention selector (#552)
|
6 months ago |
|
AlpinDale
|
9fba7f1d36
remove quant_config from a few legacy models
|
6 months ago |
|
AlpinDale
|
b178ae4b4a
chore: generalize linear_method to be quant_method (#540)
|
6 months ago |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
6 months ago |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
9 months ago |
|
AlpinDale
|
da223153c6
feat&fix: cohere support and missing GPU blocks (#333)
|
10 months ago |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
10 months ago |
|
AlpinDale
|
e31c6f0b45
feat: refactor modeling logic and support more models (#274)
|
11 months ago |
|
AlpinDale
|
842912d022
feat: on-the-fly gguf conversion (#250)
|
11 months ago |
|
AlpinDale
|
c3a221eb02
feat: GGUF, QuIP#, and Marlin support (#228)
|
1 year ago |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
1 year ago |
|
AlpinDale
|
f013d714c0
chore: merge dev branch into main (#177)
|
1 year ago |
|
AlpinDale
|
2755a48d51
merge dev branch into main (#153)
|
1 year ago |
|
AlpinDale
|
d5abc36994
fix: assertion error in gpt-j
|
1 year ago |
|
AlpinDale
|
74604eb252
fix: pylint complaints (#91)
|
1 year ago |
|
AlpinDale
|
efc6f7fbec
chore: reformats (#90)
|
1 year ago |
|
AlpinDale
|
a6a4220fa6
feat: refactor megatron and quants (#57)
|
1 year ago |
|
AlpinDale
|
0495c50a3e
GPTQ+exllama support (#21)
|
1 year ago |
|
AlpinDale
|
75c27d3e65
massive overhaul
|
1 year ago |
|
AlpinDale
|
6b9561ef07
adapt TGI incremental detokenization
|
1 year ago |
|
AlpinDale
|
45f6d9f923
initial refactor commit
|
1 year ago |
|
AlpinDale
|
6dfca19dda
fix: gpt-j loading
|
1 year ago |
|
AlpinDale
|
cd17af7bc4
chore: clean up gpt-j and remove cross_attention
|
1 year ago |
|
AlpinDale
|
3dfa2c8480
fix: pass to mlp
|
1 year ago |
|
AlpinDale
|
a59d9a25b2
feat: support for GPT-J HF
|
1 year ago |
|
AlpinDale
|
fd35ba84b0
fix: whoops
|
1 year ago |
