 AlpinDale
|
05e45aeb53
fix: dtype mismatch for paligemma
|
vor 5 Monaten |
|
AlpinDale
|
bf4f113ef1
feat: add paligemma vision model support
|
vor 5 Monaten |
 AlpinDale
|
0f4a9ee77b
quantized lm_head (#582)
|
vor 5 Monaten |
|
AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
vor 6 Monaten |
|
AlpinDale
|
b6ff0623a6
chore: clean up branding
|
vor 6 Monaten |
|
AlpinDale
|
c5d8028668
fix: no need to redefine supports_vision and supports_lora in model class
|
vor 6 Monaten |
|
AlpinDale
|
56e0b8223c
chore: add base class for LoRA-supported models
|
vor 6 Monaten |
|
AlpinDale
|
656459fd84
make fp8_e4m3 work on nvidia
|
vor 6 Monaten |
|
AlpinDale
|
eaa06fdd14
fix some f-strings
|
vor 6 Monaten |
|
AlpinDale
|
50b7c13db0
refactor: attention selector (#552)
|
vor 6 Monaten |
|
AlpinDale
|
b178ae4b4a
chore: generalize linear_method to be quant_method (#540)
|
vor 6 Monaten |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
vor 7 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 9 Monaten |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
vor 10 Monaten |
|
AlpinDale
|
da223153c6
feat&fix: cohere support and missing GPU blocks (#333)
|
vor 11 Monaten |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
vor 11 Monaten |
|
AlpinDale
|
c41462cfcd
feat: exllamav2 quantization (#305)
|
vor 11 Monaten |
|
AlpinDale
|
e31c6f0b45
feat: refactor modeling logic and support more models (#274)
|
vor 11 Monaten |
