 AlpinDale
|
0f4a9ee77b
quantized lm_head (#582)
|
il y a 5 mois |
|
AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
il y a 6 mois |
 AlpinDale
|
c5d8028668
fix: no need to redefine supports_vision and supports_lora in model class
|
il y a 6 mois |
|
AlpinDale
|
56e0b8223c
chore: add base class for LoRA-supported models
|
il y a 6 mois |
|
AlpinDale
|
656459fd84
make fp8_e4m3 work on nvidia
|
il y a 6 mois |
|
AlpinDale
|
50b7c13db0
refactor: attention selector (#552)
|
il y a 6 mois |
|
AlpinDale
|
b178ae4b4a
chore: generalize linear_method to be quant_method (#540)
|
il y a 6 mois |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
il y a 7 mois |
