AlpinDale
|
ac79d115b3
add guards for prefix caching, fp8, chunked, etc
|
6 bulan lalu |
AlpinDale
|
656459fd84
make fp8_e4m3 work on nvidia
|
6 bulan lalu |
AlpinDale
|
50b7c13db0
refactor: attention selector (#552)
|
6 bulan lalu |
AlpinDale
|
b178ae4b4a
chore: generalize linear_method to be quant_method (#540)
|
6 bulan lalu |
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
7 bulan lalu |