 AlpinDale
|
5884e0b904
add bitnetforcausallm support
|
hai 6 meses |
|
AlpinDale
|
696f2cd59c
add phi3_small support with blocksparse attention
|
hai 6 meses |
|
AlpinDale
|
eaa06fdd14
fix some f-strings
|
hai 6 meses |
 AlpinDale
|
50b7c13db0
refactor: attention selector (#552)
|
hai 6 meses |
|
AlpinDale
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
hai 6 meses |
|
AlpinDale
|
1e35cef979
feat: add arctic snowflake model (#551)
|
hai 6 meses |
|
AlpinDale
|
b178ae4b4a
chore: generalize linear_method to be quant_method (#540)
|
hai 6 meses |
|
AlpinDale
|
e7b1368156
feat: Phi3 support
|
hai 7 meses |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
hai 7 meses |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hai 8 meses |
|
AlpinDale
|
72cd8494aa
feat: mistral neuron support (#368)
|
hai 10 meses |
|
AlpinDale
|
681e94611f
fix: restore backwards compatibility with old Yi models (#351)
|
hai 10 meses |
|
AlpinDale
|
da223153c6
feat&fix: cohere support and missing GPU blocks (#333)
|
hai 10 meses |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
hai 10 meses |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
hai 11 meses |
|
AlpinDale
|
e31c6f0b45
feat: refactor modeling logic and support more models (#274)
|
hai 11 meses |
|
AlpinDale
|
224b87b484
feat: add fused mixtral moe support (#238)
|
hai 11 meses |
|
AlpinDale
|
2370dbcfd8
feat: OPT model support (#266)
|
hai 11 meses |
|
AlpinDale
|
d9b65e6c5f
feat: DeepSeek MoE support (#237)
|
hai 1 ano |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
hai 1 ano |
|
AlpinDale
|
f013d714c0
chore: merge dev branch into main (#177)
|
hai 1 ano |
|
AlpinDale
|
2755a48d51
merge dev branch into main (#153)
|
hai 1 ano |
|
AlpinDale
|
e59e7f0a99
feat: yi support (#104)
|
hai 1 ano |
|
AlpinDale
|
efc6f7fbec
chore: reformats (#90)
|
hai 1 ano |
|
AlpinDale
|
28db67fd78
fix: mistral support
|
hai 1 ano |
|
AlpinDale
|
cbeeabeb9a
feat: mistral support (#20)
|
hai 1 ano |
|
AlpinDale
|
06e71fc492
feat: add GPT-NeoX support for testing purposes
|
hai 1 ano |
|
AlpinDale
|
18c76e1a86
update __init__.py
|
hai 1 ano |
|
AlpinDale
|
5e25fe5e64
feat: add model loader
|
hai 1 ano |
