 AlpinDale
|
9e73559eba
make use of batched rotary embedding kernels to support long context lora
|
6 месяцев назад |
|
AlpinDale
|
14a2d6f624
fix rope error when loading models with different dtypes
|
6 месяцев назад |
|
AlpinDale
|
c5066558a1
add dtype to cos sin cache casting
|
6 месяцев назад |
|
AlpinDale
|
6fc1ec6e9a
fix redirects and improve low level debugging
|
6 месяцев назад |
|
AlpinDale
|
110a2724f4
extended -> llama3, also make rope_type in config work
|
6 месяцев назад |
 AlpinDale
|
3ab36e6b2d
feat: extended RoPE for Llama 3.1 (#543)
|
6 месяцев назад |
|
AlpinDale
|
e7b1368156
feat: Phi3 support
|
7 месяцев назад |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
7 месяцев назад |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 месяцев назад |
|
AlpinDale
|
e702f587cf
feat: add batched RoPE kernels (#371)
|
10 месяцев назад |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
10 месяцев назад |
|
AlpinDale
|
ea0f57b233
feat: allow further support for non-cuda devices (#247)
|
1 год назад |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
1 год назад |
|
AlpinDale
|
f013d714c0
chore: merge dev branch into main (#177)
|
1 год назад |
|
AlpinDale
|
2755a48d51
merge dev branch into main (#153)
|
1 год назад |
|
AlpinDale
|
7e8483c6d7
chore: rope refactors (#114)
|
1 год назад |
|
AlpinDale
|
5175605f8d
fix: yarn (#112)
|
1 год назад |
|
AlpinDale
|
efc6f7fbec
chore: reformats (#90)
|
1 год назад |
|
AlpinDale
|
bdad759503
feat: YaRN context window extension support (#67)
|
1 год назад |
|
AlpinDale
|
75c27d3e65
massive overhaul
|
1 год назад |
