AlpinDale
|
ea54ffafa4
let's try this again
|
4 months ago |
AlpinDale
|
b71a865b3a
Revert "update dockerfile"
|
4 months ago |
AlpinDale
|
6dd64089a2
update dockerfile
|
4 months ago |
AlpinDale
|
b1e61268a8
bump torch to 2.3.1
|
4 months ago |
AlpinDale
|
5be90c3859
Mamba infrastrucuture support (#586)
|
4 months ago |
AlpinDale
|
e6d70101b3
feat: add support for phi-3 vision model
|
5 months ago |
AlpinDale
|
75f97bc25d
bump flash-attn to remove unnecessary copies in the backend
|
5 months ago |
AlpinDale
|
93cffaf446
add flash_attn back
|
5 months ago |
AlpinDale
|
c6a501f682
add multiprocessing executor; make ray optional
|
5 months ago |
AlpinDale
|
d11d68f4e6
switch to vllm-flash-attn
|
5 months ago |
AlpinDale
|
440384d776
chore: use nvidia-ml-py instead of pynvml
|
6 months ago |
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |