 AlpinDale
|
b15e6376f8
bump to torch 2.4.0, add aphrodite_flash_attn (#614)
|
4 月之前 |
 AlpinDale
|
44d81c3a3e
chore: bump torch to 2.4.0
|
4 月之前 |
|
AlpinDale
|
ea54ffafa4
let's try this again
|
4 月之前 |
|
AlpinDale
|
b71a865b3a
Revert "update dockerfile"
|
4 月之前 |
|
AlpinDale
|
6dd64089a2
update dockerfile
|
4 月之前 |
|
AlpinDale
|
b1e61268a8
bump torch to 2.3.1
|
4 月之前 |
|
AlpinDale
|
5be90c3859
Mamba infrastrucuture support (#586)
|
4 月之前 |
|
AlpinDale
|
e6d70101b3
feat: add support for phi-3 vision model
|
5 月之前 |
|
AlpinDale
|
75f97bc25d
bump flash-attn to remove unnecessary copies in the backend
|
5 月之前 |
|
AlpinDale
|
93cffaf446
add flash_attn back
|
5 月之前 |
|
AlpinDale
|
c6a501f682
add multiprocessing executor; make ray optional
|
5 月之前 |
|
AlpinDale
|
d11d68f4e6
switch to vllm-flash-attn
|
5 月之前 |
|
AlpinDale
|
440384d776
chore: use nvidia-ml-py instead of pynvml
|
6 月之前 |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 月之前 |
