 AlpinDale
|
50b7c13db0
refactor: attention selector (#552)
|
vor 8 Monaten |
 AlpinDale
|
8b56dc4347
dict -> torch.Tensor for blocks_to_swap
|
vor 8 Monaten |
|
AlpinDale
|
21ce19b3ea
blocks_to_copy dict -> torch.Tensor
|
vor 8 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 10 Monaten |
|
AlpinDale
|
e3252edd07
fix: remove event and stream, add typing (#382)
|
vor 11 Monaten |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
vor 11 Monaten |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
vor 1 Jahr |
|
AlpinDale
|
ea0f57b233
feat: allow further support for non-cuda devices (#247)
|
vor 1 Jahr |
|
AlpinDale
|
31c95011a6
feat: FP8 E5M2 KV Cache (#226)
|
vor 1 Jahr |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
vor 1 Jahr |
|
AlpinDale
|
15a0454172
feat: FP8 KV Cache (#185)
|
vor 1 Jahr |
|
AlpinDale
|
1aab8a7d6f
feat: speedup compilation times by 3x (#130)
|
vor 1 Jahr |
|
AlpinDale
|
74604eb252
fix: pylint complaints (#91)
|
vor 1 Jahr |
|
AlpinDale
|
75c27d3e65
massive overhaul
|
vor 1 Jahr |
|
AlpinDale
|
525edab7cc
fix: logger in cache engine
|
vor 1 Jahr |
|
AlpinDale
|
b8f4337c5b
chore: various fixes
|
vor 1 Jahr |
|
AlpinDale
|
a409431c40
feat: draft for cuda kernels
|
vor 1 Jahr |
