 AlpinDale
|
a4cbcfe59f
feat: disable logprob serialization to CPU for spec decode
|
hai 5 meses |
 AlpinDale
|
af43576da0
feat: add MLPSpeculator speculative decoding support (#572)
|
hai 5 meses |
|
AlpinDale
|
4d1e613804
chore: minor simplifications
|
hai 5 meses |
|
AlpinDale
|
5b0c11d190
support pipeline parallel pynccl groups
|
hai 6 meses |
|
AlpinDale
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
hai 6 meses |
|
AlpinDale
|
79901b76de
logprobs for target model (spec decoding)
|
hai 6 meses |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hai 8 meses |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
hai 10 meses |
