 AlpinDale
|
58e89e29d9
add custom bias to attention.py
|
hai 9 meses |
 AlpinDale
|
9810daa699
feat: INT8 KV Cache (#298)
|
hai 10 meses |
|
AlpinDale
|
31c95011a6
feat: FP8 E5M2 KV Cache (#226)
|
hai 11 meses |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
hai 11 meses |
|
AlpinDale
|
f013d714c0
chore: merge dev branch into main (#177)
|
hai 1 ano |
|
AlpinDale
|
2755a48d51
merge dev branch into main (#153)
|
hai 1 ano |
 50h100a
|
fa0ae5a2c9
feat: new mirostatv2 implementation (#96)
|
hai 1 ano |
|
AlpinDale
|
69204736de
Revert "fix: sync CPU delay in sampler (#93)"
|
hai 1 ano |
|
AlpinDale
|
ce66e1df56
fix: sync CPU delay in sampler (#93)
|
hai 1 ano |
|
AlpinDale
|
efc6f7fbec
chore: reformats (#90)
|
hai 1 ano |
|
AlpinDale
|
3d72f05c7b
feat: flattened 1D tensor -> 2D tensor (#85)
|
hai 1 ano |
|
AlpinDale
|
e6be0118c9
feat: prompt logprobs and batched samplers (#77)
|
hai 1 ano |
|
AlpinDale
|
3bf6197afb
fix: prompt processing delay introduced by #66 (#71)
|
hai 1 ano |
|
AlpinDale
|
cbeeabeb9a
feat: mistral support (#20)
|
hai 1 ano |
|
AlpinDale
|
34295abec4
chore: use xformers attention bias and add docs
|
hai 1 ano |
|
AlpinDale
|
5e82533d02
upstream: add option to specify tokenizer
|
hai 1 ano |
|
AlpinDale
|
cf9dc9b6cd
feat: write model metadata
|
hai 1 ano |
