| .. |
|
attention
|
0f7ef9ef7c
fix: import in selector
|
hai 8 meses |
|
common
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
hai 8 meses |
|
distributed
|
d1a3c7bc2c
chore: simplify try-finally logic in pynccl
|
hai 8 meses |
|
endpoints
|
46159b107a
formatting: pt1
|
hai 8 meses |
|
engine
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
hai 8 meses |
|
executor
|
c21af7acad
feat: `DistributedGPUExecutor` abstract class (#541)
|
hai 8 meses |
|
kv_quant
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
hai 1 ano |
|
lora
|
b178ae4b4a
chore: generalize linear_method to be quant_method (#540)
|
hai 8 meses |
|
modeling
|
36660b55c2
chore: mixtral fp8 w/ static scales (#542)
|
hai 8 meses |
|
processing
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
hai 8 meses |
|
quantization
|
36660b55c2
chore: mixtral fp8 w/ static scales (#542)
|
hai 8 meses |
|
spec_decode
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hai 10 meses |
|
task_handler
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
hai 8 meses |
|
transformers_utils
|
ed759f065d
chore: tokenizer_revision -> revision
|
hai 8 meses |
|
__init__.py
|
199e776722
chore: move ray utils to executor dir
|
hai 8 meses |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
hai 1 ano |
AlpinDale
0f7ef9ef7c
fix: import in selector