| .. |
|
attention
|
ac79d115b3
add guards for prefix caching, fp8, chunked, etc
|
hai 5 meses |
|
common
|
ac79d115b3
add guards for prefix caching, fp8, chunked, etc
|
hai 5 meses |
|
distributed
|
5b0c11d190
support pipeline parallel pynccl groups
|
hai 5 meses |
|
endpoints
|
696f2cd59c
add phi3_small support with blocksparse attention
|
hai 5 meses |
|
engine
|
ac79d115b3
add guards for prefix caching, fp8, chunked, etc
|
hai 5 meses |
|
executor
|
5b0c11d190
support pipeline parallel pynccl groups
|
hai 5 meses |
|
kv_quant
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
hai 10 meses |
|
lora
|
5b0c11d190
support pipeline parallel pynccl groups
|
hai 5 meses |
|
modeling
|
9bbc75d2e3
wip
|
hai 5 meses |
|
processing
|
0d15aa3ab3
fix prefix caching for block manager v2
|
hai 5 meses |
|
quantization
|
5884e0b904
add bitnetforcausallm support
|
hai 5 meses |
|
spec_decode
|
344ddaac5a
properly disable speculative decoding
|
hai 5 meses |
|
task_handler
|
5b0c11d190
support pipeline parallel pynccl groups
|
hai 5 meses |
|
transformers_utils
|
5884e0b904
add bitnetforcausallm support
|
hai 5 meses |
|
__init__.py
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
hai 5 meses |
|
py.typed
|
1c988a48b2
fix logging and add py.typed
|
hai 1 ano |
AlpinDale
9bbc75d2e3
wip