| .. |
|
guided_decoding
|
0256ed236b
feat: windows support (#790)
|
2 months ago |
|
layers
|
ef99a567b6
fix: temp_last warning being repeated for every output token (#869)
|
1 month ago |
|
model_loader
|
e182d00256
feat: AWQ quantization for InternVL (#867)
|
1 month ago |
|
models
|
e182d00256
feat: AWQ quantization for InternVL (#867)
|
1 month ago |
|
__init__.py
|
7df7b8ca53
optimization: reduce end-to-end overhead from python obj allocation (#666)
|
4 months ago |
|
_custom_op.py
|
5d37ec1016
suppress tpu import warning (#696)
|
4 months ago |
|
parameter.py
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
1 month ago |
|
pooling_metadata.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
sampling_metadata.py
|
2150bb5019
sampler: add range parameter for DRY (#855)
|
1 month ago |
|
utils.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |
AlpinDale
ef99a567b6
fix: temp_last warning being repeated for every output token (#869)