AlpinDale 201db10f02 models: add support for Phi3 MoE 1 개월 전
..
compressed_tensors 201db10f02 models: add support for Phi3 MoE 1 개월 전
gguf_utils 8a71788372 Add OLMoE (#772) 3 달 전
kernels f7f3fed265 feat: add async postprocessor (#925) 1 개월 전
utils 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 1 개월 전
__init__.py f98e7b2f8c feat: add HQQ quantization support (#795) 2 달 전
aqlm.py ccbda97416 fix: types in AQLM and GGUF for dynamo support (#736) 4 달 전
autoquant.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 달 전
awq.py edec2e9a9e feat: migrate awq and awq_marlin to AphroditeParameter (#702) 4 달 전
awq_marlin.py 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 1 개월 전
awq_triton.py fcfcfc65e1 quants: add triton kernels for AWQ (#946) 1 개월 전
base_config.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 달 전
bitsandbytes.py 6bdff60aab quant: support pre-quanted bitsandbytes checkpoints (#961) 1 개월 전
deepspeedfp.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 달 전
eetq.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 달 전
exl2.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 달 전
experts_int8.py 201db10f02 models: add support for Phi3 MoE 1 개월 전
fbgemm_fp8.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 달 전
fp6.py 73177656ed feat: quant_llm support (#755) 4 달 전
fp8.py 201db10f02 models: add support for Phi3 MoE 1 개월 전
gguf.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 개월 전
gptq.py ccbda97416 fix: types in AQLM and GGUF for dynamo support (#736) 4 달 전
gptq_marlin.py 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 1 개월 전
gptq_marlin_24.py 5d9021969c quants: update `qqq` and `gptq_marlin_24` to use AphroditeParameters (#921) 1 개월 전
hadamard.safetensors 9d81716bfd [v0.5.3] Release Candidate (#388) 8 달 전
hqq_marlin.py f98e7b2f8c feat: add HQQ quantization support (#795) 2 달 전
kv_cache.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 달 전
marlin.py 799667737b quantization: update marlin to use `AphroditeParameters` (#913) 1 개월 전
qqq.py 5d9021969c quants: update `qqq` and `gptq_marlin_24` to use AphroditeParameters (#921) 1 개월 전
quip.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 달 전
quip_utils.py 8a71788372 Add OLMoE (#772) 3 달 전
schema.py 9d81716bfd [v0.5.3] Release Candidate (#388) 8 달 전
squeezellm.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 달 전
tpu_int8.py f4b62bf803 quant: update tpu_int8 to use AphroditeParameters (#959) 1 개월 전