1
0
AlpinDale fc5ef786b0 Merge branch 'main' into lm_head_lora 1 долоо хоног өмнө
..
__init__.py a5bfc2bc3d VLM: add support for LLaVA-Onevision model (#1100) 1 долоо хоног өмнө
arctic.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
baichuan.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
bart.py a985143768 core: add cuda graph support for encoder-decoder models (#1051) 1 сар өмнө
blip.py 7ce3174039 VLM: refactor blip models to support composite weight loading (#1098) 1 долоо хоног өмнө
blip2.py 7ce3174039 VLM: refactor blip models to support composite weight loading (#1098) 1 долоо хоног өмнө
bloom.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
chameleon.py 651678d2df VLM: use `SequenceData.from_token_counts` to create dummy data (#1093) 1 долоо хоног өмнө
chatglm.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
clip.py a5bfc2bc3d VLM: add support for LLaVA-Onevision model (#1100) 1 долоо хоног өмнө
commandr.py 135dfd648b fix: LoRA support for Cohere and Jamba models (#1004) 1 сар өмнө
dbrx.py b65449b5ad moe: refactor DBRX experts to support FusedMoE (#1095) 1 долоо хоног өмнө
decilm.py 9022c6d869 remove progress_bar imports 3 сар өмнө
deepseek.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
deepseek_v2.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
eagle.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
exaone.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
falcon.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
fuyu.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
gemma.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
gemma2.py b33cf04386 quants: add bitsandbytes support for gemma2 model (#1026) 1 сар өмнө
gpt2.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
gpt_bigcode.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
gpt_j.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
gpt_neox.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
granite.py 11f49b5341 fix: granite logit scale in logit computation (#1054) 1 сар өмнө
idefics2_vision_model.py f1d0b77c92 [0.6.0] Release Candidate (#481) 5 сар өмнө
interfaces.py 80e7f3b0bd feat: support finetuned lm_head and embed_tokens in LoRA adapters 1 сар өмнө
intern_vit.py f56d6b396a vlm: fallback to SDPA for ViT models on CPU backend (#982) 1 сар өмнө
internlm2.py 7632f91429 fix: InternLM2 model with Tensor Parallel (#980) 1 сар өмнө
internvl.py 91d03c04d2 VLM: refactor composite weight loading logic (#1097) 1 долоо хоног өмнө
jais.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
jamba.py 135dfd648b fix: LoRA support for Cohere and Jamba models (#1004) 1 сар өмнө
llama.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
llama_embedding.py 9022c6d869 remove progress_bar imports 3 сар өмнө
llava.py 91d03c04d2 VLM: refactor composite weight loading logic (#1097) 1 долоо хоног өмнө
llava_next.py 7ce3174039 VLM: refactor blip models to support composite weight loading (#1098) 1 долоо хоног өмнө
llava_next_video.py 91d03c04d2 VLM: refactor composite weight loading logic (#1097) 1 долоо хоног өмнө
llava_onevision.py a5bfc2bc3d VLM: add support for LLaVA-Onevision model (#1100) 1 долоо хоног өмнө
mamba.py 3bb0f07461 chore: rename `task_handler` to `worker` (#985) 1 сар өмнө
mamba_cache.py a113309876 kernel: add meta functions for ops to prevent graph breaks (#1019) 1 сар өмнө
medusa.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
minicpm.py ce7b602f03 model: add support for MiniCPM-3 (#1044) 1 сар өмнө
minicpm3.py ce7b602f03 model: add support for MiniCPM-3 (#1044) 1 сар өмнө
minicpmv.py 651678d2df VLM: use `SequenceData.from_token_counts` to create dummy data (#1093) 1 долоо хоног өмнө
mixtral.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
mixtral_quant.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
mlp_speculator.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
molmo.py acc0c727c8 vlm: add support for molmo vision model (#1069) 1 сар өмнө
mpt.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
na_vit.py 9f3e7c86e2 feat: add fused Marlin MoE kernel (#934) 1 сар өмнө
nemotron.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
olmo.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
olmoe.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
opt.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
orion.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
paligemma.py 91d03c04d2 VLM: refactor composite weight loading logic (#1097) 1 долоо хоног өмнө
persimmon.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
phi.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
phi3.py ec17b6c4d0 fix: Phi3.5 Mini and MoE LoRA inference (#1070) 1 сар өмнө
phi3_small.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
phi3v.py 4d14bd1fe5 vlm: add multi-input support for LLaVA and InternVL models (#1002) 1 сар өмнө
phimoe.py ec17b6c4d0 fix: Phi3.5 Mini and MoE LoRA inference (#1070) 1 сар өмнө
pixtral.py 651678d2df VLM: use `SequenceData.from_token_counts` to create dummy data (#1093) 1 долоо хоног өмнө
qwen.py 651678d2df VLM: use `SequenceData.from_token_counts` to create dummy data (#1093) 1 долоо хоног өмнө
qwen2.py c90abcc603 VLM: add pipeline parallelism support for Qwen2-VL (#1103) 1 долоо хоног өмнө
qwen2_moe.py 5224389dae chore: skip loading extra bias for qwen2 moe GPTQ (#1011) 1 сар өмнө
qwen2_vl.py c90abcc603 VLM: add pipeline parallelism support for Qwen2-VL (#1103) 1 долоо хоног өмнө
siglip.py a5bfc2bc3d VLM: add support for LLaVA-Onevision model (#1100) 1 долоо хоног өмнө
solar.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
stablelm.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
starcoder2.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө
ultravox.py 91d03c04d2 VLM: refactor composite weight loading logic (#1097) 1 долоо хоног өмнө
utils.py 91d03c04d2 VLM: refactor composite weight loading logic (#1097) 1 долоо хоног өмнө
xverse.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 1 сар өмнө