Support Qwen3next and prefix cache.#1115

Open

sufubao wants to merge 65 commits intomainfrom

Commits on Dec 30, 2025

qwen3_moe mtp

shihaobai
authored and
wangzaijun
committed
fix weight name

shihaobai
authored and
wangzaijun
committed
fix qwen3 fa3 mtp

shihaobai
authored and
wangzaijun
committed
fix

shihaobai
authored and
wangzaijun
committed
fix

shihaobai
authored and
wangzaijun
committed
fix

shihaobai
authored and
wangzaijun
committed
fix rebase
wangzaijun
committed
mtp dense

shihaobai
authored and
wangzaijun
committed
mtp dense weight

shihaobai
authored and
wangzaijun
committed
fix

shihaobai
authored and
wangzaijun
committed
fix

shihaobai
authored and
wangzaijun
committed
fix

shihaobai
authored and
wangzaijun
committed
remove mtp norm

shihaobai
authored and
wangzaijun
committed
mtp dense

shihaobai
authored and
wangzaijun
committed
update

shihaobai
authored and
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed
fix mtp mistral model
wangzaijun
committed
mistral mtp pre layer infer
wangzaijun
committed
fix pre layer mtp
wangzaijun
committed
fix mistral mtp weight load
wangzaijun
committed
fix
wangzaijun
committed
fix
wangzaijun
committed

Commits on Dec 31, 2025

qwen3next
sufubao
committed
add radix cache hit rate
sufubao
committed
hhh
sufubao
committed
reset
sufubao
committed
draft
sufubao
committed
tmp
sufubao
committed
done
sufubao
committed
fix
sufubao
committed
fix cudagraph
sufubao
committed
update kernel
sufubao
committed
use autotuner
sufubao
committed
fix autotuner
sufubao
committed
update_kernel
sufubao
committed
update kernel
sufubao
committed
try fix
sufubao
committed
clean code
sufubao
committed
try fix
sufubao
committed
fix prefix cache
sufubao
committed
fix
sufubao
committed
refactor
sufubao
committed
fix
sufubao
committed
fix
sufubao
committed
fix
sufubao
committed
fix
sufubao
committed
feat: add Qwen3Next MTP (Multi-Token Prediction) support

sufubao
and
claude
committed
fix
sufubao
committed
fix: set Triton allocator for TMA kernels in solve_tril
sufubao
committed
feat: add TTFT/ITL metrics and fix Chinese input handling in test_chat

sufubao
and
claude
committed
feat: optimize hybrid radix cache buffer insertion strategy
sufubao
committed
fix: prefix cache optim
sufubao
committed
fix
sufubao
committed
feat: add radix prefix hit rate log
sufubao
committed
fix
sufubao
committed
fix: prefix cache
sufubao
committed
update prefix algo
sufubao
committed
draft
sufubao
committed
fix mistral support fa3
wangzaijun
committed
draft
sufubao
committed
Merge branch 'qwen3_mtp_dense' from origin

sufubao
and
claude
committed

Commits on Jan 3, 2026

before cc
sufubao
committed

Commits on Jan 4, 2026

mtp can run
sufubao
committed

Commits on Jan 5, 2026

refactor
sufubao
committed