inference speed

llama.cpp Adds Multi-Token Prediction for Qwen3.6: A Massive Speed Boost for Local AI

llama.cpp has merged Multi-Token Prediction (MTP) support for the Qwen3.6 model family, with Georgi Gerganov calling it a 'significant milestone for the local AI ecosystem.' The change enables up to 2.5x faster inference on commodity hardware, with no additional model required — just three extra flags at run time.

Read more →