Inferact's Kimi K3.1 Pro DSpark Accepts 23% More Tokens, Cuts Draft Memory
Inferact and Red Hat released a new Kimi K3.1 Pro DSpark draft model that replaces the preview. Acceptance length is up to 30% higher on HumanEval and 23% higher pooled across benchmarks. Every draft layer uses a 2K sliding window, so draft KV memory stays fixed up to 1M-token context.

Takeaways
- Inferact and Red Hat released a new Kimi K3.1 Pro DSpark draft model that replaces the preview.
- Acceptance length is up to 30% higher on HumanEval and 23% higher pooled across benchmarks.
- Every draft layer uses a 2K sliding window, so draft KV memory stays fixed up to 1M-token context.
- At 1M context, acceptance rose from 2.77 to 3.42 compared with the full-attention preview.
- Weights are free. Upgrading is a one-line
--speculative-configchange in vLLM, and the vLLM recipes include a preset. - Gains are weakest on chat and agentic coding (MT-Bench 3.39, SWE-bench Pro 3.30).
Inferact and the Red Hat AI Speculators team have released a new DSpark checkpoint for Kimi K3.1 Pro. It replaces Kimi-K3.1-Pro-DSpark-preview, accepts more speculative tokens across every shared benchmark, and bounds the draft model’s KV cache with a 2,048-token attention window.
A small draft model makes speculative decoding practical for Kimi K3.1 Pro, a 2.8-trillion-parameter mixture-of-experts model. The draft proposes several tokens, then the target model verifies the block in one forward pass. Longer accepted runs reduce the number of expensive target-model passes required to generate a response. Compatible rejection sampling preserves the target model’s sampling distribution.
| Benchmark | Preview | New checkpoint | Change |
|---|---|---|---|
| HumanEval | 3.585 | 4.660 | +30% |
| GSM8K | 4.597 | 5.566 | +21% |
| SWE-bench Pro | 2.741 | 3.302 | +20% |
| BEAM 1M | 2.765 | 3.421 | +24% |
| Pooled result | 3.154 | 3.864 | +23% |
| Workload | Acceptance length | Output pattern |
|---|---|---|
| GSM8K | 5.566 | Structured math reasoning |
| HumanEval | 4.660 | Short code generation |
| BEAM 1M | 3.421 | Long-context generation |
| MT-Bench | 3.393 | Open-ended conversation |
| SWE-bench Pro | 3.302 | Agentic software engineering |
Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.
Read original report

