跪拜 Guibai
← All articles
LLM · AIGC · Vibe Coding

Kimi K3.1 Leaves a Paper Trail: Kibitz on LMArena, SGLang Hardening PRs, and an Engineering Release in the Making

By Behaviour ·
Read original on juejin.cn ↗ Google Translate ↗ Alt translation

K3.1 exists today only as a rumor with a strong paper trail: no public endpoint, price, or weight repo, so production code cannot be pinned to it. The same-day SGLang work points to where the next release competes: agent tool-call reliability and serving stability, not headline benchmark numbers.

Summary

Kimi K3.1 has not launched, but it is leaving fingerprints. Two anonymous LMArena models named Kibitz and Kalmia appeared on 2026-10-22, and community consensus reads Kibitz as Moonshot AI's alias for the next Kimi model. That same day, a cluster of SGLang pull requests landed: shared-expert output moved onto the output stream, native output validation and terminal failure propagation were added, tool-call parameters switched from whole-buffer buffering to incremental streaming, KDA fused decode became default on AMD gfx950, and FP8/SiTU quantization work went in. These are the fixes a serving stack gets before exposing a new model to external traffic, not while patching a live one.

Public evidence for the release itself is still thin. DeepInfra's full model list contains only K2.6 and K3; SGLang has no kimi_k3_1.py; searches for 'K3.1', 'Kalmia', and 'Kibitz' in the repo return zero. The current K3 is a 2.8T-parameter MoE with 104B activated parameters and a 1M context, priced at $2.85/M input and $14.25/M output on DeepInfra. Its official benchmark card leads Claude Fable 5 on SWE-Marathon (42.0 vs 35.0) and MCPMark-Verified (94.5 vs 87.4), but loses on HLE-Full, CritPt, GDPval-AA v2 Elo, and even Kimi's own Code Bench 2.0. No official comparison includes GPT-6 Astra, whose release date is itself disputed.

If the anonymous runs and PRs are an accurate guide, K3.1 is an engineering-oriented release: deployment stability and tool-call streaming are exactly what the SGLang work is polishing. The version number supports that reading, since K3 already had a K3-0903 refresh in September. Expect the first confirmation signals in DeepInfra's model list and a kimi_k3_1.py merge in SGLang, before any announcement event.

Takeaways
— LMArena hosted anonymous models Kibitz and Kalmia on 2026-10-22, with Kibitz widely read as Moonshot AI's alias for Kimi K3.1.
— SGLang merged a same-day batch of PRs covering shared-expert output streaming, output validation, terminal failure propagation, incremental tool-call streaming, AMD gfx950 KDA decode, and FP8/SiTU quantization.
— DeepInfra's public model list still has only Kimi K2.6 and K3; a K3.1 deployment claim has no counterpart there.
— Kimi K3 uses 2.8T total parameters, 104B activated, a 1M-token context, 93 layers, and an MoE with 896 experts selecting 16 per token.
— DeepInfra pricing for K3 is $2.85/M input, $14.25/M output, and $0.285/M cache hit; K2.6 costs $0.75/$3.5 with a 262K context.
— Official K3 benchmarks beat Claude Fable 5 on SWE-Marathon and MCPMark-Verified, but lose on HLE-Full, CritPt, GDPval-AA v2 Elo, and Code Bench 2.0.
— Moonshot's API exposes reasoning_effort as a top-level request field, defaulting to max; it is also where migrated scripts most often break.
— Self-hosting K3 requires more than 1.4TB for MXFP4 weights, which exceeds eight 141GB GPUs, so the practical path is a hosted API.
Conclusions

The same-day timing of the SGLang PRs carries more weight than the Arena screenshots, because streaming and failure propagation are prerequisites for exposing a new model, not post-release maintenance.

A reused codename like Kibitz looks like deliberate continuity from Moonshot, but the public record offers no way to rule out a name-pool collision, so the evidence stays circumstantial.

K3.1's likely scope is already visible in its version number: a .1 bump plus inference-stack hardening means an engineering iteration, while a real capability jump would more plausibly land as K4.

The official benchmark card omits GPT-6 Astra entirely, and the closest listed model, GPT-5.6 Sol, still beats K3 on GDPval Elo; treating Astra as the comparison target inflates K3.1 expectations before it is even confirmed.

MXFP4 quantization-aware training changes deployment economics: even 4-bit weights are too large for eight 141GB GPUs, so most users will consume K3.1 through hosted APIs and have little reason to self-host.

Concepts & terms
KDA
The attention variant used in Kimi K3's 69-layer text backbone. Its overhead grows more slowly than standard attention on long sequences, making the 1M-token context practical; SGLang added a fused decode kernel for it on AMD gfx950.
Latent MoE
A mixture-of-experts design in Kimi K3 where token routing happens in a latent space. The model has 896 experts, activates 16 per layer, and adds two shared experts; per-expert hidden dimension is 3072 with a latent MoE dimension of 3584.
reasoning_effort
A top-level parameter in Moonshot's OpenAI-compatible API that controls how much compute the model spends before answering. Values are low, high, or max, with max as the default; it directly trades latency and cost against output quality.
MXFP4
A 4-bit floating-point format for model weights, paired with MXFP8 activations on Kimi K3. K3 is trained with quantization awareness, so the MXFP4 weights lose less accuracy than a post-training compression would.
Source: juejin.cn ↗ Google Translate ↗ Backup ↗