# SGLang v0.5.12

- Product: SGLang (https://whatsnew.fyi/product/sglang)
- Vendor: LMSYS
- Date: 2026-05-16
- Version: v0.5.12
- Original notes: https://github.com/sgl-project/sglang/releases/tag/v0.5.12
- Permalink: https://whatsnew.fyi/product/sglang/releases/v0.5.12

What's New is an index, not a publisher: every entry below links to the vendor's own release notes, which are the authoritative source. Entries are labelled where they are hand-curated sample data, pre-releases, or drawn from a secondary source such as a developer blog.

Reuse: the summaries, labels and curation here are © What's New. Quote freely with attribution and a link back; wholesale republication of the corpus is not permitted — terms: https://whatsnew.fyi/terms. The vendors' own release notes remain their publishers'.

---

- **added** — DeepSeek V4 full inference path with tensor parallelism, expert parallelism, context parallelism, data parallel attention, HiSparse for CPU KV cache offloading, reasoning parser, tool call parser, DeepGemm and FlashMLA kernels
- **added** — HiCache for DeepSeek V4 under unified Radix Tree
- **added** — W4A4 MegaMoE kernels for DeepSeek V4 with faster speed and negligible accuracy drop
- **added** — Marlin and FlashInfer W4A8 MoE kernels on Hopper
- **added** — TP16 support on H100 and H20
- **added** — Pipeline Parallelism with Prefill-Decode support for DeepSeek V4
- **added** — Unified docker tag lmsysorg/sglang:v0.5.12 for all Nvidia GPUs
- **added** — TokenSpeed MLA attention backend for Blackwell with FP8 KV cache support
- **added** — Support for Intern-S2-Preview model
- **added** — Support for MiniCPM-V 4.6 model
- **added** — Support for Laguna-XS.2 model
- **added** — Support for Ring-2.6-1T model
- **added** — Support for Gemma 4 MTP model
- **added** — Adaptive Spec V2 for speculative decoding
- **added** — EAGLE-3 drafter support with Sliding Window Attention
- **added** — Kimi K2.5 EAGLE-3 MLA speculative decoding
- **added** — Gemma 3 and Gemma 4 with EAGLE-3 speculative decoding support
- **changed** — DeepSeek V3.2 and GLM-5 FP4 low-latency performance improved with PDL enablement and Cute-DSL FP4 dense GEMM
- **changed** — Gateway DeepEP source migrated from community fork to deepseek-ai/DeepEP@hybrid-ep for CUDA 13 support
- **changed** — FlashInfer pinned at version 0.6.11.post1
- **fixed** — Spec-decoding CPU overhead reduced

#### Highlights

- **DeepSeek V4 support**: Full inference path for DeepSeek-V4 (#23882), including:

    Day-0 Features: #23882
    - Parallelism: Tensor Parallelism/Expert Parallelism/Context Parallelism/Data Parallel Attention
    - Hardware: Nvidia B300/B200/H200/H100/GB200/GB300, AMD MI35X
    - Prefill-Decode Disaggregation
    - HiSparse for offloading inactive KV cache to CPU memory
    - Reasoning parser and Tool Call Parser
    - DeepGemm and FlashMLA kernels for DeepSeek V4, including MegaMoE

    Post-Day-0 additions:
    - HiCache for DeepSeek V4 under unified Radix Tree [UnifiedTree]: #24691
    - W4A4 MegaMoE kernels — faster speed with negligible accuracy drop: #25052
    - Marlin/FlashInfer W4A8 MoE kernels on Hopper: #24816 #24986
    - Faster V2 fused compression kernels: #24890
    - TP16 support on H100/H20: #24949
    - Fused SiLU+clamp+FP8 quant kernel: #24897
    - Optimized MHC + DeepGemm pipeline (fused norm, fused hc_head): #24775
    - Non-standard chat template support for DSv4: #23915
    - Multi-detokenizer support: #24944
    - Pipeline Parallelism + PD support for DeepSeek-V4: #24700
    - **A unified docker tag `lmsysorg/sglang:v0.5.12` for all Nvidia GPUs**

    See the [LMSYS blog](https://www.lmsys.org/blog/2026-04-25-deepseek-v4/) and the [DeepSeek-V4 cookbook](https://docs.sglang.io/cookbook/autoregressive/DeepSeek/DeepSeek-V4) for more details.

- **TokenSpeed MLA attention backend (Blackwell, FP8 KV cache)**: New MLA prefill/decode kernels integrated as an attention backend on SM100, with FP8 KV cache support for low-latency MLA serving: #24925

- **DSv3.2 / GLM-5 FP4 low-latency perf**: PDL enabled across DSv3.2 / GLM-5 kernels, `torch.mm` for the DeepSeek V3.2 indexer GEMM, and a reland of the Cute-DSL FP4 dense GEMM — materially trimming low-latency overheads on FP4 paths: #23965, #23856, #23590, #25311

- **New Model Support**: DeepSeek V4 #23882, Intern-S2-Preview #24875, MiniCPM-V 4.6 #24855, Laguna-XS.2 #24204, Ring-2.6-1T #25360, and Gemma 4 MTP #24436 — with cookbook recipes for tuned deployment commands. See [docs.sglang.io/cookbook](https://docs.sglang.io/cookbook)

- **HiCache + UnifiedRadixTree**: HiCache framework support for UnifiedRadixTree (with SWA), HiCache for DeepSeek V4, SSD offload through Mooncake store, and stability fixes across cascade eviction, tombstone replay, and partial-match paths: #23316, #23391, #24691, #24277, #24943, #24972, #25068, #25277

- **Speculative Decoding V2 maturation**: Adaptive Spec V2, EAGLE-3 SWA + newer drafters, Kimi K2.5 EAGLE-3 MLA, Gemma 3/4 + EAGLE-3, and an extensive naming / shape-handling refactor across draft-extend paths: #23336, #24663, #24664, #24826, #23976, #24859

- **CUDA 13 DeepEP migration**: Gateway DeepEP source swapped from a community fork to `deepseek-ai/DeepEP@hybrid-ep` so DeepEP builds and runs cleanly on the CUDA 13 default; FlashInfer pinned at 0.6.11.post1 alongside a gpt-oss triton-kernel fix: #25113


##### New Model Support

Entries with a published cookbook recipe come first; entries whose cookbook page is still pending are grouped at the bottom.

* DeepSeek V4 (see [cookbook](https://docs.sglang.io/cookbook/autoregressive/DeepSeek/DeepSeek-V4); [LMSYS blog](https://www.lmsys.org/blog/2026-04-25-deepseek-v4/))
* Intern-S2-Preview: #24875, #25115, #25134 (see [cookbook](https://docs.sglang.io/cookbook/autoregressive/InternLM/Intern-S2-Preview))
* MiniCPM-V 4.6: #24855, #24876, #24991, #24998 (see [cookbook](https://docs.sglang.io/cookbook/autoregressive/OpenBMB/MiniCPM-V-4_6))
* Laguna-XS.2 (Poolside): #24204, #24730 (see [cookbook](https://docs.sglang.io/cookbook/autoregressive/Poolside/Laguna-XS.2))
* Ring-2.6-1T (InclusionAI, trillion-param reasoning): #25360, #25370 (see [cookbook](https://docs.sglang.io/cookbook/autoregressive/InclusionAI/Ring-2.6-1T))
* Gemma 4 MTP (MTP head for Gemma 4): #24436, #24433
* Trinity-mini (Ascend NPU, ~90% accuracy): #

_[Truncated at 4000 characters — full notes: https://github.com/sgl-project/sglang/releases/tag/v0.5.12]_