DeepSeek V4 Launches With Million-Token Context and Native Multimodality: Open Weights Break the Ceiling Again

On April 24, 2026, DeepSeek formally released its new flagship DeepSeek-V4 series, in dual versions: V4-Pro and V4-Flash. The series is open-sourced under the MIT license on both HuggingFace and ModelScope, supports context lengths up to one million tokens, and handles multimodality natively — a milestone many in the industry are calling a turning point for open large models.

The timing did not hurt the drama: OpenAI had shipped GPT-5.5 the day before, and the back-to-back releases were instantly nicknamed a “clash of the gods.” V4’s extreme engineering efficiency and disruptive pricing made it the immediate center of attention in developer communities worldwide.

The Product Matrix: Two Versions, All Scenarios

VersionTotal paramsActive paramsContextPretraining tokens
V4-Pro1.6T49B1M tokens33T
V4-Flash284B13B1M tokens32T

Notably, V4-Flash is not a distillation of V4-Pro. It is an independently trained MoE model sharing the same hybrid-attention architecture and core reasoning logic as Pro.

The Core Technology: Engram + mHC Crack the Long-Context Problem

Until now, million-token context was mostly a paper spec — KV cache bloat exploded memory usage and latency climbed. DeepSeek attacked the pain point with two innovations. The Engram architecture, inspired by the memory mechanics of the human hippocampus, dynamically compresses redundant historical information in the KV cache into low-dimensional vectors stored on NVMe SSDs, recalled on demand at inference. Measured on 1M-token scenarios, KV cache occupancy is just 10 percent of V3.2’s, and inference FLOPs drop to 27 percent. The mHC (multi-head compression) framework applies adaptive gating to suppress low-contribution experts and stabilize gradient flow, raising the convergence success rate of the 1.6T-parameter model to 92 percent.

Native Multimodality: From Image Understanding to Video Reasoning

V4’s biggest upgrade is native multimodal support — no longer “a text model with a bolted-on vision encoder” but cross-modal generation and understanding within a unified architecture: images encoded through ViT-14B at 256 visual tokens per image; video sampled at 1fps producing 256 tokens per second with support up to 10-minute clips; and every modality’s tokens sharing the same Transformer backbone for seamless cross-attention.

Pricing: Redefining the Cost Curve

V4’s API pricing is the aggressive part. V4-Flash runs $1.5 per million tokens — one twenty-seventh of GPT-5.5’s rate, more than 99 percent cheaper than Claude Opus 4.6 — while reaching 85-90 percent of their performance on most coding and Q&A tasks. The entire series supports up to 384K output tokens, enough to read and summarize an entire book in a single request.

Domestic Hardware Adaptation: Breaking the CUDA Monopoly

Against the backdrop of US export controls on high-end GPUs, V4’s domestic-chip adaptation carries strategic weight: it supports Huawei Ascend 910B clusters with MindSpore 2.3, deploys directly on Huawei NPUs and Cambricon MLUs, and ships with the open-source inference engine supporting ONNX, GGUF, and Safetensors formats. Officials indicate that once Huawei’s Ascend 950 supernodes ship in volume in the second half of the year, Pro pricing will fall further.

Applications and Honest Limits

The headline scenarios: intelligent coding — multi-file project comprehension, toolchain calls, closed-loop bug fixing, with HumanEval+ Pass@1 at 78.3 percent, surpassing GPT-4 Turbo — and the enterprise knowledge hub: million-page document retrieval, intelligent Q&A, and compliance review without complex RAG slicing. The shortcomings are stated just as plainly: on difficult scientific reasoning (genetics, quantum chemistry) V4 still trails GPT-5.5 by 15-20 points; image generation caps at 512x512; and hallucination risk rises beyond roughly 800K tokens of context.

What the Release Means for the Market

Read strategically, V4 changes three calculations at once. For developers, the price-performance line moves so far that architecture decisions re-open: workloads that were pre-filtered by cost — long-document analysis, whole-repository reasoning, video understanding — return to the plausible column, and the 384K output ceiling in particular enables single-request workflows that previously demanded orchestrating multiple calls. For enterprises, MIT-licensed weights plus domestic-hardware deployment make a self-hosted frontier model a realistic procurement option rather than an aspiration, which matters both for cost control and for jurisdictions weighing data-sovereignty requirements. And for the industry’s narrative, the release lands alongside the broader shift this publication has tracked: with parameter scaling’s returns diminishing and the 97-percent sparsity plateau documented, the differentiators that remain are exactly the ones V4 concentrated on — memory architecture, cache economics, training stability, and hardware breadth. The open-weights community gains not just another checkpoint but a reference design for how to build one.

The caveats deserve equal weight in any adoption decision. Teams needing frontier-grade scientific reasoning will still reach for the closed flagships. Products relying on generated imagery will find the 512x512 ceiling disqualifying. And anyone planning million-token prompts should budget for verification passes, since the documented hallucination drift past 800K tokens is the kind of failure that arrives quietly inside otherwise plausible output. V4’s honest self-assessment of these limits is itself part of the story — a maturity signal from a team confident enough to publish its own weaknesses alongside its wins.

The Bottom Line

The significance of DeepSeek-V4 is not parameter stacking. It is proof that under real compute constraints, algorithmic innovation plus relentless engineering optimization can produce world-class, highly available, low-cost model infrastructure. It is not a GPT-5.5 replacement — it is the victory of a different technical route, one weighted toward efficiency, deployment accessibility, affordability, and ecosystem independence. As the technical report’s closing epigraph from Xunzi puts it: unmoved by praise, unafraid of blame — walk the path, and stand upright.

Related News