DFlash: Block Diffusion for Flash Speculative Decoding - Z Lab
4.0DFlash is a cutting-edge technology by Z Lab that accelerates large language model inference through block diffusion and speculative decoding, delivering up to 3x speedup without compromising quality.
About
DFlash: Block Diffusion for Flash Speculative Decoding is a cutting-edge technology developed by Z Lab, designed to tackle the efficiency bottlenecks in large language model inference. Traditional autoregressive decoding methods deliver high accuracy, but generation speed is constrained by token-by-token computation, making it difficult to meet the demands of real-time applications. By combining a block diffusion mechanism with speculative decoding, DFlash significantly boosts inference throughput without compromising generation quality. This technology is especially well-suited for fast-response dialogue systems, content generation tools, and edge deployment scenarios, offering developers an efficient and scalable solution.
Key Features
Pricing & Fees
- Pricing: Not publicly listed on the pages we reviewed; check the official site for current plans.
- Open code and models: DFlash's paper, code, and pretrained draft models (e.g. z-lab/Qwen3-8B-DFlash-b16, z-lab/Qwen3-Coder-30B-A3B-DFlash) are publicly released for download and self-hosting.
- Framework availability: Supports SGLang for production serving and Hugging Face Transformers for quick experimentation; vLLM integration is in progress.
- Performance claim: Reports up to 6× lossless acceleration on Qwen3-8B, roughly 2.5× faster than EAGLE-3, on the same hardware.
Who It's For
AI researchers and engineers looking to explore new decoding paradigms and optimize large model inference performance; product developers who need to integrate real-time AI capabilities such as chatbots or code completion into their applications; edge computing practitioners deploying large models on resource-constrained devices while prioritizing low power consumption and fast response; and enterprise technology decision-makers evaluating options to reduce LLM serving costs and improve user experience.