Skip to main content
SGLang Diffusion is SGLang’s built-in inference engine for image, video, audio, and action generation. It ships in the same repository and sglang Python package, using the shared sglang generate and sglang serve commands. It provides native SGLang pipelines, diffusers backend support, a server with OpenAI-compatible media APIs and SGLang action APIs, and an optimized kernel stack built on both precompiled sgl-kernel operators and JIT kernels for key inference paths.

Key Features

  • Broad model support across media generation and robot action policies, including Wan, Hunyuan, Qwen-Image, FLUX, Z-Image, GLM-Image, Cosmos3, Pi0.5, and Praxis-1
  • Fast inference with sgl-kernel, JIT kernels, scheduler improvements, and caching acceleration
  • Multiple interfaces: sglang generate, sglang serve, OpenAI-compatible media APIs, and action HTTP/WebSocket APIs
  • Multi-platform support for NVIDIA, AMD, Intel XPU, Ascend, Apple Silicon, and Moore Threads

Quick Start

Start with the recommended Docker setup for Linux GPU deployments. The installation guide also covers pip/uv, source installation, and other platforms. Run the following commands inside the container or your activated Python environment. Generate an image:
Or start an HTTP server:

Start Here

  • Installation: install SGLang Diffusion and platform dependencies
  • Supported Models: browse supported model families, tasks, and public checkpoints
  • CLI: run one-off generation jobs or launch a persistent server
  • OpenAI-Compatible API: send image and video requests to the HTTP server
  • Action Generation API: generate robot action chunks and discover policy metadata
  • VLA Cookbook: deploy action policies with model-specific observation schemas and control-loop settings
  • ComfyUI plugin: use SGLang from ComfyUI in server mode or as a per-step DiT backend
  • Performance Overview: choose speed, memory, parallelism, caching, and quality-tradeoff levers
  • Caching Acceleration: use Cache-DiT, TeaCache, or Spectrum to reduce denoising cost
  • Quantization: configure component checkpoint and causal KV-cache quantization
  • Realtime and Causal Video Models: understand session state, causal caches, and realtime-only controls
  • Contributing: contribution workflow, adding new models, and CI perf baselines

Additional Documentation

Developer Documentation

References