1. Model Introduction
Intern-S1 includes the large Intern-S1 MoE model and the smaller Intern-S1-mini dense model. The command generator below covers BF16 and FP8 serving on NVIDIA H100/H200/B200/B300 platforms.2. SGLang Installation
Refer to the official SGLang installation guide, or install from source:Command
3. Model Deployment
3.1 Basic Configuration
3.2 Configuration Tips
- FP8 checkpoints use the matching BF16 checkpoint as tokenizer path.
- B300 deployments use
--attention-backend flashinfer. - Enable
--reasoning-parser interns1and--tool-call-parser interns1when your workload needs structured reasoning or tool-call parsing.