SpecForge Documentation#
SpecForge is an ecosystem project developed by the SGLang team. It is a framework for training speculative decoding models so that you can smoothly port them over to the SGLang serving framework to speed up your inference.
Get Started
Concepts
Basic Usage
Advanced Features
Benchmarks