Flint

docker pull lmsysorg/sglang:dev-flint

from openai import OpenAI

client = OpenAI(base_url="http://localhost:30000/v1", api_key="EMPTY")

response = client.chat.completions.create(
    model="flint",
    messages=[{"role": "user", "content": "What is 15% of 240?"}],
)

message = response.choices[0].message
print("=============== Reasoning ===============")
print(message.reasoning_content)
print("=============== Answer ===============")
print(message.content)

=============== Reasoning ===============
We need answer simple. Need maybe show calculation. User asks "What is 15% of 240?" We can answer. Need be careful maybe just 36. Let's craft concise.
=============== Answer ===============
15% of 240 is **36**.

import json
from openai import OpenAI

client = OpenAI(base_url="http://localhost:30000/v1", api_key="EMPTY")

tools = [
    {
        "type": "function",
        "function": {
            "name": "get_weather",
            "description": "Get the current weather for a city",
            "parameters": {
                "type": "object",
                "properties": {"city": {"type": "string"}},
                "required": ["city"],
            },
        },
    }
]

response = client.chat.completions.create(
    model="flint",
    messages=[{"role": "user", "content": "What's the weather in Paris?"}],
    tools=tools,
)

message = response.choices[0].message
print("=============== Reasoning ===============")
print(getattr(message, "reasoning_content", None))
print("=============== Content ===============")
print(message.content)
print("=============== Tool Calls ===============")
for call in message.tool_calls or []:
    print(call.function.name, json.loads(call.function.arguments))

=============== Reasoning ===============
The user asked for the weather in Paris, and I have a get_weather tool available that takes a city parameter. I should call it with city 'Paris' to get the current weather.
=============== Content ===============
I'll get the current weather for Paris for you.
=============== Tool Calls ===============
get_weather {'city': 'Paris'}