Streaming

AgentAPI supports token streaming using SSE.

Automatic Streaming with @app.chat

If a handler returns an async iterator, AgentAPI automatically returns text/event-stream.

@app.chat("/stream")
async def stream_chat(message: str):
    return agent.stream(message)

SSE Behavior

• Emits incremental data: chunks
• Sends data: [DONE] at completion
• Includes anti-buffering headers for reverse proxies

Error Behavior in Streams

During streaming, runtime errors are emitted as SSE error events:

• config errors (missing keys)
• upstream provider failures

Explicit Streaming Route

@app.stream still exists as a compatibility alias when you want strict streaming-only semantics.

@app.stream("/stream")
async def stream_chat(message: str):
    return agent.stream(message)

Quick Test

curl -N -X POST "http://127.0.0.1:8000/stream?message=hello"