Streaming
Coming soon
Streaming is not yet available in the Server AI Toolkit. In the meantime, you can use the AI Toolkit to stream AI-generated content in real-time on the client side.
Streaming support for the Server AI Toolkit is under active development. Once available, it will allow AI-generated document edits to appear in real-time as the model produces them, directly from the server side.
Use the AI Toolkit for streaming
Until server-side streaming is available, you can use the AI Toolkit's streaming feature to achieve real-time updates. The AI Toolkit runs on the client side and supports streaming today via the streamTool method.