LangChain Streaming - Chainlit

Chainlit supports LangChain’s stream API natively. To use streaming just pass streaming=True when instantiating the LLM:

Code Example

llm = OpenAI(temperature=0, streaming=True)

Also make sure to pass a callback handler to your chain or agent run.

See here for final answer streaming.

Was this page helpful?

Python Streaming Multi-Modal Functionality