Streaming
LangChain Streaming
Chainlit supports LangChain’s stream API natively. To use streaming just pass streaming=True
when instantiating the LLM:
Code Example
llm = OpenAI(temperature=0, streaming=True)
Also make sure to pass a callback handler to your chain or agent run.
See here for final answer streaming.
Was this page helpful?