openai
.

Streaming OpenAI response
Integrations
Streaming is also supported at a higher level for some integrations. For example, to use streaming with Langchain just passstreaming=True
when instantiating the LLM:
openai
.
Streaming OpenAI response
streaming=True
when instantiating the LLM: