Preview of what you will build
app.py
in your project directory. This file will contain the main logic for your LLM application.
app.py
, import the necessary packages and define one function to handle a new chat session and another function to handle messages incoming from the UI.
Runnable
with a custom ChatPromptTemplate
for each chat session. The Runnable
is invoked everytime a user sends a message to generate the response.
The callback handler is responsible for listening to the chain’s intermediate steps and sending them to the UI.
app.py
. Then run the following command:
-w
flag tells Chainlit to enable auto-reloading, so you don’t need to restart the server every time you make changes to your application. Your chatbot UI should now be accessible at http://localhost:8000.
cache=true
in your chainlit config file.