This repository contains a Streamlit application that allows users to chat with CentML’s Serverless API. The application streams responses in real-time, displaying a conversation-style interface.
Set up your CentML API key as an environment variable:
Copy
export CENTML_API_KEY=your_centml_api_key_here
Running the Application
Run the Streamlit app:
Copy
streamlit run app.py
Open your browser and navigate to the URL provided in the terminal (usually http://localhost:8501).
Usage
Once the app is running, you can enter a message in the text input box and click “Send.”
The assistant’s responses will be streamed in real-time below the input box.
Your conversation history will be displayed in the order of user and assistant messages.
Customization• To modify the model used or other parameters such as temperature, max tokens, or penalties, you can edit the stream_response function in app.py.
• You can also customize the UI by modifying the Streamlit components.Environment Variables• CENTML_API_KEY: Your CentML API key. This is required for interacting with CentML’s API.ContactIf you have any questions or issues, feel free to open an issue or contact the repository maintainer.