Merge dev into master

Author: gaurav00700

README.md

@@ -3,7 +3,7 @@
 
 ### Introduction
 
-This repository contains a web application that allows users to interact with large language models (LLMs) through an intuitive interface. The application is built using Streamlit. It connects to an Ollama backend server, which provides access to various LLMs. CI/CD is implemented to automate the build and deployment process, ensuring that the application is always up-to-date.
+This repository contains a web application that allows users to interact with large language models (LLMs) through an intuitive interface. The application is built using Streamlit. It connects to an Ollama backend server, which provides access to various LLMs. CI/CD is implemented to automate the build and deployment process, ensuring that the application is always up-to-date. Application Orchestration is implemented used Kubernetes
 
 ### Features
 
@@ -12,6 +12,7 @@ This repository contains a web application that allows users to interact with la
 - **Inference Speed**: The application leverages Docker Compose to run the frontend and backend services, which can be optimized for faster inference using GPU support if available.
 - **Cache**: Redis is used as a caching mechanism to store frequently accessed queries and responses, reducing redundant computations.
 - **CI/CD**: Continuous Integration and Continuous Deployment (CI/CD) is implemented using GitHub Actions to automate the build and deployment process.
+- **Orchestration**: Application Orchestration is implemented using Kubernetes running on multi node compute environment.
 
 ### Preview
 Application Architecture |
@@ -31,6 +32,7 @@ Frontend Interface |
 
 1. Clone the repository: `git clone git@github.com:gaurav00700/OllamaWebApplication.git`
 2. Navigate to the project directory: `cd OllamaWebApplication`
-3. Run the docker-compose command to start the application: `docker-compose up -d` 
+3. Deployment and Orchestration: `kubectl apply -f k8s`
+4. (Optional) Run the docker-compose command to start the application: `docker-compose up -d` 
 
    (Change the LLM_NAME in `.env` file according to your preference.)