LLM Validator

A tool for validating and testing Large Language Model (LLM) responses.

Project Structure

llm-validator/
├── backend/
│   ├── app/
│   │   ├── __init__.py
│   │   ├── main.py
│   │   ├── models.py
│   │   ├── schemas.py
│   │   ├── crud.py
│   │   └── database.py
│   ├── requirements.txt

Setup

1. Create a virtual environment:

python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

2. Install dependencies:

cd backend
pip install -r requirements.txt

3. Run the application:

uvicorn app.main:app --reload

The API will be available at http://localhost:8000

API Documentation

Once the server is running, you can access:

• Swagger UI: http://localhost:8000/docs
• ReDoc: http://localhost:8000/redoc

Features

• FastAPI backend with SQLite database
• CRUD operations for validation tests
• Pydantic models for request/response validation
• SQLAlchemy ORM for database operations