Skip to content

Commit 861fb47

Browse files
committed
update docs
1 parent fdc1275 commit 861fb47

File tree

2 files changed

+116
-4
lines changed

2 files changed

+116
-4
lines changed

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,7 @@ __pycache__
55
!config/.env
66
.DS_Store
77
*.json
8+
docs/source/autoapi
89

910
# Sphinx build directories
1011
_build/

docs/source/index.md

Lines changed: 115 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -11,8 +11,119 @@ BreakYourLLM documentation
1111
documentation for details. -->
1212

1313

14-
```{toctree}
15-
:maxdepth: 2
16-
:caption: API Documentation:
14+
[![Waitlist](https://img.shields.io/badge/Waitlist-Click_here-blue)](https://example.com/form)
15+
[![Website](https://img.shields.io/badge/Website-Click_here-green)](https://example.com/website)
16+
[![Documentation](https://img.shields.io/badge/docs-online-blue?style=flat-square)](https://<your-docs-url>)
17+
[![Python Version](https://img.shields.io/badge/python-3.8%2B-blue.svg)](https://www.python.org/downloads/release/python-380/)
18+
19+
20+
## Test & Simulate your Production LLMs
21+
22+
**Break Your LLM before your users do! With our framework, you can build a comprehensive suite of tests that rigorously test your LLM against your guidelines.**
23+
24+
25+
## Overview
26+
27+
This is a comprehensive framework designed for testing and evaluating language models, particularly in the field of Natural Language Processing (NLP). This toolset provides functionalities for running tests, calculating performance metrics, and visualizing results to assess the quality of language models.
28+
29+
![Overview Image](../images/overview.png)
30+
31+
## Table of Contents
32+
33+
- [Features](#features)
34+
- [Technologies](#technologies)
35+
- [Installation](#installation)
36+
- [Usage](#usage)
37+
- [Codebase Organization](#codebase-organization)
38+
- [Contributing](#contributing)
39+
- [License](#license)
40+
41+
## Features
42+
43+
- **Model Testing**: Execute tests on various language models.
44+
- **Metrics Calculation**: Calculate metrics such as accuracy, hallucination rate, and more.
45+
- **Result Visualization**: Visualize test results for better analysis.
46+
- **Configurable**: Easily configure settings through YAML and environment files.
47+
48+
![Features Image](../images/features.png)
49+
50+
## Technologies
51+
52+
- **Languages**: Python
53+
- **Frameworks/Libraries**:
54+
- OpenAI
55+
- Pandas
56+
- NumPy
57+
- PyYAML
58+
- Requests
59+
- **Tools**:
60+
- Pydantic
61+
- Python-dotenv
62+
63+
## Installation
1764

18-
autoapi/index
65+
To get started with this project, follow these steps:
66+
67+
1. **Clone the repository**:
68+
```bash
69+
git clone https://github.com/yourusername/BreakYourLLM.git
70+
cd BreakYourLLM
71+
72+
2. **Install the required dependencies**:
73+
```bash
74+
pip install -r requirements.txt
75+
```
76+
3. **Configure your environment**:
77+
```bash
78+
Create a .env file based on the provided .env.example and fill in the necessary variables.
79+
```
80+
81+
## Usage
82+
83+
To execute tests and evaluate models, run the following command:
84+
85+
```bash
86+
python sources/execute_tests.py
87+
```
88+
89+
Refer to the documentation in the sources/ directory for more detailed usage instructions.
90+
91+
92+
## Codebase Organization
93+
The project is organized as follows:
94+
95+
```bash
96+
BreakYourLLM/
97+
98+
├── config/ # Configuration files
99+
│ ├── .env # Environment variables
100+
│ └── config.yaml # Configuration settings
101+
102+
├── sources/ # Source code
103+
│ ├── execute_tests.py # Script for executing tests
104+
│ ├── full_pipeline.py # Full testing pipeline script
105+
│ ├── helpers/ # Helper scripts
106+
│ ├── metrics/ # Metrics calculation modules
107+
│ ├── models/ # Model-related modules
108+
│ └── views/ # Result visualization modules
109+
110+
└── requirements.txt # Project dependencies
111+
```
112+
113+
## Contributing
114+
115+
We welcome contributions! Please follow these steps:
116+
117+
1. Fork the repository.
118+
2. Create a new branch (git checkout -b feature/YourFeature).
119+
3. Make your changes and commit them (git commit -m 'Add some feature').
120+
4. Push to the branch (git push origin feature/YourFeature).
121+
5. Open a pull request.
122+
123+
--------
124+
125+
```{toctree}
126+
:maxdepth: 2
127+
:caption: API Documentation:
128+
autoapi/index
129+
```

0 commit comments

Comments
 (0)