LLMBenchmark

Environment Setup

Install pytorch based on official website.

Install other dependencies with following command:

pip install -v -e .

Quick Start

Create a YAML configure file (or use one of we provide under ./configs directory).

Start benchmark with following command:

python llmbenchmark/benchmark.py -c <path_to_config_file>

Model Zoo

Anything supported by hugging face.