MEDHELM

🚀 Getting Started

1. Create your environment

conda env create -f env.yaml

2. Activate the environment

conda activate medhelm

3. Install medhelm

pip install -e .

📊 Generate Plots

1. Heatmap

bash scripts/plots/1_create_heatmaps.sh

2. Cost vs Win Rate

bash scripts/plots/2_create_cost_plot.sh

3. LLM-Judge Stats

bash scripts/plots/3_create_stats_plot.sh

📋 Generate Tables

1. Win rate table

bash scripts/tables/1_win_rate_table.sh