Pinned Loading

1. openai/evals openai/evals Public

   Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

   Python 17.1k 2.8k

2. openai/frontier-evals openai/frontier-evals Public

   OpenAI Frontier Evals

   Python 914 103

3. openai/mle-bench openai/mle-bench Public

   MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

   Python 1k 152

4. bitblaster-16 bitblaster-16 Public

   BitBlaster-16 is a 16-bit computer built from scratch using only NAND gates and data flip-flops as primitives! :)

   Python 2

5. fermi-poker fermi-poker Public

   Want to get better at making better estimates under uncertainty? No? Well, now you can!

   Python 3

6. summarizing-from-human-feedback summarizing-from-human-feedback Public

   Implementation of OpenAI's "Learning to Summarize with Human Feedback"

   Jupyter Notebook 7 1