Machine Learning from Human Preferences

Sang Truong, Andreas Haupt, and Sanmi Koyejo

This book is available online at: ai.stanford.edu/~sttruong/mlhp

How to build the book

1. Install Quarto:

• MacOS and Windows: https://quarto.org/docs/get-started/
• If you are using MacOS and having HomeBrew: brew install quarto

2. Install Python 3.8 or later:

• MacOS: brew install python
• Windows: Download from https://www.python.org/downloads/
• Install Python packages:

pip install jupyter jupyter-cache

After this step, you can use the terminal to run the following commands.

1. Clone the repo:

git clone https://github.com/sangttruong/mlhp

1. Go to the repo:

cd mlhp

5.[One-time action]: Install required plugins.

• Open R shell:

R

• Restore dependencies:

renv::restore()

1. Preview the book:

• If you only want to preview the book (prior to publish it):

quarto preview

• Using your browser to go to http://localhost:4200/ to see the book preview

1. Publish the book:
   • After you complete all edits and want to publish the book:

   quarto render --to html

   • The build website will be stored in folder _book.
   • Commit changes to Github:

   git add .
   git commit -m "commit message"
   git push origin main

Note that this book is licensed CC-BY-NC 4.0.