Add a README to the benchmark directory that contains some commonly recommended ways of running the benchmarks, and add a link to it from the CONTRIBUTING.md file.
This would make the lives of reviewers and authors easier, when having to run benchmarks for PR focussed on performance improvements.