2 seconds per crate is really long if there are a lot of crates. https://crates.io/data-access For information through the index, it would be nice to use the index before downloading the dump.