The fetcher queries the feeds table for worker once a minute (headhunter.DB_READY_SEC) One reason is so that "fetch soon" requests are noticed in a timely manner. There are some efficiency improvement ideas at the top of fetcher/hunter.py and fetcher/scoreboard.py