crawl / scrape GitHub topics

[shinenelson]

there are 33 public repositories with the terms-of-service topic and 84 public repositories with the privacy-policy topic. This includes companies like GitHub, Basecamp, Unity-Technologies among many others.

Since these are version controlled repositories with plain text files ( mostly markdown ), it may make it lot easier to track changes and source the policy documents verbatim than scraping them off of a website and doing processing on top of all that.

I understand this might introduce some extra technical effort in getting done. The reason I am proposing this was because I was surprised that the Basecamp's Terms of Service was not annotated yet even though they had their policies in a public repository in markdown format.

What would it take for this to get done?

[shinenelson]

this could be converted to a technical issue if it is relevant.