Version 1.2.2

Merge pull request #6 from rapidclock/rapidclock-readme-update-1

added go doc and get links

minor fixes

v1.2.1

updated licence year

Now with Crawl Rate Limiting.

• This release includes the rate-limiting feature. Rate limiting is defined by requests per second and also has Burst Capacity.
• Also individual requests have a timeout of 15 seconds each before the request is ignored/cancelled.

Added Total Links Crawled Limit

Added User Specifiable Total Links Crawled Limit.

First Working Release

This marks the first working release of the web-octopus crawling library