Need some exception handling for when the timeout is exceeded #5

Open

opened

sitemap_grabber/src/sitemap_grabber/sitemap_grabber.py

Line 32 in dcb1fe2

response = requests.get(robots_url, headers=useragent, timeout=TIMEOUT)

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests