web-scraper

Web URLs scraper built using node.js

This piece of code will collect hyperlinks by scraping them from a given base url. The output will be generated in form of a csv file.

Set your base url in 'baseUrl' variable in server.js file. Set global connection limit in globalConnectionLimit varieble.

Run server.js using node server

$ node server.js

All the links will be saved in file links.csv