Content-Scraper is a Node.js command line application.
Connect to the website http://shirts4mike.com Get the latest products details (price, title, url and image url) Save the products to a spreadsheet (CSV format) inside the data folder
(will be created if not found)
Content-Scraper uses a number of open source projects to work properly:
- Request - Simplified HTTP request client.
- NodeJS - Running the backend.
- Cheerio - Fast, flexible & lean implementation of core jQuery designed specifically for the server.
- FS - Export a JSON array to CSV.
- json2csv - Json to CVS parser package to conver json data into a csv format.
- JSHint - Static analysis tool for JavaScript.
Those projects were chosen because they're very popular and have a great documentations.
In your terminal navigate to projects root dir (./) then follow install.
npm i bthis-content-scraper
$ npm install
$ npm start
$ NODE_ENV=production npm install
$ npm start
Run this line to check your code for syntax errors
$ npm run error-report
All errors will be stored into a dir called "error-logs".
Open the "scrapper-log" file, which will have more detail on the error along with the date && time of the error.
(will be created if not found)
MIT
Free Software, Yay!!