Node.js web crawler & scraper.
$ git clone https://github.com/smontana/node-scrawler.git
$npm install
After cloning the repo, add a .env file to root and store your sensitive variables here. Reference the .env-example file
- node.js
- express
- dotenv
- cheerio
- request
- json2csv
- moment.js
- debug
- locus (node CLI REPL)