Node-Scrawler

Node.js web crawler & scraper.

Installation

$ git clone https://github.com/smontana/node-scrawler.git

---

$npm install

---

After cloning the repo, add a .env file to root and store your sensitive variables here. Reference the .env-example file

Dependencies

• node.js
• express
• dotenv
• cheerio
• request
• json2csv
• moment.js
• debug
• locus (node CLI REPL)