Skip to content

Latest commit

 

History

History
 
 

README.md

Node Web Scraping

This project shows how to scrape data from a website, store these data retrieved in the database then create and endpoint to expose them to the world.

Prerequisites

  • Node.js 10+
  • Yarn or NPM

Installation

  • Install dependencies
yarn install
  • Create application configuration
cp .env.example .env
nano .env
  • Scrape programming languages from Wikipedia page
yarn scrape
  • Start Application
yarn start

Browse http://localhost:4500/languages to view languages retrieved by the scraper.

The application will be launched by Nodemon. It will restart automatically on file change