This project shows how to scrape data from a website, store these data retrieved in the database then create and endpoint to expose them to the world.
- Node.js 10+
- Yarn or NPM
- Install dependencies
yarn install- Create application configuration
cp .env.example .env
nano .env- Scrape programming languages from Wikipedia page
yarn scrape- Start Application
yarn startBrowse http://localhost:4500/languages to view languages retrieved by the scraper.
The application will be launched by Nodemon. It will restart automatically on file change