2 releases
| 0.1.1 | Jun 28, 2020 |
|---|---|
| 0.1.0 | Jun 27, 2020 |
#117 in #web-scraping
16KB
266 lines
fs_scraper
fs_scraper is a web scraper for FjalorShqip.
Install the cli tool
Prerequirements:
- Install
cargoon your machine - Add
~/.cargo/binto your path
If you already have cargo installed and added to the path then you can install fs_scraper by running the following command.
cargo install fs_scraper
Example usage
Search for a single query (The query should be at least two characters long).
fs_scraper -q fjalor
Scrape the whole database and save the data as json in a fjalorshqip.json
fs_scraper -s -o fjalorshqip.json -j
Show app usage for more flags and options
fs_scraper --help
Dependencies
~0–7MB
~145K SLoC