Using scrapy to fetch some data

Please do find a list of proxies so you can use this one and fill the proxies.txt file with them

SCRAPY_URL_BASE='https://militancia.para.com/publico/paso-{}/{}' scrapy crawl people -o people.jl

You can customize your defaults in settings.py

If you find a nice list of proxies, please do fill an issue or a PR to let others know

With this you will learn to:

1. Use some proxies to fetch the data
2. Practice crawling wizard pages to extract data
3. Recover from gaps and continue working
4. Store the data so you can retrieve it easily afterwards
5. Have lots of fun

Use this at your own risk, no guarrantee or anything like this, you are warned.