Program that can be used to download data from multiple sources and protocols to local disk
- Python 3.6
python3 -m venv envsource env/bin/activatepip3 install -r requirements.txtFor deactivate
deactivatepython3 setup.py testDefault script will download to folder downloads in current path.
Download from HTTP
python3 hercules/cli.py download https://i.pinimg.com/564x/07/ae/16/07ae164da80a7168c59a01c41bfdb74a.jpgDownload from FTP
python3 hercules/cli.py download ftp://206.189.83.200/files/agoda.jpgDownload from SFTP
python3 hercules/cli.py download sftp://206.189.83.200//home/agoda_sftp_user/agoda.jpgDownload list urls in file
python3 hercules/cli.py download-from-urls-file urls.txtIf want to change destination, add env parameter FOLDER_DOWNLOAD, example:
FOLDER_DOWNLOAD=custom_download python3 hercules/cli.py download https://i.pinimg.com/564x/07/ae/16/07ae164da80a7168c59a01c41bfdb74a.jpg