Skip to content

Commit

Permalink
Remove unnecessary leftover comments
Browse files Browse the repository at this point in the history
  • Loading branch information
prncc authored Nov 20, 2017
1 parent c94f339 commit ab69920
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions steam/settings.py
Original file line number Diff line number Diff line change
Expand Up @@ -5,10 +5,8 @@
SPIDER_MODULES = ['steam.spiders']
NEWSPIDER_MODULE = 'steam.spiders'

# Crawl responsibly by identifying yourself (and your website) on the user-agent
USER_AGENT = 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Safari/537.36'

# Obey robots.txt rules
ROBOTSTXT_OBEY = True

DOWNLOADER_MIDDLEWARES = {
Expand Down

0 comments on commit ab69920

Please sign in to comment.