Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 11, 2018

• Use default value of AUTOTHROTTLE_TARGET_CONCURRENCY setting by removing custom value

  prncc

  committed
  d1508fc

  Copy full SHA for d1508fc

• Encode .jl output files using utf-8

  prncc

  committed
  e92c9af

  Copy full SHA for e92c9af

Commits on Feb 2, 2018

• Add option to crawl a single title by Steam id

  prncc

  committed
  98a1f6f

  Copy full SHA for 98a1f6f

• Switch to single quotes in formatted strings

  prncc

  committed
  e106fc5

  Copy full SHA for e106fc5

• Add option to scrape reviews for a particular Steam id

  prncc

  committed
  97ac4a5

  Copy full SHA for 97ac4a5

• Switch test url to a less popular game

  prncc

  committed
  2806dc5

  Copy full SHA for 2806dc5

• Fix extraction of recommended field from reviews

  prncc

  committed
  2ac67d8

  Copy full SHA for 2ac67d8

• Fix linting issues in items.py

  prncc

  committed
  1e4918e

  Copy full SHA for 1e4918e

• Update user agent to generic value

  prncc

  committed
  65e9214

  Copy full SHA for 65e9214

• Fix linting issues in the two spiders

  prncc

  committed
  107d27c

  Copy full SHA for 107d27c

• Remove package versions from requirements.txt

  prncc

  committed
  fd6f76a

  Copy full SHA for fd6f76a

Commits on Nov 20, 2017

• Remove unnecessary leftover comments

  prncc

  authored
  d0729b8

  Copy full SHA for d0729b8

• Remove unnecessary leftover comments

  prncc

  authored
  ab69920

  Copy full SHA for ab69920

• Update readme with links to accompanying article

  prncc

  authored
  c94f339

  Copy full SHA for c94f339

Commits on Jun 22, 2017

• Add bind address to scrapyd README explanation

  prncc

  committed
  8c508f1

  Copy full SHA for 8c508f1

Commits on Jun 21, 2017

• Update README with remote deployment info

  prncc

  committed
  25361ad

  Copy full SHA for 25361ad

• Expand README with instructions to run spiders

  prncc

  committed
  82cd923

  Copy full SHA for 82cd923

• Fix deployment path in scrapydee

  prncc

  committed
  93cdb70

  Copy full SHA for 93cdb70

Commits on Jun 13, 2017

• Update scripts

  prncc

  committed
  f927b23

  Copy full SHA for f927b23

Commits on Jun 10, 2017

• Make docstring imperative

  prncc

  committed
  06e0b09

  Copy full SHA for 06e0b09

• Remove unnecessary requirement

  prncc

  committed
  e3feaff

  Copy full SHA for e3feaff

• Remove comments from settings and add dedupe setting

  prncc

  committed
  8d1273a

  Copy full SHA for 8d1273a

• Add custom dedupe filter

  prncc

  committed
  9279f94

  Copy full SHA for 9279f94

• Create README.md

  prncc

  authored
  b2f4182

  Copy full SHA for b2f4182

• Merge pull request prncc#1 from prncc/dev

  Show description for 27dd419
  prncc

  authored
  27dd419

  Copy full SHA for 27dd419

• Update product spider start url

  prncc

  committed
  a98fa43

  Copy full SHA for a98fa43

• Enable cache by default

  prncc

  committed
  5eaac09

  Copy full SHA for 5eaac09

• Expand gitignore

  prncc

  committed
  99e5f06

  Copy full SHA for 99e5f06

• Update start/test urls for review spider

  prncc

  committed
  21ded31

  Copy full SHA for 21ded31

• Bump deployment version

  prncc

  committed
  c0eb441

  Copy full SHA for c0eb441

Commits on Apr 23, 2017

• Update path to eggs to reflect new directory structure

  prncc

  committed
  837664f

  Copy full SHA for 837664f

• Shuffle urls before splitting

  prncc

  committed
  466acbf

  Copy full SHA for 466acbf

• Update paths in scrapydee.sh to reflect new relative directory

  prncc

  committed
  cfa792d

  Copy full SHA for cfa792d

• Move scrapydee.sh to scripts folder

  prncc

  committed
  1184713

  Copy full SHA for 1184713

• Move steam scrapy project up a directory level

  prncc

  committed
  d166709

  Copy full SHA for d166709

Pagination

Previous

Next