SimKennedy / sp_E3520_SCC_gov

Suffolk County Council | Suffolk County Council

README.md

This is a scraper that runs on Morph. To get started see the documentation

Last run failed 2017-01-17 with status code 1.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Python app detected [1G-----> Installing python-2.7.9 [1G $ pip install -r requirements.txt [1G Collecting beautifulsoup4==4.2.0 (from -r requirements.txt (line 1)) [1G Downloading beautifulsoup4-4.2.0.tar.gz (63kB) [1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 4)) [1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki [1G Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 4)) [1G Downloading dumptruck-0.1.6.tar.gz [1G Collecting requests (from scraperwiki->-r requirements.txt (line 4)) [1G Downloading requests-2.12.4-py2.py3-none-any.whl (576kB) [1G Installing collected packages: beautifulsoup4, dumptruck, requests, scraperwiki [1G Running setup.py install for beautifulsoup4: started [1G Running setup.py install for beautifulsoup4: finished with status 'done' [1G Running setup.py install for dumptruck: started [1G Running setup.py install for dumptruck: finished with status 'done' [1G Running setup.py develop for scraperwiki [1G Successfully installed beautifulsoup4-4.2.0 dumptruck-0.1.6 requests-2.12.4 scraperwiki [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 22, in <module> html = urllib2.urlopen(url) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 154, in urlopen return opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 437, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 550, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 475, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 409, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 558, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 404: Not Found

Statistics

Total run time: about 1 month

Total cpu time used: 2 minutes

Total disk space used: 23.3 KB

History

Auto ran revision 14d3d70b and failed 2017-01-17.

run time 41 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2017-01-16.

run time 50 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2017-01-15.

run time about 1 month
Auto ran revision 14d3d70b and failed 2016-12-15.

run time 11 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-13.

run time 1 minute

nothing changed in the database

68 pages scraped
Auto ran revision 14d3d70b and failed 2016-12-12.

run time 44 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-11.

run time 43 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-10.

run time 45 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-09.

run time 53 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-08.

run time 46 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-07.

run time 44 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-06.

run time 52 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-05.

run time 49 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-04.

run time 56 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-03.

run time 49 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-02.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-12-01.

run time 56 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-11-28.

run time 52 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-11-27.

run time 54 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-11-26.

run time 47 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-25.

run time 47 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-24.

run time 1 minute

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-23.

run time 50 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-11-23.

run time 43 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-21.

run time 44 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-20.

run time 44 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-19.

run time 41 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-18.

run time 45 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-17.

run time 58 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-11-16.

run time 6 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-15.

run time 42 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-11-14.

run time 41 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-13.

run time 7 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-12.

run time 45 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-11.

run time 53 s

nothing changed in the database

2 pages scraped
Auto ran revision 14d3d70b and failed 2016-11-10.

run time 8 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-09.

run time 47 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-08.

run time 58 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-07.

run time 47 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-06.

run time 44 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-05.

run time 48 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-04.

run time 48 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-03.

run time 53 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-02.

run time 44 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-11-01.

run time 44 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-31.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-30.

run time 47 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-29.

run time 44 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-28.

run time 45 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-27.

run time 7 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-26.

run time 47 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-25.

run time 47 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-10-19.

run time 9 s

nothing changed in the database

8 pages scraped
Auto ran revision 14d3d70b and failed 2016-10-18.

run time 46 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-17.

run time 47 s

nothing changed in the database

2 pages scraped
Auto ran revision 14d3d70b and failed 2016-10-16.

run time 49 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-15.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-14.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-13.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-12.

run time 41 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-11.

run time 41 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-10.

run time 55 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-10-09.

run time 40 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-08.

run time 48 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-07.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-06.

run time 1 minute

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-05.

run time 52 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-04.

run time 45 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-02.

run time 40 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-02.

run time 7 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-10-01.

run time 45 s

nothing changed in the database

7933 pages scraped
Auto ran revision 14d3d70b and failed 2016-09-30.

run time 40 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-29.

run time 51 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-28.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-27.

run time 6 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-26.

run time 7 s

nothing changed in the database

24 pages scraped
Auto ran revision 14d3d70b and failed 2016-09-25.

run time 41 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-24.

run time 5 s

nothing changed in the database

228 pages scraped
Auto ran revision 14d3d70b and failed 2016-09-23.

run time 6 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-22.

run time 40 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-21.

run time 44 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-20.

run time 47 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-19.

run time 40 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-18.

run time 49 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-17.

run time 6 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-16.

run time 7 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-15.

run time 39 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-14.

run time 41 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-13.

run time 39 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-12.

run time 41 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-11.

run time 1 minute

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-10.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-09.

run time 41 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-08.

run time 46 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-07.

run time 53 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-09-06.

run time 6 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-05.

run time 3 minutes

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-04.

run time 3 minutes

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-03.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-02.

run time 48 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-09-01.

run time 48 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-31.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-30.

run time 45 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-29.

run time 7 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-28.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-27.

run time 42 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-26.

run time 1 minute

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-08-25.

run time 60 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-24.

run time 2 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-08-23.

run time 2 minutes

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-22.

run time 1 minute

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-21.

run time 1 minute

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-08-20.

run time 49 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-19.

run time 1 minute

nothing changed in the database
Auto ran revision 14d3d70b and failed 2016-08-18.

run time 1 minute

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-17.

run time 6 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-16.

run time 58 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-15.

run time 46 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-14.

run time 51 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-13.

run time 2 minutes

nothing changed in the database

11 pages scraped
Auto ran revision 14d3d70b and failed 2016-08-12.

run time 55 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-11.

run time 54 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-08-10.

run time 2 minutes

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-01-04.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-01-03.

run time 28 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-01-02.

run time 25 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2016-01-01.

run time 27 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-31.

run time 28 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-30.

run time 45 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-29.

run time 46 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-28.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-27.

run time 25 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-26.

run time 25 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-25.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-24.

run time 25 s

nothing changed in the database

66 pages scraped
Auto ran revision 14d3d70b and failed 2015-12-23.

run time 23 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-22.

run time 58 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-21.

run time 19 s

nothing changed in the database

2 pages scraped
Auto ran revision 14d3d70b and failed 2015-12-20.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-19.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-18.

run time 7 minutes

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-17.

run time 24 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-16.

run time 26 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-15.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-14.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-13.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-11.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-11.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-11.

run time 1 minute

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-09.

run time 23 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-08.

run time 47 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-07.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-05.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-05.

run time 19 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-04.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-03.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-02.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-12-01.

run time 7 minutes

nothing changed in the database

2 pages scraped
Auto ran revision 14d3d70b and failed 2015-11-30.

run time about 1 hour

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-29.

run time 23 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-28.

run time 1 minute

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-27.

run time 60 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-26.

run time 26 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-25.

run time 24 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-24.

run time 52 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-23.

run time 27 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-22.

run time 30 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-21.

run time 33 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-20.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-19.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-18.

run time 27 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-17.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-16.

run time 26 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-15.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-14.

run time 45 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-13.

run time 26 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-12.

run time 57 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-11.

run time 4 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-11-10.

run time 29 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-09.

run time 26 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-08.

run time 23 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-07.

run time 27 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-06.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-04.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-04.

run time 21 s

nothing changed in the database

3 pages scraped
Auto ran revision 14d3d70b and failed 2015-11-03.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-11-02.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-31.

run time 5 minutes

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-31.

run time 7 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-10-30.

run time 7 minutes

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-30.

run time 8 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-10-28.

run time 9 minutes

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-27.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-26.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-24.

run time 17 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-24.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-23.

run time 19 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-22.

run time 25 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-21.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-20.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-19.

run time 15 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-18.

run time 30 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-17.

run time 25 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-16.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-15.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-14.

run time 28 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-13.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-12.

run time 24 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-11.

run time 26 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-10.

run time 28 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-09.

run time 3 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-10-08.

run time 43 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-07.

run time 1 minute

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-06.

run time 23 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-05.

run time 4 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-10-04.

run time 33 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-03.

run time 57 s

nothing changed in the database

2 pages scraped
Auto ran revision 14d3d70b and failed 2015-10-03.

run time 29 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-10-01.

run time 3 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-09-30.

run time 1 minute

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-29.

run time 30 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-28.

run time 57 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-27.

run time 30 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-26.

run time 55 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-25.

run time 39 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-24.

run time 40 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-23.

run time 2 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-09-22.

run time 39 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-21.

run time 16 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-20.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-19.

run time 14 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-18.

run time 13 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-17.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-16.

run time 38 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-16.

run time 31 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-14.

run time 17 s

nothing changed in the database

2 pages scraped
Auto ran revision 14d3d70b and failed 2015-09-13.

run time 3 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-09-12.

run time 17 s

nothing changed in the database

7 pages scraped
Auto ran revision 14d3d70b and failed 2015-09-11.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-10.

run time 15 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-09.

run time 15 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-08.

run time 17 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-07.

run time 17 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-06.

run time 17 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-05.

run time 24 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-04.

run time 16 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-03.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-02.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-09-01.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-31.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-30.

run time 15 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-29.

run time 17 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-28.

run time 15 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-27.

run time 17 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-26.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-25.

run time 15 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-24.

run time 16 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-23.

run time 17 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-22.

run time 26 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-21.

run time 43 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-20.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-19.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-18.

run time 26 s

nothing changed in the database

2 pages scraped
Auto ran revision 14d3d70b and failed 2015-08-18.

run time 23 minutes

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-16.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-15.

run time 27 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-14.

run time 28 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-13.

run time 33 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-12.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-11.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-10.

run time 23 s

nothing changed in the database

2 pages scraped
Auto ran revision 14d3d70b and failed 2015-08-09.

run time 29 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-08.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-07.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-06.

run time 23 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-05.

run time 22 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-04.

run time 23 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-08-03.

run time 21 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-08-02.

run time 37 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-08-01.

run time 21 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-07-31.

run time 19 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-07-30.

run time 20 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-07-29.

run time 21 s

nothing changed in the database

2 pages scraped
Auto ran revision 14d3d70b and failed 2015-07-28.

run time 21 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-07-27.

run time 20 s

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-07-26.

run time 23 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-25.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-24.

run time 29 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-23.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-22.

run time 46 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-21.

run time 23 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-20.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-19.

run time 17 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-18.

run time 15 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-17.

run time 18 s

nothing changed in the database

12 pages scraped
Auto ran revision 14d3d70b and failed 2015-07-16.

run time 16 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-15.

run time 16 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-14.

run time 43 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-13.

run time 20 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-12.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-11.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-10.

run time 18 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-09.

run time 16 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-08.

run time 17 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-07.

run time 16 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-06.

run time 28 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-05.

run time 19 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-04.

run time 4 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-07-03.

run time 21 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-02.

run time 45 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-07-01.

run time 31 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-06-30.

run time 19 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-06-29.

run time 3 minutes

nothing changed in the database
Auto ran revision 14d3d70b and failed 2015-06-28.

run time 17 s

nothing changed in the database

1 page scraped
Auto ran revision 14d3d70b and failed 2015-06-27.

run time 27 s

nothing changed in the database

1 page scraped
Created on morph.io 2015-06-08

Scraper code

Python

sp_E3520_SCC_gov / scraper.py

git clone URL