This is a scraper that runs on Morph. To get started see the documentation

Contributors woodbine blablupcom

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 93, in <module> html = urllib2.urlopen(url) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 442, in error result = self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 629, in http_error_302 return self.parent.open(new, timeout=req.timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 442, in error result = self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 629, in http_error_302 return self.parent.open(new, timeout=req.timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 448, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 531, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 400: Bad request

Data

Downloaded 812 times by SimKennedy MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (22 KB) Use the API

rows 10 / 79

d l f
2016-02-16 09:08:16.612355
WAG090_WAG_gov_2015_12
2016-06-13 10:24:33.153413
WAG090_WAG_gov_2016_01
2016-06-13 10:24:33.451345
WAG090_WAG_gov_2015_12
2016-06-13 10:24:33.754055
WAG090_WAG_gov_2015_10
2016-06-13 10:24:34.057250
WAG090_WAG_gov_2015_11
2016-06-13 10:24:34.378284
WAG090_WAG_gov_2015_09
2016-06-13 10:24:34.691596
WAG090_WAG_gov_2015_08
2016-06-13 10:24:34.997427
WAG090_WAG_gov_2015_07
2016-06-13 10:24:35.304455
WAG090_WAG_gov_2015_06
2016-06-13 10:24:35.610626
WAG090_WAG_gov_2015_05

Statistics

Average successful run time: 2 minutes

Total run time: 10 days

Total cpu time used: about 1 hour

Total disk space used: 53.2 KB

History

  • Auto ran revision 5edf5893 and failed .
    nothing changed in the database
  • Auto ran revision 5edf5893 and failed .
    nothing changed in the database
  • Auto ran revision 5edf5893 and failed .
    nothing changed in the database
  • Auto ran revision 5edf5893 and failed .
    nothing changed in the database
  • Auto ran revision 5edf5893 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

sp_WAG090_WAG_gov / scraper.py