henare / federal_travel_expenses

Scrapes www.finance.gov.au

Department of Finance


Contributors henare nickjevershed

Last run failed with status code 1.

Console output of last run

Step 0 : FROM 1b501021f695589d50ad7c51fd32ebadcae3fb3ab22cbcbe61b87de9a0dcbe37 ---> 1b501021f695 Step 1 : ADD code_config.tar /app ---> Using cache ---> 7ed4abfbaae2 Step 2 : ENV CURL_TIMEOUT 180 ---> Using cache ---> 89fd9fc3f671 Step 3 : RUN /build/builder ---> Using cache ---> 6cee9b24db4a Successfully built 6cee9b24db4a Step 0 : FROM 6cee9b24db4a ---> 6cee9b24db4a Step 1 : ADD code.tar /app ---> db620c64ce4b Removing intermediate container 074d84ea138b Successfully built db620c64ce4b Traceback (most recent call last): File "scraper.py", line 9, in <module> pdfdata = urllib2.urlopen(url).read() File "/app/.heroku/python/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 448, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 531, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError : HTTP Error 404: Not Found

Statistics

Total run time: less than a minute

Total cpu time used: less than 5 seconds

Total disk space used: 48.5 KB

History

  • Manually ran revision 456e95f5 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 456e95f5 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 456e95f5 and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

federal_travel_expenses / scraper.py