abid-ali / tutorial-1

How to Write a Screen Scraper: 1

Scrapes scraperwiki.com

ScraperWiki


Contributors abid-ali

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Hello 0 Hello 1 Hello 2 Hello 3 Hello 4 Hello 5 Hello 6 Hello 7 Hello 8 Hello 9 Hello 10 Hello 11 Hello 12 Hello 13 Hello 14 Hello 15 Hello 16 Hello 17 Hello 18 Hello 19 Traceback (most recent call last): File "scraper.py", line 27, in <module> html = scraperwiki.scrape('https://scraperwiki.com/hello_world.html') File "/app/.heroku/src/scraperwiki/scraperwiki/utils.py", line 31, in scrape f = urllib2.urlopen(req) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 448, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 531, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 404: Not Found

Statistics

Average successful run time: less than 5 seconds

Total run time: less than 10 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 20.7 KB

History

  • Manually ran revision fd1e8668 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision fd1e8668 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 434a6964 and completed successfully .
    nothing changed in the database
  • Manually ran revision e285c4e1 and completed successfully .
    nothing changed in the database
  • Manually ran revision e285c4e1 and completed successfully .
    nothing changed in the database
  • Created on morph.io

Scraper code

tutorial-1