fgregg / knight_news_challenge_popularity_scraper

Knight News Challenge Popularity Scraper Page by Page

Last run failed with status code 1.

Console output of last run

Scraping page 1 Scraping page 2 Scraping page 3 Scraping page 4 Scraping page 5 Scraping page 6 Scraping page 7 Scraping page 8 Scraping page 9 Scraping page 10 Scraping page 11 Scraping page 12 Scraping page 13 Scraping page 14 Scraping page 15 Scraping page 16 Scraping page 17 Scraping page 18 Scraping page 19 Scraping page 20 Scraping page 21 Scraping page 22 Scraping page 23 Scraping page 24 Traceback (most recent call last): File "/repo/scraper.py", line 39, in <module> entryHTML = scraperwiki.scrape(url) File "/usr/local/lib/python2.7/dist-packages/scraperwiki-0.3.7-py2.7.egg/scraperwiki/utils.py", line 31, in scrape f = urllib2.urlopen(req) File "/usr/lib/python2.7/urllib2.py", line 126, in urlopen return _opener.open(url, data, timeout) File "/usr/lib/python2.7/urllib2.py", line 406, in open response = meth(req, response) File "/usr/lib/python2.7/urllib2.py", line 519, in http_response 'http', request, response, code, msg, hdrs) File "/usr/lib/python2.7/urllib2.py", line 444, in error return self._call_chain(*args) File "/usr/lib/python2.7/urllib2.py", line 378, in _call_chain result = func(*args) File "/usr/lib/python2.7/urllib2.py", line 527, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 504: Gateway Timeout

Data

Downloaded 1 time by MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (509 KB) Use the API

rows 10 / 1185

url total likes comments title reblogs
http://newschallenge.tumblr.com/post/25579307811/poi-dough-pliable-geodata
0
0
0
POI Dough - Pliable Geodata
0
http://newschallenge.tumblr.com/post/25579292818/transforming-how-we-understand-billions-of-dollars
0
0
0
Transforming How We Understand Billions of Dollars Worth of Federal Spending Data
0
http://newschallenge.tumblr.com/post/29413096106/announcing-knight-news-challenge-mobile
33
27
0
Announcing Knight News Challenge: Mobile
6
http://newschallenge.tumblr.com/post/27551374942/an-update-on-knight-news-challenge-data
3
2
0
An update on Knight News Challenge: Data
1
http://newschallenge.tumblr.com/post/26902304878/advisers-gather-to-review-apps-in-knight-news
6
4
0
Advisers gather to review apps in Knight News Challenge: Data
2
http://newschallenge.tumblr.com/post/26351667574/policy-data
0
0
0
Policy Data
0
http://newschallenge.tumblr.com/post/26140835323/factlink
5
2
0
Factlink
3
http://newschallenge.tumblr.com/post/26069963079/ourschool
0
0
0
OurSchool
0
http://newschallenge.tumblr.com/post/26000372140/whats-in-your-thought-bubble
6
3
0
What’s In Your Thought Bubble?
3
http://newschallenge.tumblr.com/post/25998429495/senior-scam-data
0
0
0
Senior Scam Data
0

Statistics

Total run time: 4 minutes

Total cpu time used: half a minute

Total disk space used: 528 KB

History

  • Manually ran revision 7d0b0a65 and failed .
    355 records added in the database
  • Created on morph.io