chuenll / GoogleNews_Scraper

Comparative News

Scrapes news.google.com

Comprehensive up-to-date news coverage, aggregated from sources all over the world by Google News.


This is a scraper that runs on Morph. To get started see the documentation

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... [ <DOM Element: link at 0x7f1f25c1bf38>, <DOM Element: link at 0x7f1f25c255a8>, <DOM Element: link at 0x7f1f25c25bd8>, <DOM Element: link at 0x7f1f25c2c248>, <DOM Element: link at 0x7f1f25c2c878>, <DOM Element: link at 0x7f1f25c2cea8>, <DOM Element: link at 0x7f1f25c32518>, <DOM Element: link at 0x7f1f25c32b48>, <DOM Element: link at 0x7f1f25c381b8>, <DOM Element: link at 0x7f1f25c387e8>] 1: Top Syrian rebel commander killed in airstrike near Damascus - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ 2: Russia faces growing accusations of civilian killings in Syria - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ 3: Hezbollah buries prominent militant, says Israel will be held accountable - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ 4: After Paris, Beirut attacks Facebook will add Safety Check to 'human disasters' - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ 5: Beirut bombings kindle flames of conflict in Lebanon - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ 6: The nation that invented social media can't outsmart Islamic State - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ Traceback (most recent call last): File "scraper.py", line 21, in <module> print '%d: %s' % (i+1,e,) UnicodeEncodeError: 'ascii' codec can't encode character u'\xa2' in position 44: ordinal not in range(128)

Statistics

Average successful run time: less than 20 seconds

Total run time: 6 days

Total cpu time used: less than 20 seconds

Total disk space used: 32.6 KB

History

  • Manually ran revision 404c8fe3 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 404c8fe3 and failed .
    nothing changed in the database
  • Manually ran revision efd8dbb0 and failed .
    nothing changed in the database
  • Manually ran revision 266ad04b and failed .
    nothing changed in the database
  • Manually ran revision 40ed9639 and failed .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

GoogleNews_Scraper / scraper.py