chuenll / GoogleNews_Scraper

Comparative News

Scrapes news.google.com

Comprehensive up-to-date news coverage, aggregated from sources all over the world by Google News.


This is a scraper that runs on Morph. To get started see the documentation

Contributors chuenll

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... [ <DOM Element: link at 0x7f1f25c1bf38>, <DOM Element: link at 0x7f1f25c255a8>, <DOM Element: link at 0x7f1f25c25bd8>, <DOM Element: link at 0x7f1f25c2c248>, <DOM Element: link at 0x7f1f25c2c878>, <DOM Element: link at 0x7f1f25c2cea8>, <DOM Element: link at 0x7f1f25c32518>, <DOM Element: link at 0x7f1f25c32b48>, <DOM Element: link at 0x7f1f25c381b8>, <DOM Element: link at 0x7f1f25c387e8>] 1: Top Syrian rebel commander killed in airstrike near Damascus - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ 2: Russia faces growing accusations of civilian killings in Syria - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ 3: Hezbollah buries prominent militant, says Israel will be held accountable - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ 4: After Paris, Beirut attacks Facebook will add Safety Check to 'human disasters' - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ 5: Beirut bombings kindle flames of conflict in Lebanon - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ 6: The nation that invented social media can't outsmart Islamic State - The Globe and Mail -> http://www.theglobeandmail.com/news/politics/paris-attacks-a-game-changer-for-security-in-the-west-nato-official-says/article27387068/ Traceback (most recent call last): File "scraper.py", line 21, in <module> print '%d: %s' % (i+1,e,) UnicodeEncodeError: 'ascii' codec can't encode character u'\xa2' in position 44: ordinal not in range(128)

Statistics

Average successful run time: less than 20 seconds

Total run time: 6 days

Total cpu time used: less than 20 seconds

Total disk space used: 60.9 KB

History

  • Manually ran revision 404c8fe3 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 404c8fe3 and failed .
    nothing changed in the database
  • Manually ran revision efd8dbb0 and failed .
    nothing changed in the database
  • Manually ran revision 266ad04b and failed .
    nothing changed in the database
  • Manually ran revision 40ed9639 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 0cac8372 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision ccb5417a and failed .
    nothing changed in the database
  • Manually ran revision c60e1e94 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision be7b4810 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision be7b4810 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 0ee5b86e and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 7d7590b0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 7d7590b0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision c31cb5d2 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision c31cb5d2 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision add56a03 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision d9a75f57 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision a41f2225 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision d690669c and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision cf3947a5 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision cf3947a5 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision c6dc1dd7 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision a4fe0ca5 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision d82ca03e and failed .
    nothing changed in the database
  • Manually ran revision 95ec64bc and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 6f7dbc3e and failed .
    nothing changed in the database
  • Manually ran revision 6dec49aa and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 6dec49aa and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 646c6cf0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision b31fc139 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision eca6db80 and failed .
    nothing changed in the database
  • Manually ran revision 3c5b217d and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision ff54f2e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision c307c9da and completed successfully .
    nothing changed in the database
  • Manually ran revision 581adf1c and completed successfully .
    nothing changed in the database
  • Manually ran revision 581adf1c and completed successfully .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

GoogleNews_Scraper / scraper.py