BrianOB / google_news_scrape_1

google news scrape

Scrapes news.google.com

Comprehensive up-to-date news coverage, aggregated from sources all over the world by Google News.


Contributors BrianOB

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... (u'This RSS feed URL is deprecated', ' ', u'https://news.google.com/news') (u'In its third year, Coda.Br conference democratizes discussion on data journalism in Brazil - Knight Center for Journalism in the Americas (blog)', ' ', u'http://news.google.com/news/url?sa=t&fd=R&ct2=us&usg=AFQjCNE-XdTOnuw_AKrEc6c3tgAFeMThSQ&clid=c3a7d30bb8a4878e06b80cf16b898331&ei=0ZD0W_jSAc2YhQHExIrYDg&url=https://knightcenter.utexas.edu/blog/00-20330-it%25E2%2580%2599s-third-year-codabr-conference-democratizes-discussion-data-journalism-brazil') (u'The needle and the damage done: Another election night ruined by garbage \u201cdata journalism\u201d - Salon', ' ', u'http://news.google.com/news/url?sa=t&fd=R&ct2=us&usg=AFQjCNGV5-4HXOrk-x7vbeXYsYJrpEAEsQ&clid=c3a7d30bb8a4878e06b80cf16b898331&ei=0ZD0W_jSAc2YhQHExIrYDg&url=https://www.salon.com/2018/11/12/the-needle-and-the-damage-done-another-election-night-fueled-by-garbage-data-journalism/') (u"The Economist's print edition launches a dedicated data journalism page for better visual storytelling - Journalism.co.uk", ' ', u'http://news.google.com/news/url?sa=t&fd=R&ct2=us&usg=AFQjCNEfBV7U_a1A4qzmv9nMPmlzce7XjA&clid=c3a7d30bb8a4878e06b80cf16b898331&ei=0ZD0W_jSAc2YhQHExIrYDg&url=https://www.journalism.co.uk/news/the-economist-s-print-edition-launches-a-dedicated-data-journalism-page-for-better-visual-storytelling/s2/a729384/') (u'Follow the Data? Investigative Journalism in the Age of Algorithms - Singularity Hub', ' ', u'http://news.google.com/news/url?sa=t&fd=R&ct2=us&usg=AFQjCNHYTgKsbxd-tsFMyjyIdexi9bP4YA&clid=c3a7d30bb8a4878e06b80cf16b898331&ei=0ZD0W_jSAc2YhQHExIrYDg&url=https://singularityhub.com/2018/11/18/follow-the-data-investigative-journalism-in-the-age-of-algorithms/') (u'Quartz forms Quartz AI Studio with $250k grant from Knight Foundation - Digiday', ' ', u'http://news.google.com/news/url?sa=t&fd=R&ct2=us&usg=AFQjCNFNtIjlNstmaFMXAnn-h6OWeEMoBg&clid=c3a7d30bb8a4878e06b80cf16b898331&ei=0ZD0W_jSAc2YhQHExIrYDg&url=https://digiday.com/media/quartz-forms-quartz-ai-studio/') (u'Fact-checking and data journalism: register now for our free online course with Laura Zommer - Knight Center for Journalism in the Americas', ' ', u'http://news.google.com/news/url?sa=t&fd=R&ct2=us&usg=AFQjCNFmJEtFS0Aqvjo6_yK6PQ_aMqIFOQ&clid=c3a7d30bb8a4878e06b80cf16b898331&ei=0ZD0W_jSAc2YhQHExIrYDg&url=https://knightcenter.utexas.edu/00-20306-fact-checking-and-data-journalism-register-now-our-free-online-course-laura-zommer') (u'Registration open for third edition of Coda.Br, Brazilian conference on data journalism - Knight Center for Journalism in the Americas (blog)', ' ', u'http://news.google.com/news/url?sa=t&fd=R&ct2=us&usg=AFQjCNHiruC6x-jYVw61j8XMpZKFPkeFJQ&clid=c3a7d30bb8a4878e06b80cf16b898331&ei=0ZD0W_jSAc2YhQHExIrYDg&url=https://knightcenter.utexas.edu/blog/00-20282-registration-open-third-edition-codabr-brazilian-conference-data-journalism') (u"Q and A: Matt Carroll on 'Spotlight' the movie, future of data journalism - Rappler", ' ', u'http://news.google.com/news/url?sa=t&fd=R&ct2=us&usg=AFQjCNGAqsACmDGxTFSs2aWPfxga5MaWnw&clid=c3a7d30bb8a4878e06b80cf16b898331&ei=0ZD0W_jSAc2YhQHExIrYDg&url=https://www.rappler.com/life-and-style/216430-question-and-answer-matt-carroll-spotlight-movie-future-data-journalism') (u'Data journalist - Journalism.co.uk', ' ', u'http://news.google.com/news/url?sa=t&fd=R&ct2=us&usg=AFQjCNHD6twa5-JQ-rameLS8LlxTkSp-3A&clid=c3a7d30bb8a4878e06b80cf16b898331&ei=0ZD0W_jSAc2YhQHExIrYDg&url=https://www.journalism.co.uk/media-jobs/data-journalist/s75/a730406/')

Statistics

Average successful run time: less than 5 seconds

Total run time: less than 20 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 23.2 KB

History

  • Manually ran revision c58d1382 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision fe3ddfda and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision f4945df0 and failed .
    nothing changed in the database
    2 pages scraped
  • Created on morph.io

Scraper code

google_news_scrape_1