everypolitician-scrapers / canada-politwitter

Scrapes politwitter.ca

A Canadian non-partisan political twitter & social media aggregator & directory. Making it easy to connect elected MPs & MLAs with the Canadian people.


Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 506 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (65 KB) Use the API

rows 10 / 343

id name twitter area source facebook youtube
TerenceYoungMP
Terence Young
@TerenceYoungMP
Oakville
JustinTrudeau
Justin Trudeau
@JustinTrudeau
Papineau
pmharper
Stephen Harper
@pmharper
La Peltrie
ElizabethMay
Elizabeth May
@ElizabethMay
Saanich—Gulf Islan
DenisCoderre
Denis Coderre
@DenisCoderre
Laval-des-Rapides
ThomasMulcair
Thomas Mulcair
@ThomasMulcair
Outremont
TonyclementCPC
Tony Clement
@TonyclementCPC
Parry Sound—Muskok
MarcGarneau
Marc Garneau
@MarcGarneau
Westmount—Ville-Ma
Carolyn_Bennett
Carolyn Bennett
@Carolyn_Bennett
St. Paul's
brownbarrie
Patrick Brown
@brownbarrie
Okanagan—Coquihall

Statistics

Average successful run time: half a minute

Total run time: about 1 hour

Total cpu time used: 3 minutes

Total disk space used: 104 KB

History

  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    4 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    90 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    8 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 341 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran and failed .
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    4 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    4 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    5 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    4 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    4 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    91 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    93 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    4 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and failed .
    nothing changed in the database
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
    1172 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    10 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    20 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    65 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    nothing changed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
    3 pages scraped
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Auto ran revision 28299833 and completed successfully .
    342 records added, 342 records removed in the database
  • Manually ran revision 28299833 and completed successfully .
    342 records added in the database
  • Manually ran revision 4d97c0c5 and completed successfully .
    253 records added in the database
  • Created on morph.io

Scraper code

Ruby

canada-politwitter / scraper.rb