This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm mashedkeyboard

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.6.0 -----> Installing dependencies using bundler version 1.17.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/..........  Fetching https://github.com/everypolitician/combine_popolo_memberships.git  Fetching https://github.com/everypolitician/scraped.git  Fetching https://github.com/everypolitician/scraped_page_archive.git  Fetching https://github.com/everypolitician/scraper_test.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/table_unspanner.git  Using bundler 1.17.2  Fetching coderay 1.1.3  Fetching public_suffix 4.0.6  Using combine_popolo_memberships 0.2.0 from https://github.com/everypolitician/combine_popolo_memberships.git (at master@5769841)  Fetching rexml 3.2.5  Installing coderay 1.1.3  Installing rexml 3.2.5  Installing public_suffix 4.0.6  Fetching field_serializer 0.3.0  Fetching git 1.3.0  Installing field_serializer 0.3.0  Installing git 1.3.0  Fetching hashdiff 1.0.1  Installing hashdiff 1.0.1  Fetching httpclient 2.8.3  Fetching method_source 1.0.0  Installing method_source 1.0.0  Installing httpclient 2.8.3  Fetching mini_portile2 2.7.1  Installing mini_portile2 2.7.1  Fetching minitest 5.15.0  Installing minitest 5.15.0  Fetching racc 1.6.0  Fetching require_all 3.0.0  Installing racc 1.6.0 with native extensions  Installing require_all 3.0.0  Fetching vcr 3.0.3  Installing vcr 3.0.3  Fetching sqlite3 1.4.2  Installing sqlite3 1.4.2 with native extensions  Fetching addressable 2.8.0  Installing addressable 2.8.0  Fetching crack 0.4.5  Installing crack 0.4.5  Fetching pry 0.14.1  Installing pry 0.14.1  Fetching webmock 2.0.3  Installing webmock 2.0.3  Fetching vcr-archive 0.3.0  Installing vcr-archive 0.3.0  Using scraper_test 0.1.0 from https://github.com/everypolitician/scraper_test.git (at master@9b4326c)  Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@a998412)  Fetching nokogiri 1.13.0 (x86_64-linux)  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing nokogiri 1.13.0 (x86_64-linux)  Using scraped 0.6.2 from https://github.com/everypolitician/scraped.git (at master@7fd4391)  Using table_unspanner 0.1.1 from https://github.com/everypolitician/table_unspanner.git (at master@238e7f9)  Bundle complete! 8 Gemfile dependencies, 28 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into `./vendor/bundle`  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Removing bundler (1.15.2)  Bundle completed (15.84s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 410 times by loudspeek-bot mashedkeyboard pysak tomgoodthings asiamemo

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (176 KB) Use the API

rows 10 / 648

id name sort_name birth_date death_date gender party party_id constituency email phone fax website twitter facebook blog youtube flickr identifier__dods identifier__pims
172
Ms Diane Abbott
Abbott, Ms Diane
female
Labour
15
Hackney North and Stoke Newington
diane.abbott.office@parliament.uk
020 7219 4426
25790
3572
4212
Debbie Abrahams
Abrahams, Debbie
female
Labour
15
Oldham East and Saddleworth
abrahamsd@parliament.uk
020 7219 1041 Fax: 0207 219 2405
80556
5905
4057
Nigel Adams
Adams, Nigel
male
Conservative
4
Selby and Ainsty
nigel.adams.mp@parliament.uk
020 7219 7141
35435
5556
4639
Bim Afolami
Afolami, Bim
male
Conservative
4
Hitchin and Harpenden
bim.afolami.mp@parliament.uk
133811
6196
1586
Adam Afriyie
Afriyie, Adam
male
Conservative
4
Windsor
adam.afriyie.mp@parliament.uk
020 7219 8023
35516
4734
4741
Nickie Aiken
Aiken, Nickie
female
Conservative
4
Cities of London and Westminster
nickie.aiken.mp@parliament.uk
020 7219 4553
6285
4069
Peter Aldous
Aldous, Peter
male
Conservative
4
Waveney
peter.aldous.mp@parliament.uk
020 7219 7182
35512
5560
4138
Rushanara Ali
Ali, Rushanara
female
Labour
15
Bethnal Green and Bow
rushanara.ali.mp@parliament.uk
020 7219 7200
58561
5735
4747
Tahir Ali
Ali, Tahir
male
Labour
15
Birmingham, Hall Green
tahir.ali.mp@parliament.uk
020 7219 3000
6286
4411
Lucy Allan
Allan, Lucy
female
Conservative
4
Telford
lucy.allan.mp@parliament.uk
020 7219 4815
105910
6012

Statistics

Average successful run time: 1 minute

Total run time: about 17 hours

Total cpu time used: 23 minutes

Total disk space used: 226 KB

History

  • Auto ran revision 55f449eb and completed successfully .
    nothing changed in the database
  • Auto ran revision 55f449eb and completed successfully .
    nothing changed in the database
  • Auto ran revision 55f449eb and completed successfully .
    nothing changed in the database
  • Auto ran revision 55f449eb and completed successfully .
    1 record updated in the database
  • Auto ran revision 55f449eb and completed successfully .
    1 record updated in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

uk-parliament-members / scraper.rb