mashedkeyboard / uk-parliament-members

README.md

This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm mashedkeyboard

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.6.0 [1G-----> Installing dependencies using bundler version 1.17.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Fetching gem metadata from https://rubygems.org/.......... [1G Fetching https://github.com/everypolitician/combine_popolo_memberships.git [1G Fetching https://github.com/everypolitician/scraped.git [1G Fetching https://github.com/everypolitician/scraped_page_archive.git [1G Fetching https://github.com/everypolitician/scraper_test.git [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching https://github.com/everypolitician/table_unspanner.git [1G Fetching public_suffix 4.0.6 [1G Using bundler 1.17.2 [1G Fetching coderay 1.1.3 [1G Using combine_popolo_memberships 0.2.0 from https://github.com/everypolitician/combine_popolo_memberships.git (at master@5769841) [1G Fetching rexml 3.2.5 [1G Installing coderay 1.1.3 [1G Installing public_suffix 4.0.6 [1G Installing rexml 3.2.5 [1G Fetching field_serializer 0.3.0 [1G Installing field_serializer 0.3.0 [1G Fetching git 1.3.0 [1G Fetching hashdiff 1.0.1 [1G Fetching httpclient 2.8.3 [1G Installing hashdiff 1.0.1 [1G Installing git 1.3.0 [1G Installing httpclient 2.8.3 [1G Fetching method_source 1.0.0 [1G Fetching mini_portile2 2.7.1 [1G Installing mini_portile2 2.7.1 [1G Installing method_source 1.0.0 [1G Fetching minitest 5.15.0 [1G Installing minitest 5.15.0 [1G Fetching racc 1.6.0 [1G Fetching require_all 3.0.0 [1G Installing require_all 3.0.0 [1G Installing racc 1.6.0 with native extensions [1G Fetching vcr 3.0.3 [1G Installing vcr 3.0.3 [1G Fetching sqlite3 1.4.2 [1G Installing sqlite3 1.4.2 with native extensions [1G Fetching addressable 2.8.0 [1G Installing addressable 2.8.0 [1G Fetching crack 0.4.5 [1G Installing crack 0.4.5 [1G Fetching pry 0.14.1 [1G Installing pry 0.14.1 [1G Fetching webmock 2.0.3 [1G Installing webmock 2.0.3 [1G Fetching vcr-archive 0.3.0 [1G Installing vcr-archive 0.3.0 [1G Using scraper_test 0.1.0 from https://github.com/everypolitician/scraper_test.git (at master@9b4326c) [1G Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@a998412) [1G Fetching nokogiri 1.13.0 (x86_64-linux) [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Installing nokogiri 1.13.0 (x86_64-linux) [1G Using scraped 0.6.2 from https://github.com/everypolitician/scraped.git (at master@7fd4391) [1G Using table_unspanner 0.1.1 from https://github.com/everypolitician/table_unspanner.git (at master@238e7f9) [1G Bundle complete! 8 Gemfile dependencies, 28 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into `./vendor/bundle` [1G Post-install message from webmock: [1G WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu [1G Removing bundler (1.15.2) [1G Bundle completed (11.10s) [1G Cleaning up the bundler cache. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 430 times by loudspeek-bot mashedkeyboard asiamemo pysak tomgoodthings

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (176 KB) Use the API

rows 10 / 649

id name sort_name birth_date death_date gender party party_id constituency email phone fax website twitter facebook blog youtube flickr identifier__dods identifier__pims
172
Ms Diane Abbott
Abbott, Ms Diane
female
Independent
8
Hackney North and Stoke Newington
diane.abbott.office@parliament.uk
020 7219 4426
http://www.dianeabbott.org.uk
https://twitter.com/HackneyAbbott
25790
3572
4212
Debbie Abrahams
Abrahams, Debbie
female
Labour
15
Oldham East and Saddleworth
abrahamsd@parliament.uk
020 7219 1041
http://www.debbieabrahams.org.uk/
https://twitter.com/Debbie_abrahams
80556
5905
4639
Bim Afolami
Afolami, Bim
male
Conservative
4
Hitchin and Harpenden
bim.afolami.mp@parliament.uk
https://twitter.com/BimAfolami
133811
6196
1586
Adam Afriyie
Afriyie, Adam
male
Conservative
4
Windsor
adam.afriyie.mp@parliament.uk
020 7219 8023
http://www.adamafriyie.org/
https://twitter.com/AdamAfriyie
35516
4734
4741
Nickie Aiken
Aiken, Nickie
female
Conservative
4
Cities of London and Westminster
nickie.aiken.mp@parliament.uk
020 7219 4553
https://www.nickieaiken.org.uk/
https://twitter.com/twocitiesnickie
https://www.facebook.com/twocitiesnickie
126632
6285
4069
Peter Aldous
Aldous, Peter
male
Conservative
4
Waveney
peter.aldous.mp@parliament.uk
020 7219 7182
http://www.peteraldous.com/
https://twitter.com/peter_aldous
35512
5560
4138
Rushanara Ali
Ali, Rushanara
female
Labour
15
Bethnal Green and Bow
rushanara.ali.mp@parliament.uk
020 7219 7200
http://www.rushanaraali.org/
https://twitter.com/rushanaraali
58561
5735
4747
Tahir Ali
Ali, Tahir
male
Labour
15
Birmingham, Hall Green
tahir.ali.mp@parliament.uk
020 7219 3000
116885
6286
4411
Lucy Allan
Allan, Lucy
female
Conservative
4
Telford
lucy.allan.mp@parliament.uk
020 7219 1368
http://www.lucyallan.com/
https://twitter.com/lucyallan
105910
6012
4573
Dr Rosena Allin-Khan
Allin-Khan, Dr Rosena
female
Labour
15
Tooting
rosena.allinkhan.mp@parliament.uk ; rosena@drrosena.co.uk
020 3621 2509
http://www.drrosena.co.uk/
https://twitter.com/DrRosena
https://www.facebook.com/DrRosena
118489
6188

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 39 minutes

Total disk space used: 226 KB

History

  • Auto ran revision 55f449eb and completed successfully .
    1 record updated in the database
  • Auto ran revision 55f449eb and completed successfully .
    nothing changed in the database
  • Auto ran revision 55f449eb and completed successfully .
    nothing changed in the database
  • Auto ran revision 55f449eb and completed successfully .
    nothing changed in the database
  • Auto ran revision 55f449eb and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

uk-parliament-members / scraper.rb