tmtmtmtm / bermuda_parliament

Bermudan MPs


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/combine_popolo_memberships.git  Fetching https://github.com/everypolitician/scraped.git  Fetching https://github.com/everypolitician/scraped_page_archive.git  Fetching https://github.com/everypolitician/scraper_test.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/table_unspanner.git  Fetching rake 12.0.0  Fetching public_suffix 2.0.5  Fetching ast 2.3.0  Installing ast 2.3.0  Installing public_suffix 2.0.5  Installing rake 12.0.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Using combine_popolo_memberships 0.2.0 from https://github.com/everypolitician/combine_popolo_memberships.git (at master@5769841)  Fetching safe_yaml 1.0.4  Fetching unf_ext 0.0.7.4  Installing safe_yaml 1.0.4  Installing coderay 1.1.1  Fetching execjs 2.7.0  Fetching field_serializer 0.3.0  Installing unf_ext 0.0.7.4 with native extensions  Installing execjs 2.7.0  Fetching git 1.3.0  Installing field_serializer 0.3.0  Fetching hashdiff 0.3.4  Installing git 1.3.0  Installing hashdiff 0.3.4  Fetching httpclient 2.8.3  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing httpclient 2.8.3  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.2.0  Installing mini_portile2 2.2.0  Fetching minitest 5.10.3  Fetching vcr 3.0.3  Installing minitest 5.10.3  Installing vcr 3.0.3  Fetching netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing netrc 0.11.0  Fetching parallel 1.12.0  Installing parallel 1.12.0  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Installing open-uri-cached 0.0.5  Fetching slop 3.6.0  Fetching require_all 1.4.0  Installing require_all 1.4.0  Fetching ruby-progressbar 1.8.1  Installing slop 3.6.0  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing unicode-display_width 1.3.0  Installing sqlite3 1.3.13 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching addressable 2.5.1  Installing addressable 2.5.1  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching crack 0.4.3  Installing crack 0.4.3  Fetching nokogiri 1.8.0  Installing nokogiri 1.8.0 with native extensions  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching minispec-metadata 2.0.0  Installing minispec-metadata 2.0.0  Fetching minitest-around 0.4.0  Installing minitest-around 0.4.0  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching webmock 2.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Installing webmock 2.0.3  Fetching minitest-vcr 1.4.0  Fetching rubocop 0.49.1  Installing minitest-vcr 1.4.0  Installing rubocop 0.49.1  Fetching domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing domain_name 0.5.20170404  Fetching vcr-archive 0.3.0  Installing vcr-archive 0.3.0  Using scraper_test 0.1.0 from https://github.com/everypolitician/scraper_test.git (at master@9b4326c)  Fetching http-cookie 1.0.3  Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@3b67c31)  Installing http-cookie 1.0.3  Using scraped 0.6.2 from https://github.com/everypolitician/scraped.git (at master@58c88c1)  Using table_unspanner 0.1.0 from https://github.com/everypolitician/table_unspanner.git (at master@a70a98a)  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Bundle complete! 18 Gemfile dependencies, 50 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Bundle completed (65.36s)  Cleaning up the bundler cache. -----> Installing node-v6.11.1-linux-x64 -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Added 36

Data

Downloaded 608 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (19 KB) Use the API

rows 1 / 1

id name start_date
2012
2012–
2012-12-17

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (19 KB) Use the API

rows 10 / 36

id name honorific_prefix area area_id party_id party executive source email image term
Renee_Ming_MP
Renee Ming
St. George's North
01
PLP
PLP
rming@parliament.bm
2017
Kim_Swan_
Kim Swan
St. George's West
02
PLP
PLP
kswan@parliament.bm
2017
Lavita_Foggo
Lovitta Foggo
St. David's
03
PLP
PLP
Minister of Government Reform
lfoggo@parliament.bm
2017
Tinee_Furbert_MP
Tinee Furbert
St. George's South
04
PLP
PLP
Junior Minister of Disability Affairs
tfurbert@parliament.bm
2017
Derrick_Burgess
Derrick Burgess
Hamilton East
05
PLP
PLP
Deputy Speaker of the House of Assembly
dburgess@parliament.bm
2017
Wayne_Furbert
Wayne Furbert
Hamilton West
06
PLP
PLP
Junior Minister of Finance
wfurbert@parliament.bm
2017
Sylvan_Richards_
Sylvan Richards Jr.
Hamilton South
07
OBA
OBA
srichards@parliament.bm
2017
Cole_Simons
N. Cole Simons
Smiths South
08
OBA
OBA
Shadow Minister of Education
nsimons@parliament.bm
2017
Trevor_Moniz
Trevor Moniz
Smiths West
09
OBA
OBA
Shadow Attorney General
tmoniz@parliament.bm
2017
Mr._Michael_Dunkle
Michael Dunkley
Smiths North
10
OBA
OBA
mdunkley@parliament.bm
2017

Statistics

Average successful run time: 4 minutes

Total run time: 4 days

Total cpu time used: about 4 hours

Total disk space used: 7 MB

History

  • Auto ran revision 1f265855 and completed successfully .
    nothing changed in the database
  • Auto ran revision 1f265855 and completed successfully .
    nothing changed in the database
    142 pages scraped
  • Auto ran revision 1f265855 and completed successfully .
    nothing changed in the database
    142 pages scraped
  • Auto ran revision 1f265855 and completed successfully .
    nothing changed in the database
    142 pages scraped
  • Auto ran revision 1f265855 and completed successfully .
    nothing changed in the database
    142 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

bermuda_parliament / scraper.rb