everypolitician-scrapers / netherlands

Fetch members of the Netherlands's Parliament

Scrapes www.houseofrepresentatives.nl

Home | House of Representatives


This is a scraper that runs on Morph. To get started see the documentation

Contributors struan tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching httpclient 2.8.3  Fetching mini_portile2 2.3.0  Fetching sqlite3 1.3.13  Installing mini_portile2 2.3.0  Installing sqlite3 1.3.13 with native extensions  Fetching nokogiri 1.8.4  Installing httpclient 2.8.3  Installing nokogiri 1.8.4 with native extensions  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 2 Gemfile dependencies, 7 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (16.49s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 1 time by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (89 KB) Use the API

rows 10 / 150

id faction_id faction gender img source name sort_name family_name given_name email dob website
aalst-rr-van-pvv
PVV
Party for Freedom
male
Roy R van Aalst
Aalst, R.R. van
Aalst
Roy
r.vaalst@tweedekamer.nl
1983-03-28
aartsen-aa-vvd
VVD
People's Party for Freedom and Democracy
male
Thierry A Aartsen
Aartsen, A.A.
Aartsen
Thierry
1989-12-19
agema-m-pvv
PVV
Party for Freedom
female
Fleur Agema
Agema, M.
Agema
Fleur
m.agema@tweedekamer.nl
1976-09-16
alkaya-m%C3%B6-sp
SP
Socialist Party
male
Mahir Ö Alkaya
Alkaya, M.Ö.
Alkaya
Mahir
m.alkaya@tweedekamer.nl
1988-07-06
amhaouch-m-cda
CDA
CDA
male
Mustafa Amhaouch
Amhaouch, M.
Amhaouch
Mustafa
m.amhaouch@tweedekamer.nl
1970-06-27
arib-k-pvda
PvdA
Labour Party
female
Khadija Arib
Arib, K.
Arib
Khadija
k.arib@tweedekamer.nl
1960-10-10
asscher-lf-pvda
PvdA
Labour Party
male
Lodewijk F Asscher
Asscher, L.F.
Asscher
Lodewijk
l.asscher@tweedekamer.nl
1974-09-27
azarkan-f-denk
DENK
DENK
male
Farid Azarkan
Azarkan, F.
Azarkan
Farid
f.azarkan@tweedekamer.nl
1971-10-16
azmani-m-vvd
VVD
People's Party for Freedom and Democracy
male
Malik Azmani
Azmani, M.
Azmani
Malik
m.azmani@tweedekamer.nl
1976-01-20
baudet-thp-fvd
FvD
FvD
male
Thierry H P Baudet
Baudet, T.H.P.
Baudet
Thierry
t.baudet@tweedekamer.nl
1983-01-28

Statistics

Average successful run time: 40 minutes

Total run time: about 8 hours

Total cpu time used: about 6 hours

Total disk space used: 98.5 MB

History

  • Manually ran revision e6f67e1d and completed successfully .
    150 records added, 150 records removed in the database
    151 pages scraped
  • Auto ran revision 1560d35f and failed .
    nothing changed in the database
  • Auto ran revision 1560d35f and failed .
    90 records added, 90 records removed in the database
  • Auto ran revision 1560d35f and completed successfully .
    150 records added, 150 records removed in the database
  • Auto ran revision 1560d35f and completed successfully .
    150 records added, 150 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

netherlands / scraper.rb