tmtmtmtm / germany-bundestag-members-wikipedia

Scrapes de.wikipedia.org

Wikipedia – Die freie Enzyklopädie


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm ondenman

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/combine_popolo_memberships.git  Fetching https://github.com/everypolitician/scraped.git  Fetching https://github.com/everypolitician/scraped_page_archive.git  Fetching https://github.com/everypolitician/scraper_test.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/table_unspanner.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching https://github.com/everypolitician/wikidata_ids_decorator.git  Fetching rake 12.0.0  Fetching public_suffix 3.0.0  Fetching ast 2.3.0  Installing ast 2.3.0  Installing rake 12.0.0  Installing public_suffix 3.0.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing coderay 1.1.2  Fetching colorize 0.8.1  Using combine_popolo_memberships 0.2.0 from https://github.com/everypolitician/combine_popolo_memberships.git (at master@5769841)  Fetching safe_yaml 1.0.4  Installing colorize 0.8.1  Installing safe_yaml 1.0.4  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Fetching excon 0.59.0  Fetching execjs 2.7.0  Installing execjs 2.7.0  Fetching multipart-post 2.0.0  Installing excon 0.59.0  Installing multipart-post 2.0.0  Installing unf_ext 0.0.7.4 with native extensions  Fetching field_serializer 0.3.0  Installing field_serializer 0.3.0  Fetching git 1.3.0  Installing git 1.3.0  Fetching hashdiff 0.3.6  Installing hashdiff 0.3.6  Fetching hashie 3.5.6  Installing hashie 3.5.6  Fetching httpclient 2.8.3  Fetching json 2.1.0  Installing httpclient 2.8.3  Installing json 2.1.0 with native extensions  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.2.0  Installing mini_portile2 2.2.0  Fetching minitest 5.10.3  Installing minitest 5.10.3  Fetching vcr 3.0.3  Installing vcr 3.0.3  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.0  Installing parallel 1.12.0  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching require_all 1.4.0  Installing require_all 1.4.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching addressable 2.5.2  Installing addressable 2.5.2  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching crack 0.4.3  Installing crack 0.4.3  Fetching faraday 0.13.1  Installing faraday 0.13.1  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.0  Fetching minispec-metadata 2.0.0  Installing minispec-metadata 2.0.0  Fetching minitest-around 0.4.0  Installing minitest-around 0.4.0  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching wikisnakker 0.9.1  Installing wikisnakker 0.9.1  Fetching sqlite_magic 0.0.6  Fetching faraday_middleware 0.12.2  Installing sqlite_magic 0.0.6  Installing faraday_middleware 0.12.2  Fetching webmock 2.0.3  Fetching minitest-vcr 1.4.0  Installing webmock 2.0.3  Installing minitest-vcr 1.4.0  Fetching rubocop 0.49.1  Installing rubocop 0.49.1  Fetching domain_name 0.5.20170404  Installing domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.10  Installing wikidata-client 0.0.10  Fetching vcr-archive 0.3.0  Installing vcr-archive 0.3.0  Installing nokogiri 1.8.0 with native extensions  Using scraper_test 0.1.0 from https://github.com/everypolitician/scraper_test.git (at master@9b4326c)  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@3b67c31)  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Installing rest-client 2.0.2  Using scraped 0.6.2 from https://github.com/everypolitician/scraped.git (at master@58c88c1)  Using table_unspanner 0.1.0 from https://github.com/everypolitician/table_unspanner.git (at master@a70a98a)  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@9657b9b)  Using wikidata_ids_decorator 0.1.0 from https://github.com/everypolitician/wikidata_ids_decorator.git (at master@259c620)  Bundle complete! 20 Gemfile dependencies, 65 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Bundle completed (38.06s)  Cleaning up the bundler cache. -----> Installing node-v6.11.1-linux-x64 -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... 18 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 17 Can't find Wikidata IDs for: vergrößern und Informationen zum Bild anzeigen, Logo des Deutschen Bundestages in de 16 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 15 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 14 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 13 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 12 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 11 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 10 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 9 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 8 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 7 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 6 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 5 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 4 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 3 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de 2 Can't find Wikidata IDs for: vergrößern und Informationen zum Bild anzeigen, Logo des Deutschen Bundestages in de 1 Can't find Wikidata IDs for: Logo des Deutschen Bundestages in de

Data

Downloaded 2744 times by everypolitician chrismytton mhl ondenman MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.32 MB) Use the API

rows 10 / 10889

id name sort_name party constituency area term wikiname wikidata source notes start_date end_date death_date
jan_van_aken_(politiker)
Jan van Aken
Aken, Jan van
DIE LINKE
Hamburg
18
Jan van Aken (Politiker)
Q107176
stephan_albani
Stephan Albani
Albani, Stephan
CDU
Niedersachsen
18
Stephan Albani
Q15093113
katrin_albsteiger
Katrin Albsteiger
Albsteiger, Katrin
CSU
Bayern
18
Katrin Albsteiger
Q1736697
agnes_alpers
Agnes Alpers
Alpers, Agnes
DIE LINKE
Bremen
18
Agnes Alpers
Q394447
ausgeschieden am 2. März 2015[3]
2015-03-02
peter_altmaier
Peter Altmaier
Altmaier, Peter
CDU
Saarlouis
Saarland
18
Peter Altmaier
Q65539
luise_amtsberg
Luise Amtsberg
Amtsberg, Luise
GRÜNE
Schleswig-Holstein
18
Luise Amtsberg
Q1876595
kerstin_andreae
Kerstin Andreae
Andreae, Kerstin
GRÜNE
Baden-Württemberg
18
Kerstin Andreae
Q95185
niels_annen
Niels Annen
Annen, Niels
SPD
Hamburg-Eimsbüttel
Hamburg
18
Niels Annen
Q109362
ingrid_arndt-brauer
Ingrid Arndt-Brauer
Arndt-Brauer, Ingrid
SPD
Nordrhein-Westfalen
18
Ingrid Arndt-Brauer
Q109521
rainer_arnold
Rainer Arnold
Arnold, Rainer
SPD
Baden-Württemberg
18
Rainer Arnold
Q96968

Statistics

Average successful run time: 3 minutes

Total run time: 3 days

Total cpu time used: about 6 hours

Total disk space used: 3.36 MB

History

  • Auto ran revision 3d0fd738 and completed successfully .
    nothing changed in the database
    360 pages scraped
  • Auto ran revision 3d0fd738 and completed successfully .
    nothing changed in the database
  • Auto ran revision 3d0fd738 and completed successfully .
    nothing changed in the database
    360 pages scraped
  • Auto ran revision 3d0fd738 and completed successfully .
    nothing changed in the database
  • Auto ran revision 3d0fd738 and completed successfully .
    nothing changed in the database
    360 pages scraped
  • ...
  • Created on morph.io

Show complete history