Contributors tmtmtmtm

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.5). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/scraped.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching ast 2.4.0  Using bundler 1.15.2  Fetching unf_ext 0.0.7.5  Fetching field_serializer 0.3.0  Installing ast 2.4.0  Installing field_serializer 0.3.0  Fetching httpclient 2.8.3  Fetching jaro_winkler 1.5.2  Installing unf_ext 0.0.7.5 with native extensions  Installing jaro_winkler 1.5.2 with native extensions  Installing httpclient 2.8.3  Fetching mime-types-data 3.2018.0812  Fetching mini_portile2 2.4.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching parallel 1.14.0  Installing parallel 1.14.0  Fetching powerpack 0.1.2  Installing mime-types-data 3.2018.0812  Fetching psych 3.1.0  Installing psych 3.1.0 with native extensions  Fetching rainbow 3.0.0  Installing mini_portile2 2.4.0  Fetching require_all 2.0.0  Installing require_all 2.0.0  Fetching ruby-progressbar 1.10.0  Installing ruby-progressbar 1.10.0  Fetching unicode-display_width 1.4.1  Installing powerpack 0.1.2  Fetching sqlite3 1.4.0  Installing sqlite3 1.4.0 with native extensions  Installing rainbow 3.0.0  Fetching parser 2.6.0.0  Installing parser 2.6.0.0  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching mime-types 3.2.2  Installing unicode-display_width 1.4.1  Fetching nokogiri 1.10.1  Installing nokogiri 1.10.1 with native extensions  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching rubocop 0.65.0  Installing mime-types 3.2.2  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Installing rubocop 0.65.0  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Using scraped 0.6.2 from https://github.com/everypolitician/scraped.git (at scraper-class@ecb23ad)  Bundle complete! 6 Gemfile dependencies, 28 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (32.67s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.5). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:363:in `open_http': 403 Forbidden (OpenURI::HTTPError) from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:210:in `catch' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:721:in `open' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:35:in `open' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request/strategy/live_request.rb:10:in `response' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:29:in `block in first_successful_response' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `first' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `first_successful_response' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:13:in `response' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/scraper.rb:15:in `scraper' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/scraper.rb:8:in `store' from scraper.rb:8:in `<main>'

Data

Downloaded 1389 times by everypolitician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (27 KB) Use the API

rows 10 / 21

id name position_id position label start_date end_date ordinal
Q2644118
Bernard Berg
Q2644118-d7de9d74-4434-dea7-daf5-8f5f8cf29f5a
Q29217646
Deputy Prime Minister of Luxembourg
1976-07-21
1979-07-16
0
Q15176517
Paul Elvinger
Q15176517-e4bad63a-4c02-e49c-b8db-0cd9605db224
Q30242784
justice minister
1959-03-02
1964-07-15
0
Q2977816
Claude Meisch
Q2977816-49277f44-4c1d-aef6-4fe8-3ddaecb9e6b5
Q30139151
Q30139151
2018-12-05
0
Q2977816
Claude Meisch
Q2977816-30304c7c-458f-e9ca-b0be-e83d206f6f84
Q30107391
minister for Education, Children and Youth
2018-12-05
0
Q57661
Jean-Claude Juncker
Q57661-CF16D4E6-66EB-4BBB-857B-445F8FD4C205
Q1344632
Prime Minister of Luxembourg
1995-01-20
2013-12-04
23
Q2573257
Charles-Gérard Eyschen
Q2573257-5905b5f7-48f2-92a6-2274-116e8ec3b801
Q51132441
Q51132441
1856-05-21
1857-11-28
0
Q2977816
Claude Meisch
Q2977816-a43e13b4-4a95-4ba2-7241-6ff33e8d380b
Q30107391
minister for Education, Children and Youth
2013-12-04
2018-12-05
0
Q13103203
Jean-Pierre André
Q13103203-00cd062b-4fb0-7121-34e4-9431d304b164
Q61455235
Q61455235
0
Q16438964
Taina Bofferding
Q16438964-9d3265e6-4fb1-d657-8252-531d5c749bf1
Q59870198
minister of Equality between Women and Men
2018-12-05
0
Q39659
Jacques Santer
Q39659-8902E69D-1B5F-4BB6-A62B-CDF6897EF11E
Q1344632
Prime Minister of Luxembourg
1984-07-20
1995-01-20
22

Statistics

Average successful run time: less than 20 seconds

Total run time: about 13 hours

Total cpu time used: 31 minutes

Total disk space used: 58.9 KB

History

  • Auto ran revision 1caf3ef7 and failed .
    nothing changed in the database
  • Auto ran revision 1caf3ef7 and failed .
    nothing changed in the database
  • Auto ran revision 1caf3ef7 and failed .
    nothing changed in the database
  • Auto ran revision 1caf3ef7 and failed .
    nothing changed in the database
  • Auto ran revision 1caf3ef7 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

luxembourg-positions / scraper.rb