tmtmtmtm / norway-stortinget

Scrapes data.stortinget.no

Forsiden - data.stortinget.no


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Using bundler 1.15.2  Fetching coderay 1.1.0  Installing coderay 1.1.0  Fetching colorize 0.7.7  Installing colorize 0.7.7  Fetching excon 0.45.4  Installing excon 0.45.4  Fetching execjs 2.5.2  Installing execjs 2.5.2  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching fuzzy_match 2.1.0  Installing fuzzy_match 2.1.0  Fetching hashie 3.4.2  Installing hashie 3.4.2  Fetching httpclient 2.6.0.1  Installing httpclient 2.6.0.1  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mini_portile 0.6.2  Installing mini_portile 0.6.2  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching sqlite3 1.3.10  Installing sqlite3 1.3.10 with native extensions  Fetching faraday 0.9.1  Installing faraday 0.9.1  Fetching nokogiri 1.6.6.2  Installing nokogiri 1.6.6.2 with native extensions  Fetching pry 0.10.1  Installing pry 0.10.1  Fetching sqlite_magic 0.0.3  Installing sqlite_magic 0.0.3  Fetching faraday_middleware 0.10.0  Installing faraday_middleware 0.10.0  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.7  Installing wikidata-client 0.0.7  Bundle complete! 8 Gemfile dependencies, 21 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (20.11s)  Cleaning up the bundler cache. -----> Installing node-v6.11.1-linux-x64 -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... 2017-2021 2013-2017 2009-2013 2005-2009 2001-2005 1997-2001 1993-97 1989-93 1985-89 1981-85 1977-81 1973-77 1969-73 1965-69 1961-65 1958-61 1954-57 1950-53 1945-49

Data

Downloaded 1601 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (857 KB) Use the API

rows 10 / 19

id name start_date end_date
2017-2021
2017-2021
2017-10-01
2021-09-30
2013-2017
2013-2017
2013-10-01
2017-09-30
2009-2013
2009-2013
2009-10-01
2013-09-30
2005-2009
2005-2009
2005-10-01
2009-09-30
2001-2005
2001-2005
2001-10-01
2005-09-30
1997-2001
1997-2001
1997-10-01
2001-09-30
1993-97
1993-97
1993-10-01
1997-09-30
1989-93
1989-93
1989-10-01
1993-09-30
1985-89
1985-89
1985-10-01
1989-09-30
1981-85
1981-85
1981-10-01
1985-09-30

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (857 KB) Use the API

rows 10 / 3008

id given_name family_name name sort_name birth_date gender area area_id party party_id term source image
ABIR
Abid Q.
Raja
Abid Q. Raja
Raja, Abid Q.
1975-11-05
male
Akershus
Ak
Venstre
V
2017-2021
ALYS
Audun
Lysbakken
Audun Lysbakken
Lysbakken, Audun
1977-09-30
male
Hordaland
Ho
Sosialistisk Venstreparti
SV
2017-2021
ANNH
Anniken
Huitfeldt
Anniken Huitfeldt
Huitfeldt, Anniken
1969-11-29
female
Akershus
Ak
Arbeiderpartiet
A
2017-2021
ANNS
André N.
Skjelstad
André N. Skjelstad
Skjelstad, André N.
1965-08-27
male
Nord-Trøndelag
NT
Venstre
V
2017-2021
ARNEV
Arne
Nævra
Arne Nævra
Nævra, Arne
1953-12-07
male
Buskerud
Bu
Sosialistisk Venstreparti
SV
2017-2021
ASKH
Åshild
Bruun-Gundersen
Åshild Bruun-Gundersen
Bruun-Gundersen, Åshild
1986-11-26
female
Aust-Agder
AA
Fremskrittspartiet
FrP
2017-2021
ATR
Anette
Trettebergstuen
Anette Trettebergstuen
Trettebergstuen, Anette
1981-05-25
female
Hedmark
He
Arbeiderpartiet
A
2017-2021
BENH
Bent
Høie
Bent Høie
Høie, Bent
1971-05-04
male
Rogaland
Ro
Høyre
H
2017-2021
BERST
Bengt Rune
Strifeldt
Bengt Rune Strifeldt
Strifeldt, Bengt Rune
1971-03-24
male
Finnmark
Fi
Fremskrittspartiet
FrP
2017-2021
BJMO
Bjørnar
Moxnes
Bjørnar Moxnes
Moxnes, Bjørnar
1981-12-19
male
Oslo
Os
Rødt
R
2017-2021

Statistics

Average successful run time: 1 minute

Total run time: about 22 hours

Total cpu time used: about 1 hour

Total disk space used: 881 KB

History

  • Auto ran revision cbae0c41 and completed successfully .
    3027 records added, 3027 records removed in the database
    20 pages scraped
  • Auto ran revision cbae0c41 and completed successfully .
    3027 records added, 3027 records removed in the database
    20 pages scraped
  • Auto ran revision cbae0c41 and completed successfully .
    3027 records added, 3027 records removed in the database
    20 pages scraped
  • Auto ran revision cbae0c41 and completed successfully .
    3027 records added, 3027 records removed in the database
    20 pages scraped
  • Auto ran revision cbae0c41 and completed successfully .
    3027 records added, 3027 records removed in the database
    20 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

norway-stortinget / scraper.rb