dracos / scraper-sweden-riksdagen

Sweden Riksdag members


This is a scraper that runs on Morph. To get started see the documentation

Contributors dracos

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.9, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.9 -----> Installing pip -----> Installing requirements with pip  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to /app/.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting idna<2.7,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading idna-2.6-py2.py3-none-any.whl (56kB)  Collecting urllib3<1.23,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB)  Installing collected packages: dumptruck, idna, urllib3, certifi, chardet, requests, scraperwiki, lxml, cssselect  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Successfully installed certifi-2018.1.18 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 idna-2.6 lxml-3.4.4 requests-2.18.4 scraperwiki urllib3-1.22   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 278 times by everypolitician MikeRalphson diskborsteMC

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (180 KB) Use the API

rows 1 / 1

id start_date name source
2014
2014-09-14
2014 election

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (180 KB) Use the API

rows 10 / 408

phone facebook gender party year_of_birth name image source email web term area area_id twitter id party_id
65241
female
Socialdemokraterna
1973
Veronica Palm
veronica.palm@riksdagen.se
2014
Stockholms kommun
ocd-division/country:se/constituency:stockholms-kommun
0548314774911
S
64446
female
Miljöpartiet de gröna
1989
Annika Hirvonen
annika.hirvonen@riksdagen.se
2014
Stockholms län
ocd-division/country:se/constituency:stockholms-län
0819601620927
MP
male
Socialdemokraterna
1993
John Skoglund
john.skoglund@riksdagen.se
2014
Västra Götalands läns norra
ocd-division/country:se/constituency:västra-götalands-läns-norra
0885483214625
S
65845
female
Moderata samlingspartiet
1983
Ulrika Heindorff
ulrika.heindorff@riksdagen.se
2014
Skåne läns västra
ocd-division/country:se/constituency:skåne-läns-västra
0764949934324
M
female
Socialdemokraterna
1991
Ida Ekeroth
ida.ekeroth@riksdagen.se
2014
Västra Götalands läns östra
ocd-division/country:se/constituency:västra-götalands-läns-östra
0412502344925
S
64116
female
Miljöpartiet de gröna
1992
Magda Rasmusson
magda.rasmusson@riksdagen.se
2014
Stockholms kommun
ocd-division/country:se/constituency:stockholms-kommun
0710022029620
MP
male
Vänsterpartiet
1957
Torbjörn Björlund
torbjorn.bjorlund@riksdagen.se
2014
Östergötlands län
ocd-division/country:se/constituency:östergötlands-län
037508021018
V
64390
male
Centerpartiet
1952
Anders Ahlgren
anders.ahlgren@riksdagen.se
2014
Dalarnas län
ocd-division/country:se/constituency:dalarnas-län
0920966427818
C
male
Centerpartiet
1954
Göran Lindell
goran.lindell@riksdagen.se
2014
Jönköpings län
ocd-division/country:se/constituency:jönköpings-län
0397377293714
C
65791
female
Kristdemokraterna
1967
Eva Wallin
eva.wallin@riksdagen.se
2014
Västra Götalands läns västra
ocd-division/country:se/constituency:västra-götalands-läns-västra
0116712544316
KD

Statistics

Average successful run time: 2 minutes

Total run time: about 1 month

Total cpu time used: 15 minutes

Total disk space used: 208 KB

History

  • Auto ran revision 4eea42a4 and completed successfully .
    350 records added, 350 records removed in the database
  • Auto ran revision 4eea42a4 and completed successfully .
    350 records added, 350 records removed in the database
    1 page scraped
  • Auto ran revision 4eea42a4 and completed successfully .
    350 records added, 350 records removed in the database
    1 page scraped
  • Auto ran revision 4eea42a4 and completed successfully .
    350 records added, 350 records removed in the database
  • Auto ran revision 4eea42a4 and completed successfully .
    350 records added, 350 records removed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

scraper-sweden-riksdagen / scraper.py