wfdd / inatsisartut-scraper

A scraper for the Greenlandic parliament.

Scrapes www.ina.gl

Saqqaa | Inatsisartut


A morph.io scraper for the parliament of Greenland, the Inatsisartut.

Contributors wfdd

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.5.1  $ pip install -r requirements.txt  Collecting selenium==3.0.1 (from -r requirements.txt (line 1))  Downloading selenium-3.0.1-py2.py3-none-any.whl (913kB)  Collecting splinter==0.7.4 (from -r requirements.txt (line 2))  Downloading splinter-0.7.4.tar.gz  Installing collected packages: selenium, splinter  Running setup.py install for splinter: started  Running setup.py install for splinter: finished with status 'done'  Successfully installed selenium-3.0.1 splinter-0.7.4   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 166, in <module> main() File "scraper.py", line 138, in main people = list(gather_people(browser)) File "scraper.py", line 106, in gather_people yield from scrape_rows(session, option_date) File "scraper.py", line 85, in scrape_rows term = appointment_dates_to_terms[option_date] KeyError: '2017-02-23'

Data

Downloaded 235 times by everypolitician wfdd ondenman bigmacman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (62 KB) Use the API

rows 10 / 367

name email image term group group_id start_date end_date
Aaja Chemnitz Larsen
aacl@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2015-11-03
Agathe Fontain
agathe@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2014-11-28
Anders Olsen
anols@inatsisartut.gl
12
Siumut
siumut
2014-11-28
Andreas Uldum
uldum@nanoq.gl
12
Demokraatit
demokraatit
2014-11-28
2015-11-02
Ane Hansen
aneh@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2014-11-28
Anthon Frederiksen
antuut@inatsisartut.gl
12
Partii Naleraq
partii_naleraq
2014-11-28
Aqqaluaq B. Egede
aqeg@nanoq.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2014-11-28
Bendt B. Kristiansen
bebk@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2016-10-31
Debora Kleist
debkl@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2016-09-16
Doris Jakobsen
doja@nanoq.gl
12
Siumut
siumut
2014-11-28

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (62 KB) Use the API

rows 10 / 12

id name start_date end_date
1
Landsting
1979-04-04
1983-04-11
2
Landsting
1983-04-12
1984-06-05
3
Landsting
1984-06-06
1987-05-25
4
Landsting
1987-05-26
1991-03-04
5
Landsting
1991-03-05
1995-03-03
6
Landsting
1995-03-04
1999-02-15
7
Landsting
1999-02-16
2002-12-02
8
Landsting
2002-12-03
2005-11-14
9
Landsting
2005-11-15
2009-06-01
10
Inatsisartut 10
2009-06-02
2013-03-11

Statistics

Average successful run time: 3 minutes

Total run time: 7 days

Total cpu time used: about 3 hours

Total disk space used: 209 KB

History

  • Auto ran revision deb3773c and failed .
    nothing changed in the database
    84 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    nothing changed in the database
    924 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    975 pages scraped
  • Auto ran revision deb3773c and failed .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    nothing changed in the database
    1018 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    nothing changed in the database
    1051 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1035 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1056 pages scraped
  • Auto ran revision deb3773c and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1017 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1079 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1040 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1019 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1002 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1049 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1051 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    nothing changed in the database
    1081 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    nothing changed in the database
    979 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1100 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
  • Manually ran revision deb3773c and completed successfully .
    379 records added in the database
    1083 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    379 records added, 379 records removed in the database
    1058 pages scraped
  • Auto ran revision deb3773c and failed .
    nothing changed in the database
  • Manually ran revision deb3773c and completed successfully .
    379 records added, 378 records removed in the database
    1074 pages scraped
  • Auto ran revision deb3773c and completed successfully .
    nothing changed in the database
    1027 pages scraped
  • Manually ran revision deb3773c and completed successfully .
    nothing changed in the database
    24 pages scraped
  • Manually ran revision deb3773c and completed successfully .
    nothing changed in the database
    1069 pages scraped
  • Manually ran revision deb3773c and completed successfully .
    nothing changed in the database
    1095 pages scraped
  • Auto ran revision 30bf568c and failed .
    nothing changed in the database
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    1907 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    nothing changed in the database
    838 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    955 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    833 pages scraped
  • Auto ran revision 30bf568c and failed .
    nothing changed in the database
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
  • Auto ran revision 30bf568c and failed .
    nothing changed in the database
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    906 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    901 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    862 pages scraped
  • Auto ran and failed .
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    948 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    934 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    894 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    955 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    963 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    898 pages scraped
  • Auto ran and failed .
  • Auto ran revision 30bf568c and failed .
    nothing changed in the database
  • Auto ran revision 30bf568c and failed .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 30bf568c and failed .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    958 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    926 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    967 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    898 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    857 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    875 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    975 pages scraped
  • Auto ran revision 30bf568c and failed .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    827 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    928 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    881 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    833 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    988 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    895 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    914 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    952 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    865 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    845 pages scraped
  • Auto ran and failed .
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    942 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    nothing changed in the database
    986 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    nothing changed in the database
    933 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    nothing changed in the database
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    931 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    nothing changed in the database
    921 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    867 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    938 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    887 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    903 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    857 pages scraped
  • Auto ran and failed .
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    859 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    786 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    945 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    925 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    810 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    892 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    918 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    917 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    899 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    864 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
  • Manually ran revision 30bf568c and completed successfully .
    379 records added in the database
    924 pages scraped
  • Manually ran revision 30bf568c and completed successfully .
    379 records added, 372 records removed in the database
    868 pages scraped
  • Auto ran revision a56f306e and failed .
    nothing changed in the database
    86 pages scraped
  • Auto ran revision a56f306e and completed successfully .
    376 records added, 376 records removed in the database
    1788 pages scraped
  • Auto ran revision a56f306e and completed successfully .
    376 records added, 376 records removed in the database
    912 pages scraped
  • Manually ran revision a56f306e and completed successfully .
    376 records added in the database
    860 pages scraped
  • Manually ran revision a56f306e and completed successfully .
    376 records added, 372 records removed in the database
  • Auto ran revision d019896b and failed .
    nothing changed in the database
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    873 pages scraped
  • Auto ran revision d019896b and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    738 pages scraped
  • Auto ran revision d019896b and completed successfully .
    nothing changed in the database
    797 pages scraped
  • Auto ran revision d019896b and completed successfully .
    nothing changed in the database
  • Auto ran revision d019896b and completed successfully .
    nothing changed in the database
    863 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    856 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    725 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    829 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    789 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    753 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    843 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    829 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    799 pages scraped
  • Manually ran revision 1ca8414b and completed successfully .
    376 records added in the database
    734 pages scraped
  • Manually ran revision 1ca8414b and completed successfully .
    nothing changed in the database
    788 pages scraped
  • Manually ran and failed .
  • Auto ran and failed .
  • Manually ran revision bcb98a3d and completed successfully .
    391 records added in the database
    845 pages scraped
  • Manually ran revision bcb98a3d and completed successfully .
    nothing changed in the database
    805 pages scraped
  • Auto ran revision b16b8050 and completed successfully .
    485 records added, 485 records removed in the database
    785 pages scraped
  • Auto ran revision b16b8050 and completed successfully .
    485 records added, 485 records removed in the database
  • Auto ran revision b16b8050 and completed successfully .
    485 records added, 485 records removed in the database
    802 pages scraped
  • Manually ran revision b16b8050 and completed successfully .
    485 records added, 442 records removed in the database
    795 pages scraped
  • Auto ran revision e7413eef and failed .
    nothing changed in the database
    90 pages scraped
  • Auto ran revision e7413eef and failed .
    nothing changed in the database
    89 pages scraped
  • Auto ran revision e7413eef and failed .
    nothing changed in the database
    90 pages scraped
  • Manually ran revision e7413eef and completed successfully .
    442 records added in the database
    930 pages scraped
  • Auto ran revision 4bcd786b and completed successfully .
    12 records added, 12 records removed in the database
    1 page scraped
  • Auto ran revision 4bcd786b and completed successfully .
    442 records added, 411 records removed in the database
    971 pages scraped
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
  • Auto ran revision 180e8256 and completed successfully .
    447 records added, 447 records removed in the database
    851 pages scraped
  • Manually ran revision 180e8256 and completed successfully .
    447 records added in the database
    929 pages scraped
  • Created on morph.io

Scraper code

Python

inatsisartut-scraper / scraper.py