wfdd / inatsisartut-scraper

A scraper for the Greenlandic parliament.

Scrapes www.ina.gl

Saqqaa | Inatsisartut


A morph.io scraper for the parliament of Greenland, the Inatsisartut.

Contributors wfdd

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.5.1  $ pip install -r requirements.txt  Collecting selenium==3.0.1 (from -r requirements.txt (line 1))  Downloading selenium-3.0.1-py2.py3-none-any.whl (913kB)  Collecting splinter==0.7.4 (from -r requirements.txt (line 2))  Downloading splinter-0.7.4.tar.gz  Installing collected packages: selenium, splinter  Running setup.py install for splinter: started  Running setup.py install for splinter: finished with status 'done'  Successfully installed selenium-3.0.1 splinter-0.7.4   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... 'Augusta Salling, Atassut' converted to 'Augusta Salling' 'Ellen Christoffersen, Atassut' converted to 'Ellen Christoffersen' 'Esmar Bergstrøm, Inuit Ataqatigiit' converted to 'Esmar Bergstrøm' 'Johan Lund Olsen, Inuit Ataqatigiit' converted to 'Johan Lund Olsen' 'Marie Fleischer, Inuit Ataqatigiit' converted to 'Marie Fleischer' 'Thomas Kristensen, Atassut' converted to 'Thomas Kristensen' 'Vittus Mikaelsen, Siumut' converted to 'Vittus Mikaelsen' 'Augusta Salling, Atassut' converted to 'Augusta Salling' 'Ellen Christoffersen, Atassut' converted to 'Ellen Christoffersen' 'Johan Lund Olsen, Inuit Ataqatigiit' converted to 'Johan Lund Olsen' 'Marie Fleischer, Inuit Ataqatigiit' converted to 'Marie Fleischer' 'Augusta Salling, Atassut' converted to 'Augusta Salling' 'Johan Lund Olsen, Inuit Ataqatigiit' converted to 'Johan Lund Olsen' 'Tommy Marø, Siumut' converted to 'Tommy Marø' 'Vittus Mikaelsen, Siumut' converted to 'Vittus Mikaelsen' 'Johan Lund Olsen, Inuit Ataqatigiit' converted to 'Johan Lund Olsen' 'Johan Lund Olsen, Inuit Ataqatigiit' converted to 'Johan Lund Olsen'

Data

Downloaded 127 times by everypolitician wfdd ondenman bigmacman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (62 KB) Use the API

rows 10 / 367

name email image term group group_id start_date end_date
Aaja Chemnitz Larsen
aacl@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2015-11-03
Agathe Fontain
agathe@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2014-11-28
Anders Olsen
anols@inatsisartut.gl
12
Siumut
siumut
2014-11-28
Andreas Uldum
uldum@nanoq.gl
12
Demokraatit
demokraatit
2014-11-28
2015-11-02
Ane Hansen
aneh@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2014-11-28
Anthon Frederiksen
antuut@inatsisartut.gl
12
Partii Naleraq
partii_naleraq
2014-11-28
Aqqaluaq B. Egede
aqqe@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2014-11-28
Bendt B. Kristiansen
bebk@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2016-10-31
Debora Kleist
debkl@inatsisartut.gl
12
Inuit Ataqatigiit
inuit_ataqatigiit
2016-09-16
Doris Jakobsen
doja@nanoq.gl
12
Siumut
siumut
2014-11-28

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (62 KB) Use the API

rows 10 / 12

id name start_date end_date
1
Landsting
1979-04-04
1983-04-11
2
Landsting
1983-04-12
1984-06-05
3
Landsting
1984-06-06
1987-05-25
4
Landsting
1987-05-26
1991-03-04
5
Landsting
1991-03-05
1995-03-03
6
Landsting
1995-03-04
1999-02-15
7
Landsting
1999-02-16
2002-12-02
8
Landsting
2002-12-03
2005-11-14
9
Landsting
2005-11-15
2009-06-01
10
Inatsisartut 10
2009-06-02
2013-03-11

Statistics

Average successful run time: 3 minutes

Total run time: 1 day

Total cpu time used: about 1 hour

Total disk space used: 135 KB

History

  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    865 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    845 pages scraped
  • Auto ran and failed .
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    942 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    nothing changed in the database
    986 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    nothing changed in the database
    933 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    nothing changed in the database
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    931 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    nothing changed in the database
    921 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    867 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    938 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    887 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    903 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    857 pages scraped
  • Auto ran and failed .
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    859 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    786 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    945 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    925 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    810 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    892 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    918 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    917 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    899 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
    864 pages scraped
  • Auto ran revision 30bf568c and completed successfully .
    379 records added, 379 records removed in the database
  • Manually ran revision 30bf568c and completed successfully .
    379 records added in the database
    924 pages scraped
  • Manually ran revision 30bf568c and completed successfully .
    379 records added, 372 records removed in the database
    868 pages scraped
  • Auto ran revision a56f306e and failed .
    nothing changed in the database
    86 pages scraped
  • Auto ran revision a56f306e and completed successfully .
    376 records added, 376 records removed in the database
    1788 pages scraped
  • Auto ran revision a56f306e and completed successfully .
    376 records added, 376 records removed in the database
    912 pages scraped
  • Manually ran revision a56f306e and completed successfully .
    376 records added in the database
    860 pages scraped
  • Manually ran revision a56f306e and completed successfully .
    376 records added, 372 records removed in the database
  • Auto ran revision d019896b and failed .
    nothing changed in the database
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    873 pages scraped
  • Auto ran revision d019896b and failed .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    738 pages scraped
  • Auto ran revision d019896b and completed successfully .
    nothing changed in the database
    797 pages scraped
  • Auto ran revision d019896b and completed successfully .
    nothing changed in the database
  • Auto ran revision d019896b and completed successfully .
    nothing changed in the database
    863 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    856 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    725 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    829 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    789 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    753 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    843 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    829 pages scraped
  • Auto ran revision d019896b and completed successfully .
    376 records added, 376 records removed in the database
    799 pages scraped
  • Manually ran revision 1ca8414b and completed successfully .
    376 records added in the database
    734 pages scraped
  • Manually ran revision 1ca8414b and completed successfully .
    nothing changed in the database
    788 pages scraped
  • Manually ran and failed .
  • Auto ran and failed .
  • Manually ran revision bcb98a3d and completed successfully .
    391 records added in the database
    845 pages scraped
  • Manually ran revision bcb98a3d and completed successfully .
    nothing changed in the database
    805 pages scraped
  • Auto ran revision b16b8050 and completed successfully .
    485 records added, 485 records removed in the database
    785 pages scraped
  • Auto ran revision b16b8050 and completed successfully .
    485 records added, 485 records removed in the database
  • Auto ran revision b16b8050 and completed successfully .
    485 records added, 485 records removed in the database
    802 pages scraped
  • Manually ran revision b16b8050 and completed successfully .
    485 records added, 442 records removed in the database
    795 pages scraped
  • Auto ran revision e7413eef and failed .
    nothing changed in the database
    90 pages scraped
  • Auto ran revision e7413eef and failed .
    nothing changed in the database
    89 pages scraped
  • Auto ran revision e7413eef and failed .
    nothing changed in the database
    90 pages scraped
  • Manually ran revision e7413eef and completed successfully .
    442 records added in the database
    930 pages scraped
  • Auto ran revision 4bcd786b and completed successfully .
    12 records added, 12 records removed in the database
    1 page scraped
  • Auto ran revision 4bcd786b and completed successfully .
    442 records added, 411 records removed in the database
    971 pages scraped
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
  • Auto ran revision 180e8256 and failed .
    nothing changed in the database
  • Auto ran revision 180e8256 and completed successfully .
    447 records added, 447 records removed in the database
    851 pages scraped
  • Manually ran revision 180e8256 and completed successfully .
    447 records added in the database
    929 pages scraped
  • Created on morph.io

Scraper code

Python

inatsisartut-scraper / scraper.py