tmtmtmtm / openpolis-scraper

Scrapes politici.openpolis.it

monitora chi sono, cosa fanno e dicono tutti 150mila politici eletti in Italia


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm chrismytton

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 1842 times by everypolitician andylolz tmtmtmtm franchg chrismytton MikeRalphson ondenman MadMind

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (371 KB) Use the API

rows 10 / 950

id name surname party area house term source image email facebook twitter
274886
AIELLO Pietro
AIELLO
Alternativa Popolare-Centristi per l'Europa-NCD-Noi con l'Italia
Calabria
Senate
17
pieroaiello.regcal@libero.it;piero.aiello@senato.it
685864
Airola Alberto
Airola
Movimento 5 stelle
Piemonte
Senate
17
albeairo@yahoo.com;alberto.airola@senato.it
341191
Albano Donatella
Albano
Partito Democratico
Liguria
Senate
17
donatella.albano@senato.it;donatella.albano@gmail.com
2
ALBERTINI Gabriele
ALBERTINI
Alternativa Popolare-Centristi per l'Europa-NCD-Noi con l'Italia
Lombardia
Senate
17
galbertini@europarl.eu.int;gabriele.albertini@senato.it
332966
ALICATA Bruno
ALICATA
Forza Italia - Il Popolo Della Libertà
Sicilia
Senate
17
bruno.alicata@senato.it
1454
AMATI Silvana
AMATI
Partito Democratico
Marche
Senate
17
silvana.amati@senato.it;s.amati@dsonline.it
8407
AMIDEI Bartolomeo
AMIDEI
Gruppo Misto
Veneto
Senate
17
bartolomeo.amidei@senato.it
175
AMORUSO Francesco Maria
AMORUSO
ALA - Alleanza Liberalpopolare Autonomie
Puglia
Senate
17
AMORUSO_F@camera.it;francescomaria.amoruso@senato.it
687154
Angioni Ignazio
Angioni
Partito Democratico
Sardegna
Senate
17
ignangioni@tiscali.it;ignazio.angioni@senato.it
687012
Anitori Fabiola
Anitori
Alternativa Popolare-Centristi per l'Europa-NCD-Noi con l'Italia
Lazio
Senate
17
fabiola.anitori@senato.it

Statistics

Average successful run time: about 1 hour

Total run time: about 2 months

Total cpu time used: about 4 hours

Total disk space used: 466 KB

History

  • Auto ran revision 49cb3d43 and completed successfully .
    337 records updated in the database
    952 pages scraped
  • Auto ran revision 49cb3d43 and completed successfully .
    nothing changed in the database
    952 pages scraped
  • Auto ran revision 49cb3d43 and completed successfully .
    nothing changed in the database
    951 pages scraped
  • Auto ran revision 49cb3d43 and completed successfully .
    1 record added, 672 records updated in the database
    952 pages scraped
  • Auto ran revision 49cb3d43 and completed successfully .
    nothing changed in the database
    951 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

openpolis-scraper / scraper.rb