struan / spain_congreso_es

Details of members of the Spanish Congress from the official website congreso.es


This is a scraper that runs on Morph. To get started see the documentation

Contributors struan tmtmtmtm octopusinvitro chrismytton

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... including Capybara::DSL in the global scope is not recommended! including Capybara::DSL in the global scope is not recommended! including Capybara::DSL in the global scope is not recommended! including Capybara::DSL in the global scope is not recommended! /app/vendor/bundle/ruby/2.3.0/gems/poltergeist-1.9.0/lib/capybara/poltergeist/browser.rb:351:in `command': Request to 'http://www.congreso.es/portal/page/portal/Congreso/Congreso/Diputados/BusqForm?_piref73_1333155_73_1333154_1333154.next_page=/wc/listadoFichas?idDiputado=284&idLegislatura=6' failed to reach server, check DNS and/or server status - Timed out with the following resources still waiting http://www.congreso.es/wc/htdocs/web/js/wc.js (Capybara::Poltergeist::StatusFailError) from /app/vendor/bundle/ruby/2.3.0/gems/poltergeist-1.9.0/lib/capybara/poltergeist/browser.rb:34:in `visit' from /app/vendor/bundle/ruby/2.3.0/gems/poltergeist-1.9.0/lib/capybara/poltergeist/driver.rb:95:in `visit' from /app/vendor/bundle/ruby/2.3.0/gems/capybara-2.6.2/lib/capybara/session.rb:232:in `visit' from /app/vendor/bundle/ruby/2.3.0/gems/capybara-2.6.2/lib/capybara/dsl.rb:51:in `block (2 levels) in <module:DSL>' from scraper.rb:89:in `get_unique_id' from scraper.rb:275:in `scrape_person' from scraper.rb:166:in `block in scrape_memberships' from scraper.rb:165:in `each' from scraper.rb:165:in `scrape_memberships' from scraper.rb:290:in `<main>'

Data

Downloaded 2164 times by everypolitician tmtmtmtm octopusinvitro struan MikeRalphson lpszBar chrismytton polmeth

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.86 MB) Use the API

rows 10 / 5856

id name term iddiputado url
0
VII Legislatura
6
284
0
I Legislatura
0
94
0
VI Legislatura
5
313
0
V Legislatura
4
219
0
VIII Legislatura
7
39
0
VI Legislatura
5
317
0
VII Legislatura
6
150
0
VI Legislatura
0
264
0
XIII Legislatura
12
245
0
XII Legislatura
11
258

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.86 MB) Use the API

rows 10 / 15

id name start_date end_date source
14
XIV Legislatura
2019
1
I Legislatura
1979
1982
0
Legislatura Constituyente
1977
1979
4
IV Legislatura
1989
1993
3
III Legislatura
1986
1989
2
II Legislatura
1982
1986
13
XIII Legislatura
2019
2019
12
XII Legislatura
2016
2019
11
XI Legislatura
2016
2016
8
VIII Legislatura
2004
2008

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.86 MB) Use the API

rows 10 / 5616

iddiputado name sort_name given_name family_name gender party faction_id faction source dob term start_date end_date email twitter facebook phone fax constituency photo id
44
José Manuel García-Margallo y Marfil
García-Margallo y Marfil, José Manuel
José Manuel
García-Margallo y Marfil
male
PP
GP
G.P. Popular
Nacido el 13 de agosto de 1944 .
11
2015-12-30
Alicante
11_44
280
Aurelio Sánchez Ramos
Sánchez Ramos, Aurelio
Aurelio
Sánchez Ramos
male
PP
GP
G.P. Popular
Nacido el 31 de diciembre de 1944 en Alcazarquivir (Marruecos) .
9
2008-03-26
2011-09-27
Cádiz
6_162
208
María José Sánchez Rubio
Sánchez Rubio, María José
María José
Sánchez Rubio
female
PSOE
GS
G.P. Socialista
Nacida el 4 de enero de 1954 .
9
2008-03-25
2010-04-21
Granada
8_23
70
Alfonso Sánchez Sánchez
Sánchez Sánchez, Alfonso
Alfonso
Sánchez Sánchez
male
PP
GP
G.P. Popular
Nacido el 4 de julio de 1940 en Villaconejos (Madrid) .
7
2000-03-21
2004-01-20
Zaragoza
6_392
114
Salvador Sánchez Terán Hernández
Sánchez Terán Hernández, Salvador
Salvador
Sánchez Terán Hernández
male
UCD
GC
Grupo Parlamentario Centrista
Diputado de la Constituyente y I legislaturas.
1
1979-03-13
1982-08-31
Salamanca
0_35
221
Carlos Sanjuán de la Rocha
Sanjuán de la Rocha, Carlos
Carlos
Sanjuán de la Rocha
male
PSOE-progresistas
GS
G.P. Socialista
Nacido el 10 de enero de 1938 en Zaragoza .
7
2000-03-27
2004-01-20
Málaga
0_172
172
Celinda Sánchez García
Sánchez García, Celinda
Celinda
Sánchez García
female
PP
GP
G.P. Popular
1945-12-24
9
2008-03-25
2011-09-27
Palencia
9_172
352
Rubén Moreno Palanques
Moreno Palanques, Rubén
Rubén
Moreno Palanques
male
PP
GP
G.P. Popular
1958-07-23
0
2011-12-05
2014-12-05
Valencia
10_288
31
José Vázquez Fouz
Vázquez Fouz, José
José
Vázquez Fouz
male
PSOE
GS
Grupo Parlamentario Socialista del Congreso
2
1982-11-06
1986-04-23
Pontevedra
1_14
225
Antonio Vázquez Guillén
Vázquez Guillén, Antonio
Antonio
Vázquez Guillén
male
UCD
GC
Grupo Parlamentario Centrista
1
1979-03-15
1982-08-31
La Coruña
0_67

Statistics

Average successful run time: about 2 hours

Total run time: 8 months

Total cpu time used: 6 days

Total disk space used: 179 MB

History

  • Auto ran revision 54698531 and failed .
    4363 records added, 4363 records removed in the database
  • Auto ran revision 54698531 and failed .
    9831 records added, 9825 records removed in the database
  • Auto ran revision 54698531 and failed .
    9006 records added, 9006 records removed in the database
  • Auto ran revision 54698531 and failed .
    8976 records added, 8976 records removed in the database
  • Auto ran revision 54698531 and failed .
    4146 records added, 4146 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

spain_congreso_es / scraper.rb