tmtmtmtm / mexico-diputados-2015

Scrapes github.com

Build software better, together.


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm octopusinvitro ondenman

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/bundle/ruby/2.3.0/gems/git-1.3.0/lib/git/lib.rb:937:in `command': git clone '--' 'https://c4748fd51c1d2185bdd5bce2fc6373a1afc27295@github.com/everypolitician-scrapers/mexico-diputados-2015' '/tmp/d20180420-16-1u6gc0e' 2>&1:Cloning into '/tmp/d20180420-16-1u6gc0e'... (Git::GitExecuteError) error: index-pack died of signal 9 fatal: index-pack failed from /app/vendor/bundle/ruby/2.3.0/gems/git-1.3.0/lib/git/lib.rb:76:in `clone' from /app/vendor/bundle/ruby/2.3.0/gems/git-1.3.0/lib/git/base.rb:29:in `clone' from /app/vendor/bundle/ruby/2.3.0/gems/git-1.3.0/lib/git.rb:97:in `clone' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/git_storage.rb:52:in `git' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/git_storage.rb:17:in `path' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive.rb:35:in `record' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/open-uri.rb:9:in `open_uri' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:717:in `open' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:35:in `open' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request/strategy/live_request.rb:10:in `response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:29:in `block in first_successful_response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `first' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `first_successful_response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:13:in `response' from scraper.rb:16:in `scrape' from scraper.rb:20:in `data_for_members' from scraper.rb:30:in `<main>'

Data

Downloaded 1096 times by everypolitician octopusinvitro MikeRalphson tmtmtmtm ondenman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (266 KB) Use the API

rows 10 / 500

party party_id term id sort_name source area area_id name image email
Partido Revolucionario Institucional
PRI
63
287
Abdala Saad Antonio Tarek
Veracruz 17
ocd-division/country:mx/entidad:veracruz/distrito:17
Antonio Tarek Abdala Saad
antonio.abdala@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
397
Aguilar Robles David
Oaxaca 3
ocd-division/country:mx/entidad:oaxaca/circunscripción:3
David Aguilar Robles
david.aguilar@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
286
Aguilar Yunes Marco Antonio
Veracruz 16
ocd-division/country:mx/entidad:veracruz/distrito:16
Marco Antonio Aguilar Yunes
marco.aguilaryunez@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
164
Aguirre Romero Andrés
México 39
ocd-division/country:mx/entidad:méxico/distrito:39
Andrés Aguirre Romero
andres.aguirre@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
477
Alcántara Rojas María Guadalupe
México 5
ocd-division/country:mx/entidad:méxico/circunscripción:5
María Guadalupe Alcántara Rojas
mariaguadalupe.alcantara@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
128
Almanza Monroy Fidel
México 3
ocd-division/country:mx/entidad:méxico/distrito:3
Fidel Almanza Monroy
fidel.almanza@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
889
Alonso Que Erubiel Lorenzo
Tabasco 3
ocd-division/country:mx/entidad:tabasco/circunscripción:3
Erubiel Lorenzo Alonso Que
Partido Revolucionario Institucional
PRI
63
293
Alpizar Carrillo Lucely Del Perpetuo Socorro
Yucatán 2
ocd-division/country:mx/entidad:yucatán/distrito:2
Lucely Del Perpetuo Socorro Alpizar Carrillo
lucely.alpizar@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
478
Álvarez Ortiz Héctor Javier
México 5
ocd-division/country:mx/entidad:méxico/circunscripción:5
Héctor Javier Álvarez Ortiz
hector.alvarez@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
169
Anaya Orozco Alfredo
Michoacán 4
ocd-division/country:mx/entidad:michoacán/distrito:4
Alfredo Anaya Orozco
aanaya.orozco@congreso.gob.mx

Statistics

Average successful run time: about 4 hours

Total run time: 3 months

Total cpu time used: about 1 month

Total disk space used: 342 MB

History

  • Auto ran revision f5ae7402 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision f5ae7402 and failed .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision f5ae7402 and failed .
    nothing changed in the database
    1682 pages scraped
  • Auto ran revision f5ae7402 and failed .
    nothing changed in the database
    106 pages scraped
  • Auto ran revision f5ae7402 and completed successfully .
    nothing changed in the database
    2006 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

mexico-diputados-2015 / scraper.rb