tmtmtmtm / mexico-diputados-2015

Scrapes github.com and sitl.diputados.gob.mx

Build software better, together.


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm octopusinvitro ondenman

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/bundle/ruby/2.3.0/gems/git-1.3.0/lib/git/lib.rb:937:in `command': git '--git-dir=/tmp/d20180120-18-3suk59/.git' '--work-tree=/tmp/d20180120-18-3suk59' push 'origin' 'scraped-pages-archive' 2>&1:To https://c4748fd51c1d2185bdd5bce2fc6373a1afc27295@github.com/everypolitician-scrapers/mexico-diputados-2015 (Git::GitExecuteError) ! [rejected] scraped-pages-archive -> scraped-pages-archive (fetch first) error: failed to push some refs to 'https://c4748fd51c1d2185bdd5bce2fc6373a1afc27295@github.com/everypolitician-scrapers/mexico-diputados-2015' hint: Updates were rejected because the remote contains work that you do hint: not have locally. This is usually caused by another repository pushing hint: to the same ref. You may want to first integrate the remote changes hint: (e.g., 'git pull ...') before pushing again. hint: See the 'Note about fast-forwards' in 'git push --help' for details. from /app/vendor/bundle/ruby/2.3.0/gems/git-1.3.0/lib/git/lib.rb:742:in `push' from /app/vendor/bundle/ruby/2.3.0/gems/git-1.3.0/lib/git/base.rb:329:in `push' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/git_storage.rb:41:in `save' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive.rb:37:in `record' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped_page_archive-28f93d74b1c1/lib/scraped_page_archive/open-uri.rb:9:in `open_uri' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:717:in `open' from /app/vendor/ruby-2.3.3/lib/ruby/2.3.0/open-uri.rb:35:in `open' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request/strategy/live_request.rb:10:in `response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:29:in `block in first_successful_response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `first' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:30:in `first_successful_response' from /app/vendor/bundle/ruby/2.3.0/bundler/gems/scraped-c458dd2601a7/lib/scraped/request.rb:13:in `response' from scraper.rb:16:in `scrape' from scraper.rb:20:in `data_for_members' from scraper.rb:30:in `<main>'

Data

Downloaded 950 times by everypolitician octopusinvitro MikeRalphson tmtmtmtm ondenman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (266 KB) Use the API

rows 10 / 500

party party_id term id sort_name source area area_id name image email
Partido Revolucionario Institucional
PRI
63
260
Abdala Carmona Yahleel
Tamaulipas 1
ocd-division/country:mx/entidad:tamaulipas/distrito:1
Yahleel Abdala Carmona
yahleel.abdala@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
287
Abdala Saad Antonio Tarek
Veracruz 17
ocd-division/country:mx/entidad:veracruz/distrito:17
Antonio Tarek Abdala Saad
antonio.abdala@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
397
Aguilar Robles David
Oaxaca 3
ocd-division/country:mx/entidad:oaxaca/circunscripción:3
David Aguilar Robles
david.aguilar@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
286
Aguilar Yunes Marco Antonio
Veracruz 16
ocd-division/country:mx/entidad:veracruz/distrito:16
Marco Antonio Aguilar Yunes
marco.aguilaryunez@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
173
Aguirre Chávez Marco Polo
Michoacán 8
ocd-division/country:mx/entidad:michoacán/distrito:8
Marco Polo Aguirre Chávez
marco.aguirre@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
164
Aguirre Romero Andrés
México 39
ocd-division/country:mx/entidad:méxico/distrito:39
Andrés Aguirre Romero
andres.aguirre@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
477
Alcántara Rojas María Guadalupe
México 5
ocd-division/country:mx/entidad:méxico/circunscripción:5
María Guadalupe Alcántara Rojas
mariaguadalupe.alcantara@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
293
Alpizar Carrillo Lucely Del Perpetuo Socorro
Yucatán 2
ocd-division/country:mx/entidad:yucatán/distrito:2
Lucely Del Perpetuo Socorro Alpizar Carrillo
lucely.alpizar@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
478
Álvarez Ortiz Héctor Javier
México 5
ocd-division/country:mx/entidad:méxico/circunscripción:5
Héctor Javier Álvarez Ortiz
hector.alvarez@congreso.gob.mx
Partido Revolucionario Institucional
PRI
63
198
Amaro Cancino Antonio
Oaxaca 1
ocd-division/country:mx/entidad:oaxaca/distrito:1
Antonio Amaro Cancino
antonio.amaro@congreso.gob.mx

Statistics

Average successful run time: about 3 hours

Total run time: 2 months

Total cpu time used: about 1 month

Total disk space used: 307 MB

History

  • Auto ran revision f5ae7402 and failed .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision f5ae7402 and completed successfully .
    nothing changed in the database
    2006 pages scraped
  • Auto ran revision f5ae7402 and completed successfully .
    5 records updated in the database
    2006 pages scraped
  • Auto ran revision f5ae7402 and failed .
    nothing changed in the database
    383 pages scraped
  • Auto ran revision f5ae7402 and failed .
    nothing changed in the database
    1160 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

mexico-diputados-2015 / scraper.rb