struan / nigeria-shineyoureye

Pombola IDs for Nigerian politicians.


This is a scraper that runs on Morph. To get started see the documentation

Contributors struan mhl ondenman tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/..........  Fetching version metadata from https://rubygems.org/..  Fetching git://github.com/everypolitician/everypolitician-popolo.git  Fetching git://github.com/openaustralia/scraperwiki-ruby.git  Installing require_all 1.4.0  Installing coderay 1.1.1  Installing httpclient 2.8.3  Installing open-uri-cached 0.0.5  Installing method_source 0.8.2  Installing slop 3.6.0  Using bundler 1.11.2  Using everypolitician-popolo 0.8.0 from git://github.com/everypolitician/everypolitician-popolo.git (at master@40dc460)  Installing sqlite3 1.3.13 with native extensions  Installing pry 0.10.4  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from git://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 4 Gemfile dependencies, 12 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (7.83s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 19 times by struan mhl tmtmtmtm jimacoff

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (206 KB) Use the API

rows 10 / 906

id name email birth_date gender image position slug identifier__pombola_slug
core_person:171
ETOK ALOYSIUS AKPAN
akpanetuk@yahoo.com
1958-02-15
male
etok-aloysius-akpan
core_person:201
GWARZO BELLO HAYATU
1960-04-14
gwarzo-bello-hayatu
core_person:273
EKWEREMADU IKE
ikeekweremadu@yahoo.com
1962-05-12
male
Senator
ekweremadu-ike
core_person:458
YAKUBU UMARU BARDE
uyakubu@yahoo.com
1968-08-28
male
Federal Representative
yakubu-umaru-barde
core_person:72
ALIYU BAHAGO AHMAN PATEGI
aliyuahmanpategi@yahoo.com
1964-12-31
Federal Representative
aliyu-bahago-ahman-pategi
core_person:23
ABIODUN DADA AWOLEYE
abbylinkolu@yahoo.com
1970-10-01
Federal Representative
abiodun-dada-awoleye
core_person:24
ABIOLA ADEBUKOLA AJAJA
repscontact@nass.gov.ng
1954-10-26
abiola-adebukola-ajaja
core_person:54
AIYEDUN OLAYINKA AKEEM
repscontact@nass.gov.ng
1970-06-29
aiyedun-olayinka-akeem
core_person:25
ABIOSE IFEOLUWA AROWOSOGE
repscontact@nass.gov.ng
1955-09-07
abiose-ifeoluwa-arowosoge
core_person:13
ABDULMALIK DAGACI USMAN CHECHE
repscontact@nass.gov.ng
1962-12-14
abdulmalik-dagaci-usman-cheche

Statistics

Average successful run time: half a minute

Total run time: 9 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 237 KB

History

  • Manually ran revision 8502e0ce and completed successfully .
    906 records updated in the database
  • Manually ran revision 0144b93d and completed successfully .
    365 records updated in the database
    2 pages scraped
  • Manually ran revision 5a1dd952 and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Manually ran revision 5a1dd952 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 5a1dd952 and completed successfully .
    906 records updated in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

nigeria-shineyoureye / scraper.rb