everypolitician-scrapers / nigeria-shineyoureye

Pombola IDs for Nigerian politicians.

Scrapes pombola.shineyoureye.org and www.whittington.nhs.uk

Home :: ShineYourEye


This is a scraper that runs on Morph. To get started see the documentation

Contributors struan mhl ondenman tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  The git source `git://github.com/everypolitician/everypolitician-popolo.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  The git source `git://github.com/openaustralia/scraperwiki-ruby.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching git://github.com/everypolitician/everypolitician-popolo.git  Fetching git://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching require_all 1.4.0  Fetching coderay 1.1.1  Fetching httpclient 2.8.3  Installing require_all 1.4.0  Installing coderay 1.1.1  Installing httpclient 2.8.3  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching open-uri-cached 0.0.5  Fetching slop 3.6.0  Fetching sqlite3 1.3.13  Installing slop 3.6.0  Installing sqlite3 1.3.13 with native extensions  Using everypolitician-popolo 0.8.0 from git://github.com/everypolitician/everypolitician-popolo.git (at master@40dc460)  Installing open-uri-cached 0.0.5  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from git://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 4 Gemfile dependencies, 12 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (9.92s)  Cleaning up the bundler cache.  The git source `git://github.com/everypolitician/everypolitician-popolo.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  The git source `git://github.com/openaustralia/scraperwiki-ruby.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 306 times by everypolitician mhl struan chrismytton

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (220 KB) Use the API

rows 10 / 1032

id name email birth_date gender image identifier__shineyoureye position
core_person:171
ETOK ALOYSIUS AKPAN
akpanetuk@yahoo.com
1958-02-15
male
etok-aloysius-akpan
core_person:201
GWARZO BELLO HAYATU
1960-04-14
gwarzo-bello-hayatu
core_person:273
EKWEREMADU IKE
ikeekweremadu@yahoo.com
1962-05-12
male
ekweremadu-ike
Senator
core_person:458
YAKUBU UMARU BARDE
uyakubu@yahoo.com
1968-08-28
male
yakubu-umaru-barde
Federal Representative
core_person:72
ALIYU BAHAGO AHMAN PATEGI
aliyuahmanpategi@yahoo.com
1964-12-31
aliyu-bahago-ahman-pategi
Federal Representative
core_person:23
ABIODUN DADA AWOLEYE
abbylinkolu@yahoo.com
1970-10-01
abiodun-dada-awoleye
Federal Representative
core_person:24
ABIOLA ADEBUKOLA AJAJA
1954-10-26
abiola-adebukola-ajaja
core_person:54
AIYEDUN OLAYINKA AKEEM
1970-06-29
aiyedun-olayinka-akeem
core_person:25
ABIOSE IFEOLUWA AROWOSOGE
1955-09-07
abiose-ifeoluwa-arowosoge
core_person:13
ABDULMALIK DAGACI USMAN CHECHE
1962-12-14
abdulmalik-dagaci-usman-cheche

Statistics

Average successful run time: half a minute

Total run time: about 1 hour

Total cpu time used: 3 minutes

Total disk space used: 254 KB

History

  • Manually ran revision 1d117b14 and completed successfully .
    1032 records added in the database
    63 pages scraped
  • Auto ran revision 26a74fc7 and failed .
    nothing changed in the database
  • Auto ran revision 26a74fc7 and failed .
    nothing changed in the database
  • Auto ran revision 26a74fc7 and failed .
    nothing changed in the database
  • Auto ran revision 26a74fc7 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

nigeria-shineyoureye / scraper.rb