everypolitician-scrapers / nigeria-shineyoureye-positions

A scraper to extract person summarys and all their positions from the Pombola-based ShineYourEye

Contributors mhl

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Python app detected [1G-----> Installing python-2.7.12 [1G $ pip install -r requirements.txt [1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6)) [1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki [1G Collecting requests==2.13.0 (from -r requirements.txt (line 8)) [1G Downloading requests-2.13.0-py2.py3-none-any.whl (584kB) [1G Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6)) [1G Downloading dumptruck-0.1.6.tar.gz [1G Installing collected packages: dumptruck, requests, scraperwiki [1G Running setup.py install for dumptruck: started [1G Running setup.py install for dumptruck: finished with status 'done' [1G Running setup.py develop for scraperwiki [1G Successfully installed dumptruck-0.1.6 requests-2.13.0 scraperwiki [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 39 times by mhl SmartVMDev

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (271 KB) Use the API

rows 10 / 659

person_summary person_name organization_name organization_id end_date membership_id organization_category person_id start_date role organization_classification
BEN NNEBEDUMCHUKWU NWANKWO
University of Nigeria
core_organisation:375
core_position:4344
education
core_person:119
2005
Student
Educational Institution
BEN NNEBEDUMCHUKWU NWANKWO
Peoples Democratic Party
core_organisation:129
core_position:2941
political
core_person:119
Member
Political Party
BEN NNEBEDUMCHUKWU NWANKWO
House of Representatives
core_organisation:120
2015-05-29
core_position:3260
political
core_person:119
2011-05-29
Federal Representative
Political Institution
BEN NNEBEDUMCHUKWU NWANKWO
Capital Market & Institutions Committee (Reps)
core_organisation:10
2015-05-29
core_position:272
political
core_person:119
Committee Member
Legislative Committee - Federal Reps
BEN NNEBEDUMCHUKWU NWANKWO
Foreign Affairs Committee (Reps)
core_organisation:41
2015-05-29
core_position:825
political
core_person:119
Committee Member
Legislative Committee - Federal Reps
BEN NNEBEDUMCHUKWU NWANKWO
Human Rights Committee (Reps)
core_organisation:50
2015-05-29
core_position:986
political
core_person:119
Committee Member
Legislative Committee - Federal Reps
BEN NNEBEDUMCHUKWU NWANKWO
National Security and Intelligence Committee (Senate)
core_organisation:79
2015-05-29
core_position:1388
political
core_person:119
Committee Member
Legislative Committee - Senate
BEN NNEBEDUMCHUKWU NWANKWO
Police Affairs Committee (Reps)
core_organisation:88
2015-05-29
core_position:1567
political
core_person:119
Committee Member
Legislative Committee - Federal Reps
BEN NNEBEDUMCHUKWU NWANKWO
Public Petitions Committee (Reps)
core_organisation:95
2015-05-29
core_position:1729
political
core_person:119
Committee Member
Legislative Committee - Federal Reps
BEN NNEBEDUMCHUKWU NWANKWO
Emergency & Disaster Preparedness Committee (Reps)
core_organisation:26
2015-05-29
core_position:611
political
core_person:119
Committee Member
Legislative Committee - Federal Reps

Statistics

Average successful run time: 1 minute

Total run time: 5 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 294 KB

History

  • Manually ran revision 01d2d82b and completed successfully .
    nothing changed in the database
  • Manually ran revision 01d2d82b and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Manually ran revision 58f3230d and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Manually ran revision 5304f876 and failed .
    659 records added in the database
    3 pages scraped
  • Manually ran revision 6a99cdc3 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Created on morph.io