everypolitician-scrapers / south-africa-national-assembly-wikidata

Contributors jacksonj04 tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.5). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.4.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing activesupport-inflector 0.1.0  Installing ast 2.4.0  Fetching colorize 0.8.1  Installing coderay 1.1.2  Fetching concurrent-ruby 1.1.4  Installing colorize 0.8.1  Fetching unf_ext 0.0.7.5  Fetching require_all 2.0.0  Installing concurrent-ruby 1.1.4  Installing require_all 2.0.0  Installing unf_ext 0.0.7.5 with native extensions  Fetching excon 0.62.0  Installing excon 0.62.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.6.0  Installing hashie 3.6.0  Fetching httpclient 2.8.3  Fetching jaro_winkler 1.5.2  Installing httpclient 2.8.3  Installing jaro_winkler 1.5.2 with native extensions  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.9.2  Installing method_source 0.9.2  Fetching mime-types-data 3.2018.0812  Installing mime-types-data 3.2018.0812  Fetching mini_portile2 2.4.0  Installing mini_portile2 2.4.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.13.0  Installing parallel 1.13.0  Fetching powerpack 0.1.2  Installing powerpack 0.1.2  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.10.0  Installing ruby-progressbar 1.10.0  Fetching unicode-display_width 1.4.1  Installing unicode-display_width 1.4.1  Fetching sqlite3 1.4.0  Installing sqlite3 1.4.0 with native extensions  Fetching yajl-ruby 1.4.1  Installing yajl-ruby 1.4.1 with native extensions  Fetching parser 2.6.0.0  Installing parser 2.6.0.0  Fetching everypolitician-popolo 0.9.0  Installing everypolitician-popolo 0.9.0  Fetching i18n 1.5.3  Installing i18n 1.5.3  Fetching faraday 0.15.4  Installing faraday 0.15.4  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching pry 0.12.2  Installing pry 0.12.2  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.10.1  Installing nokogiri 1.10.1 with native extensions  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching rubocop 0.63.1  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@f85e4b6)  Installing rubocop 0.63.1  Fetching faraday_middleware 0.13.1  Installing faraday_middleware 0.13.1  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing wikidata-client 0.0.12  Installing faraday-cookie_jar 0.0.6  Fetching mediawiki_api 0.7.1  Installing rest-client 2.0.2  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.24.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@c4c6f01)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from i18n:  HEADS UP! i18n 1.1 changed fallbacks to exclude default locale.  But that may break your application.  Please check your Rails app for 'config.i18n.fallbacks = true'.  If you're using I18n (>= 1.1.0) and Rails (< 5.2.2), this should be  'config.i18n.fallbacks = [I18n.default_locale]'.  If not, fallbacks will be broken in your app by I18n 1.1.x.  For more info see:  https://github.com/svenfuchs/i18n/releases/tag/v1.1.0  Bundle completed (39.47s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.5). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 1340 times by everypolitician everypolitician-scrapers jacksonj04

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (283 KB) Use the API

rows 10 / 903

statement id name start_date end_date constituency constituency_id party party_id term
Q16746670-6A1F3839-F004-4A05-B277-0107E113D5C8
Q16746670
Tandiwe Elizabeth Kenye
2014-05-21
2019-05-07
Eastern Cape
Q130840
African National Congress
Q83162
26
Q16746668-C6C3F5A0-92BE-4E6A-8B9E-58B6EC9BCBBC
Q16746668
John Jeffery
2019-05-22
KwaZulu-Natal
Q81725
African National Congress
Q83162
27
Q16193273-7E1556CE-1C76-4A1C-BDDD-F397C826332A
Q16193273
Thulas Nxesi
2014-05-21
2019-05-07
African National Congress
Q83162
26
Q16744844-A9348E25-5DE1-4322-9BC1-A25535EF728B
Q16744844
Gavin Richard Davis
2014-05-21
2018-09-20
Democratic Alliance
Q761877
26
Q16744439-0862F5B3-41D7-4581-8194-92ED80C5BEAA
Q16744439
Jerome Joseph Maake
2019-05-22
Limpopo
Q134907
African National Congress
Q83162
27
Q16744425-AA45A540-091A-4B73-BC92-8A388115A40D
Q16744425
Narend Singh
2019-05-22
Inkatha Freedom Party
Q654444
27
Q16746652-6c0df142-47df-ef5b-aa96-236d41c6ca26
Q16746652
Ebrahim Ismail Ebrahim
2014-05-21
2019-05-07
African National Congress
Q83162
26
Q16746675-B9E419C7-22BE-48B2-ACA6-E0528D29D4B6
Q16746675
Gerhardus Willem Koornhof
2014-05-21
2019-05-07
Gauteng
Q133083
African National Congress
Q83162
26
Q16744410-34c48627-4b47-33c4-2b97-73a6e80da82b
Q16744410
Alfred Mkhipheni Mpontshane
2014-05-21
2015-08-01
KwaZulu-Natal
Q81725
Inkatha Freedom Party
Q654444
26
Q16744297-57732f84-4b56-12e5-de59-f3fddbdb4f02
Q16744297
Pam Tshwete
2014-05-21
2019-05-07
African National Congress
Q83162
26

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: 22 minutes

Total disk space used: 361 KB

History

  • Auto ran revision 98b2bec2 and completed successfully .
    893 records updated in the database
  • Auto ran revision 98b2bec2 and completed successfully .
    901 records updated in the database
  • Auto ran revision 98b2bec2 and completed successfully .
    830 records updated in the database
  • Auto ran revision 98b2bec2 and completed successfully .
    772 records updated in the database
  • Auto ran revision 98b2bec2 and completed successfully .
    768 records updated in the database
  • ...
  • Created on morph.io

Show complete history