everypolitician-scrapers / malaysian_parliament-wikidata

Scrapes raw.githubusercontent.com, cdn.rawgit.com, api.morph.io, and 3 other domains

Build software better, together.

Contributors tmtmtmtm ondenman

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching rake 12.0.0  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Installing ast 2.3.0  Installing activesupport-inflector 0.1.0  Installing rake 12.0.0  Using bundler 1.15.2  Fetching coderay 1.1.1  Fetching colorize 0.8.1  Installing coderay 1.1.1  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Fetching require_all 1.4.0  Installing require_all 1.4.0  Fetching excon 0.58.0  Fetching multipart-post 2.0.0  Installing unf_ext 0.0.7.4 with native extensions  Installing excon 0.58.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.6  Installing hashie 3.5.6  Fetching httpclient 2.8.3  Fetching i18n 0.8.1  Installing i18n 0.8.1  Installing httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching ruby-progressbar 1.8.1  Installing ruby-progressbar 1.8.1  Fetching unicode-display_width 1.2.1  Installing unicode-display_width 1.2.1  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.0  Installing yajl-ruby 1.3.0 with native extensions  Fetching parser 2.4.0.0  Installing parser 2.4.0.0  Fetching rainbow 2.2.2  Installing rainbow 2.2.2 with native extensions  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.12.1  Installing faraday 0.12.1  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.7.1  Installing nokogiri 1.7.1 with native extensions  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@20582b1)  Fetching faraday_middleware 0.11.0.1  Fetching rubocop 0.48.1  Fetching domain_name 0.5.20170404  Installing faraday_middleware 0.11.0.1  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.10  Installing domain_name 0.5.20170404  Installing rubocop 0.48.1  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Installing wikidata-client 0.0.10  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@69ea1ee)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (38.35s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Can't find Wikidata IDs for: Hashim Bin Jahya in ms ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5056 for Q299574 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1187 for Q181383 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5056 for Q181383 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1187 for Q716871 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P1187 for Q7093808 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5056 for Q57675 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q529391 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q131248 ‼ Q20716099 is_instance_of Wikimedia list article. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q296317 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3280 for Q4521287 ‼ Q24949579 is_instance_of Wikimedia list article. Skipping No data for Q20460035 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4293 for Q264516 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q264516 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P5056 for Q264516 ‼ Q21005935 is_instance_of Wikimedia list article. Skipping

Data

Downloaded 872 times by everypolitician ondenman chrismytton

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (508 KB) Use the API

rows 10 / 535

id name__en name__zh name__ms name__es name__id name__de name__nb name__da name__nn name__sv name__nl name__hu name wikipedia__en wikipedia__id wikipedia__ms wikipedia__zh gender birth_date identifier__freebase original_wikiname name__fr image given_name name__cy wikipedia__de identifier__VIAF identifier__GND identifier__LCAuth death_date name__zh_hans name__zh_hant name__zh_hk name__zh_cn name__zh_sg name__zh_tw name__jv name__pl name__eu name__qu name__ta name__et name__my name__pt name__eo name__is name__ru name__tr name__hak name__mk name__fi name__uk name__be_tarask name__ne name__az name__tl name__kk_arab name__kk_cn name__kk_tr name__kk_kz name__kk_cyrl name__kk_latn name__nan name__be name__ko name__he name__lv name__it name__li name__ja name__vi name__yue name__sh name__sa name__hi name__ro name__th name__ca name__war name__cs name__bg name__fa name__mr name__km name__kk name__sr name__ar name__ky name__new name__sco name__si name__la name__mg name__bcl name__lzh name__pnb name__wuu name__yi name__ur name__ba name__ka name__ml name__sd name__tt name__vo name__hy name__io name__lb name__lo name__mn name__te name__gu name__bn name__gl name__ast name__el wikipedia__ar wikipedia__arwikiquote wikipedia__ast wikipedia__az wikipedia__ba wikipedia__bcl wikipedia__be_x_old wikipedia__be wikipedia__bg wikipedia__bn wikipedia__ca wikipedia__commons wikipedia__cs wikipedia__cy wikipedia__da wikipedia__dewikiquote wikipedia__el wikipedia__enwikinews wikipedia__enwikiquote wikipedia__eo wikipedia__es wikipedia__et wikipedia__eu wikipedia__fa wikipedia__fi wikipedia__fr wikipedia__gu wikipedia__hak wikipedia__he wikipedia__hi wikipedia__hu wikipedia__hy wikipedia__io wikipedia__is wikipedia__it wikipedia__ja wikipedia__jv wikipedia__ka wikipedia__kk wikipedia__km wikipedia__ko wikipedia__ky wikipedia__la wikipedia__lb wikipedia__li wikipedia__lo wikipedia__lv wikipedia__mg wikipedia__mk wikipedia__ml wikipedia__mn wikipedia__mr wikipedia__my wikipedia__ne wikipedia__new wikipedia__nl wikipedia__nn wikipedia__nnwikiquote wikipedia__no wikipedia__pl wikipedia__plwikiquote wikipedia__pnb wikipedia__pt wikipedia__qu wikipedia__ro wikipedia__ru wikipedia__ruwikinews wikipedia__ruwikiquote wikipedia__sa wikipedia__sco wikipedia__sd wikipedia__sh wikipedia__simple wikipedia__sr wikipedia__sv wikipedia__ta wikipedia__te wikipedia__th wikipedia__thwikiquote wikipedia__tl wikipedia__tr wikipedia__tt wikipedia__uk wikipedia__ukwikiquote wikipedia__ur wikipedia__vi wikipedia__vo wikipedia__war wikipedia__wuu wikipedia__yi wikipedia__zh_classical wikipedia__zh_min_nan wikipedia__zh_yue wikipedia__zhwikiquote identifier__ISNI identifier__BNF identifier__SUDOC identifier__IMDB identifier__NDL family_name identifier__NNDB identifier__CANTIC identifier__Munzinger identifier__FAST identifier__CSPAN identifier__wikitree identifier__NLA identifier__NTA identifier__NLAtrove name__nds name__vmf name__en_ca name__en_gb twitter facebook name__min wikipedia__min website name__so name__ckb name__bs name__ace wikipedia__ace wikipedia__bswikiquote wikipedia__ckb wikipedia__itwikiquote wikipedia__so wikipedia__trwikiquote identifier__MusicBrainz identifier__GTAA name__yo name__lt name__oc wikipedia__eowikinews wikipedia__lt wikipedia__yo name__de_ch name__pt_br wikipedia__oc identifier__Oxforddnb identifier__bigenc_ru name__br name__co name__ty identifier__OLID wikipedia__gl name__zh_mo name__lmo name__pa wikipedia__pa name__sk name__zh_my identifier__NLI identifier__britishmuseum identifier__NPG occupation identifier__google_knowledge identifier__nyt_topic wikipedia__kn name__kn identifier__snac identifier__Britannica identifier__quora wikipedia__si name__fo name__kl wikipedia__uz identifier__ioc_athlete name__uz instagram identifier__BIBSYS identifier__NUKAT identifier__EGAXA identifier__national_archives wikipedia__enwikisource identifier__ne_se identifier__SELIBR identifier__GNC name__bar identifier__PTBNP identifier__LNB name__sl name__zh_classical wikipedia__lfn name__lfn
Q1252922
Mohammad Said Keruak
Mohamed Said Bin Keruak
Mohamad Said Keruak
Mohamad Said Keruak
Mohammad Said Keruak
Mohammad Said Keruak
Mohamed Said Bin Keruak
male
1926-11-15
Mohamad Said Keruak
Mohamad Said Keruak
Mohamad
Mohamad Said Keruak
1995-11-17
モハマド・サイード・ケラク
politician
/g/120mt4mh
Q6893939
Mohd Hatta Ramli
莫哈末哈达
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd Hatta Ramli
莫哈末哈达
male
1956-09-11
/m/09rtfc8
Mohd Hatta Ramli
Mohd Hatta Ramli
Mohd
politician
Q8054967
Yong Khoon Seng
杨昆贤
Yong Khoon Hian @ Yong Khoon Seng
Yong Khoon Seng
Yong Khoon Seng
Yong Khoon Hian @ Yong Khoon Seng
Yong Khoon Hian @ Yong Khoon Seng
Yong Khoon Hian @ Yong Khoon Seng
Yong Khoon Hian @ Yong Khoon Seng
Yong Khoon Seng
Yong Khoon Seng
Yong Khoon Seng
Yong Khoon Seng
Yong Khoon Hian @ Yong Khoon Seng
杨昆贤
male
1941-12-22
/m/0bm9qgk
Yong Khoon Seng
politician
Q6894002
Mohd Nizar Zakaria
莫哈末尼扎
Mohd Nizar Zakaria
Mohd Nizar Zakaria
Mohd Nizar Zakaria
Mohd Nizar Zakaria
Mohd Nizar Zakaria
Mohd Nizar Zakaria
Mohd Nizar Zakaria
Mohd Nizar Zakaria
Mohd Nizar Zakaria
Mohd Nizar Zakaria
Mohd Nizar Zakaria
Mohd Nizar Zakaria
莫哈末尼扎
male
1969
Mohd Nizar Zakaria
Mohd
politician
Q561704
Mohamed Rahmat
Mohamed bin Rahmat
Mohamed Rahmat
Mohamed Rahmat
Mohamed Rahmat
Mohamed Rahmat
Mohamed Rahmat
Tan Sri Mohamed Rahmat
Mohamed Rahmat
Mohamed Rahmat
Mohamed Rahmat
Mohamed Rahmat
Mohamed Rahmat
male
1938-01-04
/m/09v22sb
Mohamed Rahmat
Mohamed Rahmat
Tan
Mohamed Rahmat
Mohamed Rahmat
107316958
2010-01-01
Mohamed Rahmat
Mohamed Rahmat
Рахмат, Мохамед
Мохамед Рахмат
モハメド・ラフマト
Рахмат
モハメド・ラフマト
Рахмат, Мохамед
Mohamed Rahmat
Mohamed Rahmat
Mohamed Rahmat
Рахмат, Мохамед
Mohamed Rahmat
Мохамед Рахмат
1529279
politician
Q15916995
Khoo Soo Seang
邱思祥
Khoo Soo Seang
Khoo Soo Seang
邱思祥
male
Khoo Soo Seang
politician
Q434830
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
Fatimah Hashim
female
1924-12-25
/m/02z17xs
Fatimah Hashim
Fatimah Hashim
Fatimah
Fatimah Hashim
Fatimah Hashim
43431250
1018184392
n89135286
2010-01-09
ファティマ・ハシム
Fatimah Hashim
314297
politician
Q12711000
Tan Phock Kin
Tan Phock Kin
Tan Phock Kin
Tan Phock Kin
Q20452396
T Mahima Singh
T Mahima Singh
T Mahima Singh
Q12711362
Teoh Chze Chong
Teoh Chze Chong
Teoh Chze Chong
Teoh Chze Chong

Statistics

Average successful run time: 2 minutes

Total run time: 3 days

Total cpu time used: about 2 hours

Total disk space used: 547 KB

History

  • Auto ran revision 2a7cab4a and completed successfully .
    534 records updated in the database
    41 pages scraped
  • Auto ran revision 2a7cab4a and completed successfully .
    1 record added, 533 records updated in the database
    41 pages scraped
  • Auto ran revision 2a7cab4a and completed successfully .
    1 record added, 533 records updated in the database
    41 pages scraped
  • Auto ran revision 2a7cab4a and completed successfully .
    531 records updated in the database
    40 pages scraped
  • Auto ran revision 2a7cab4a and completed successfully .
    532 records updated in the database
    40 pages scraped
  • ...
  • Created on morph.io

Show complete history