wfdd / colombia-senado-wikidata-scraper

A scraper for the members of the Colombian Senate found on Wikidata.

Scrapes query.wikidata.org, es.wikipedia.org, www.wikidata.org, and 1 other domain

Wikidata Query Service (Beta)


A morph.io scraper for the members of the Colombian Senate found on Wikidata.

Contributors wfdd

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  The git source `git://github.com/openaustralia/scraperwiki-ruby.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  The git source `git://github.com/everypolitician/wikidata-fetcher.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  The git source `git://github.com/everypolitician/wikisnakker.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching git://github.com/openaustralia/scraperwiki-ruby.git  Fetching git://github.com/everypolitician/wikidata-fetcher.git  Fetching git://github.com/everypolitician/wikisnakker.git  Using bundler 1.15.2  Fetching coderay 1.1.1  Fetching colorize 0.8.1  Fetching diskcached 1.1.2  Installing colorize 0.8.1  Installing coderay 1.1.1  Fetching unf_ext 0.0.7.2  Installing diskcached 1.1.2  Fetching excon 0.54.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Installing unf_ext 0.0.7.2 with native extensions  Installing excon 0.54.0  Fetching hashie 3.4.6  Installing hashie 3.4.6  Fetching httpclient 2.8.2.4  Fetching json 2.0.2  Installing httpclient 2.8.2.4  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching require_all 1.3.3  Installing require_all 1.3.3  Fetching sqlite3 1.3.12  Installing sqlite3 1.3.12 with native extensions  Installing json 2.0.2 with native extensions  Using wikisnakker 0.7.0 from git://github.com/everypolitician/wikisnakker.git (at master@cc55a4f)  Fetching faraday 0.9.2  Installing faraday 0.9.2  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.6.8.1  Installing nokogiri 1.6.8.1 with native extensions  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching faraday_middleware 0.10.0  Installing faraday_middleware 0.10.0  Fetching domain_name 0.5.20161021  Installing domain_name 0.5.20161021  Using scraperwiki 3.0.1 from git://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.10  Installing wikidata-client 0.0.10  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.0  Installing rest-client 2.0.0  Fetching mediawiki_api 0.7.0  Installing mediawiki_api 0.7.0  Using wikidata-fetcher 0.18.2 from git://github.com/everypolitician/wikidata-fetcher.git (at master@cc464f2)  Bundle complete! 5 Gemfile dependencies, 33 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (29.66s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3219 for Q187413 Unknown value for P735 for Q19788636 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3987 for Q3045986 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2032 for Q5858080 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P945 for Q704022 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1142 for Q704022 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3943 for Q704022 Unknown value for P569 for Q5951281 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P4619 for Q51055683 Unknown value for P106 for Q4776830 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3762 for Q6752925 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3219 for Q152472 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P5361 for Q152472 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P5587 for Q152472

Data

Downloaded 207 times by everypolitician wfdd tmtmtmtm ondenman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (245 KB) Use the API

rows 10 / 303

id name__es name__en name__nl name__fr name__hu name wikipedia__es gender birth_date given_name original_wikiname name__it image name__de wikipedia__en identifier__ISNI identifier__VIAF identifier__SUDOC death_date identifier__FAST name__cy identifier__GND identifier__LCAuth name__nb name__da name__nn name__sv name__ru name__ca name__gl second_surname name__pl name__mg wikipedia__mg wikipedia__pl wikipedia__de wikipedia__ru wikipedia__fr name__zh_hant name__zh_cn name__tr name__zh wikipedia__trwikiquote identifier__freebase wikipedia__it name__zh_hans name__zh_hk name__zh_sg name__zh_tw name__eu name__wa name__ko name__he name__oc name__lv name__ja name__scn name__pt name__eo name__fi name__uk name__la name__cs name__bg name__fa name__ksh name__lt name__tl wikipedia__bg wikipedia__ca wikipedia__commons wikipedia__cs wikipedia__cswikiquote wikipedia__da wikipedia__dewikiquote wikipedia__enwikiquote wikipedia__eo wikipedia__eswikiquote wikipedia__eu wikipedia__fa wikipedia__fi wikipedia__he wikipedia__itwikiquote wikipedia__ja wikipedia__ko wikipedia__ksh wikipedia__la wikipedia__lt wikipedia__lv wikipedia__nl wikipedia__no wikipedia__oc wikipedia__pt wikipedia__scn wikipedia__simple wikipedia__sv wikipedia__tl wikipedia__uk wikipedia__wa wikipedia__zh identifier__BNF identifier__NDL identifier__SBN_it identifier__NTA family_name name__nov wikipedia__nov website twitter facebook name__en_ca name__en_gb name__sk name__et wikipedia__et identifier__GTAA name__qu name__gd name__be name__af name__yo name__id name__sq name__vi name__el name__ar name__sr_el name__sr_ec name__be_tarask name__io name__gv name__sr name__ro name__az name__sco wikipedia__af wikipedia__ar wikipedia__az wikipedia__be_x_old wikipedia__be wikipedia__el wikipedia__gd wikipedia__gl wikipedia__gv wikipedia__id wikipedia__io wikipedia__nn wikipedia__qu wikipedia__ro wikipedia__sco wikipedia__sq wikipedia__sr wikipedia__tr wikipedia__vi wikipedia__yo identifier__IMDB identifier__NKC identifier__CANTIC identifier__Munzinger identifier__CSPAN identifier__OLID identifier__BNE instagram name__de_ch name__pt_br identifier__NNDB linkedin occupation identifier__google_plus name__an name__ast name__bar name__bm name__br name__co name__de_at name__frc name__frp name__fur name__ga name__gsw name__hr name__ia name__ie name__jam name__kab name__kg name__lb name__li name__lij name__min name__ms name__nap name__nds name__nds_nl name__nrm name__pap name__pcd name__pms name__prg name__rgn name__rm name__sc name__sw name__vec name__vls name__vmf name__vo name__wo name__zu identifier__nlg identifier__snac wikipedia__fawikiquote wikipedia__eswikinews identifier__TED identifier__Britannica identifier__PTBNP identifier__SELIBR wikipedia__plwikiquote wikipedia__eswikisource name__sl identifier__bigenc_ru identifier__CiNii pseudonym identifier__youtube wikipedia__ast name__hy wikipedia__hy identifier__goodreads wikipedia__lb wikipedia__zh_yue name__yue identifier__BVMC identifier__BIBSYS identifier__BAV identifier__N6I wikipedia__ruwikinews wikipedia__tt name__tt identifier__NLP honorific_prefix
Q5983411
Luis Fernando Duque
Luis Fernando Duque
Luis Fernando Duque
Luis Fernando Duque
Luis Fernando Duque
Luis Fernando Duque
Luis Fernando Duque
male
1952
Luis
Luis Fernando Duque
politician
Luis Fernando Duque
Q19788624
Javier Tato Álvarez
Javier Tato Álvarez
Javier Tato Álvarez
Javier Tato Álvarez
Javier Tato Álvarez
Javier Tato Álvarez
male
1969-01-01
Javier
politician
Javier Tato Álvarez
Q17478235
Alfredo Rangel
Alfredo Rangel
Alfredo Rangel
Alfredo Rangel
Alfredo Rangel
Alfredo Rangel
Alfredo Rangel
male
1955-02-15
Alfredo
Alfredo Rangel
politician
Alfredo Rangel
Q17624021
Orlando Castañeda Serrano
Orlando Castañeda Serrano
Orlando Castañeda Serrano
Orlando Castañeda Serrano
Orlando Castañeda Serrano
Orlando Castañeda Serrano
Orlando Castañeda
male
Orlando
politician
Orlando Castañeda Serrano
Q5669012
Alirio Villamizar
Alirio Villamizar
Alirio Villamizar
Alirio Villamizar
Alirio Villamizar
Alirio Villamizar
Alirio Villamizar
male
1959
Alirio Villamizar
politician
Alirio Villamizar
Q5944572
Mauricio Pimiento
Mauricio Pimiento
Mauricio Pimiento
Mauricio Pimiento
Mauricio Pimiento
Mauricio Pimiento
Mauricio Pimiento
male
1961-03-17
Mauricio
Mauricio Pimiento
Mauricio Pimiento
politician
Mauricio Pimiento
Q18201479
Sofía Gaviria
Sofia Gaviria
Sofia Gaviria
Sofia Gaviria
Sofía Gaviria
Sofía Gaviria
Sofía Gaviria
female
1968-02
Sofia
Sofía Gaviria
politician
Sofía Gaviria
Q28858596
Juan Samy Merheg
Juan Samy Merheg
Juan Samy Merheg
Juan Samy Merheg
Juan Samy Merheg
male
Samy
politician
Juan Samy Merheg
Q17477977
Susana Correa Borrero
Susana Correa Borrero
Susana Correa Borrero
Susana Correa
Susana Correa Borrero
Susana Correa Borrero
Susana Correa
female
1976-08-12
Susana
Susana Correa
Susana Correa
Susana Correa
politician
Susana Correa Borrero
Q17478000
Iván Duque Márquez
Iván Duque Márquez
Iván Duque
Iván Duque Márquez
Iván Duque
Iván Duque Márquez
Iván Duque Márquez
male
1976-08-01
Iván
Iván Duque Márquez
https://upload.wikimedia.org/wikipedia/commons/1/12/Iván_Duque.png
Iván Duque
Iván Duque Márquez
103299307
139979522
Iván Duque
Дуке Маркес, Иван
Iván Duque Márquez
Iván Duque Márquez
Márquez
Iván Duque Márquez
Iván Duque Márquez
Iván Duque
Дуке Маркес, Иван
Iván Duque
Iván Duque
Iván Duque Márquez
이반 두께
איוואן דוקה
イバン・ドゥケ
Iván Duque Márquez
Iván Duque Márquez
Iván Duque
Іван Дуке
Ioannes Duque
ایوان دوکه
Iván Duque Márquez
Category:Iván Duque Márquez
Iván Duque Márquez
ایوان دوکه
Iván Duque
איוואן דוקה
Iván Duque Márquez
이반 두께
Ioannes Duque
Iván Duque
Iván Duque Márquez
Iván Duque Márquez
Іван Дуке Маркес
Duque
IvanDuque
ivanduquemarquez
Iván Duque Márquez
Iván Duque Márquez
Iván Duque Márquez
Iván Duque Márquez
Iván Duque
Іван Дуке Маркес
Ιβάν Ντούκε
Иван Дуке
Іван Дуке Маркес
Ιβάν Ντούκε
Iván Duque
Iván Duque Márquez
Iván Duque
ivanduquemarquez
Iván Duque
Iván Duque Márquez
politician
Iván Duque Márquez
Iván Duque
Iván Duque Márquez
Iván Duque
UC5wdznN-41mzUBnmMw7f3yw
Iván Duque Márquez
Իվան Դուկե Մարկես
Իվան Դուկե Մարկես
Iván Duque
伊班杜奇馬基斯
伊班杜奇馬基斯
Категория:Иван Дуке Маркес
Иван Дуке Маркес
Иван Дуке Маркес
Excellency

Statistics

Average successful run time: 2 minutes

Total run time: about 19 hours

Total cpu time used: about 1 hour

Total disk space used: 270 KB

History

  • Auto ran revision cf841dd9 and completed successfully .
    302 records updated in the database
    26 pages scraped
  • Auto ran revision cf841dd9 and completed successfully .
    302 records updated in the database
    26 pages scraped
  • Auto ran revision cf841dd9 and completed successfully .
    302 records updated in the database
    26 pages scraped
  • Auto ran revision cf841dd9 and completed successfully .
    301 records updated in the database
    26 pages scraped
  • Auto ran revision cf841dd9 and completed successfully .
    301 records updated in the database
    26 pages scraped
  • ...
  • Created on morph.io

Show complete history