wfdd / colombia-senado-wikidata-scraper

A scraper for the members of the Colombian Senate found on Wikidata.

Scrapes query.wikidata.org, es.wikipedia.org, www.wikidata.org, and 1 other domain

Wikidata Query Service (Beta)


A morph.io scraper for the members of the Colombian Senate found on Wikidata.

Contributors wfdd

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  The git source `git://github.com/openaustralia/scraperwiki-ruby.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  The git source `git://github.com/everypolitician/wikidata-fetcher.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  The git source `git://github.com/everypolitician/wikisnakker.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching git://github.com/openaustralia/scraperwiki-ruby.git  Fetching git://github.com/everypolitician/wikidata-fetcher.git  Fetching git://github.com/everypolitician/wikisnakker.git  Using bundler 1.15.2  Fetching coderay 1.1.1  Fetching colorize 0.8.1  Fetching diskcached 1.1.2  Installing colorize 0.8.1  Fetching unf_ext 0.0.7.2  Installing diskcached 1.1.2  Installing coderay 1.1.1  Fetching excon 0.54.0  Installing excon 0.54.0  Fetching multipart-post 2.0.0  Installing unf_ext 0.0.7.2 with native extensions  Installing multipart-post 2.0.0  Fetching hashie 3.4.6  Installing hashie 3.4.6  Fetching httpclient 2.8.2.4  Fetching json 2.0.2  Installing json 2.0.2 with native extensions  Installing httpclient 2.8.2.4  Fetching method_source 0.8.2  Installing method_source 0.8.2  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.1.0  Installing mini_portile2 2.1.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching slop 3.6.0  Installing slop 3.6.0  Fetching require_all 1.3.3  Installing require_all 1.3.3  Fetching sqlite3 1.3.12  Installing sqlite3 1.3.12 with native extensions  Using wikisnakker 0.7.0 from git://github.com/everypolitician/wikisnakker.git (at master@cc55a4f)  Fetching faraday 0.9.2  Fetching mime-types 3.1  Installing faraday 0.9.2  Installing mime-types 3.1  Fetching nokogiri 1.6.8.1  Fetching pry 0.10.4  Installing pry 0.10.4  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching faraday_middleware 0.10.0  Installing nokogiri 1.6.8.1 with native extensions  Installing faraday_middleware 0.10.0  Fetching domain_name 0.5.20161021  Installing domain_name 0.5.20161021  Using scraperwiki 3.0.1 from git://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.10  Installing wikidata-client 0.0.10  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.0  Installing rest-client 2.0.0  Fetching mediawiki_api 0.7.0  Installing mediawiki_api 0.7.0  Using wikidata-fetcher 0.18.2 from git://github.com/everypolitician/wikidata-fetcher.git (at master@cc464f2)  Bundle complete! 5 Gemfile dependencies, 33 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (30.61s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3987 for Q3045986 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3219 for Q187413 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P4619 for Q51055683 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P945 for Q704022 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1142 for Q704022 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3943 for Q704022 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P1595 for Q704022 Unknown value for P106 for Q4776830 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3762 for Q6752925 Unknown value for P569 for Q5951281 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3219 for Q152472 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P5361 for Q152472 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P5587 for Q152472 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P3630 for Q152472 ⁇ Unknown claim: https://www.wikidata.org/wiki/Property:P2032 for Q5858080 Unknown value for P735 for Q19788636

Data

Downloaded 208 times by everypolitician wfdd tmtmtmtm ondenman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (259 KB) Use the API

rows 10 / 308

id name__es name__en name__nl name__fr name__hu name wikipedia__es gender birth_date given_name original_wikiname name__it image name__de wikipedia__en identifier__ISNI identifier__VIAF identifier__SUDOC death_date identifier__FAST name__cy identifier__GND identifier__LCAuth name__nb name__da name__nn name__sv name__ru name__ca name__gl second_surname name__pl name__mg wikipedia__mg wikipedia__pl wikipedia__de wikipedia__ru wikipedia__fr name__zh_hant name__zh_cn name__tr name__zh wikipedia__trwikiquote identifier__freebase wikipedia__it name__zh_hans name__zh_hk name__zh_sg name__zh_tw name__eu name__wa name__ko name__he name__oc name__lv name__ja name__scn name__pt name__eo name__fi name__uk name__la name__cs name__bg name__fa name__ksh name__lt name__tl wikipedia__bg wikipedia__ca wikipedia__commons wikipedia__cs wikipedia__cswikiquote wikipedia__da wikipedia__dewikiquote wikipedia__enwikiquote wikipedia__eo wikipedia__eswikiquote wikipedia__eu wikipedia__fa wikipedia__fi wikipedia__he wikipedia__itwikiquote wikipedia__ja wikipedia__ko wikipedia__ksh wikipedia__la wikipedia__lt wikipedia__lv wikipedia__nl wikipedia__no wikipedia__oc wikipedia__pt wikipedia__scn wikipedia__simple wikipedia__sv wikipedia__tl wikipedia__uk wikipedia__wa wikipedia__zh identifier__BNF identifier__NDL identifier__SBN_it identifier__NTA family_name name__nov wikipedia__nov website twitter facebook name__en_ca name__en_gb name__sk name__et wikipedia__et identifier__GTAA name__qu name__gd name__be name__af name__yo name__id name__sq name__vi name__el name__ar name__sr_el name__sr_ec name__be_tarask name__io name__gv name__sr name__ro name__az name__sco wikipedia__af wikipedia__ar wikipedia__az wikipedia__be_x_old wikipedia__be wikipedia__el wikipedia__gd wikipedia__gl wikipedia__gv wikipedia__id wikipedia__io wikipedia__nn wikipedia__qu wikipedia__ro wikipedia__sco wikipedia__sq wikipedia__sr wikipedia__tr wikipedia__vi wikipedia__yo identifier__IMDB identifier__NKC identifier__CANTIC identifier__Munzinger identifier__CSPAN identifier__OLID identifier__BNE instagram name__de_ch name__pt_br identifier__NNDB linkedin occupation identifier__google_plus name__an name__ast name__bar name__bm name__br name__co name__de_at name__frc name__frp name__fur name__ga name__gsw name__hr name__ia name__ie name__jam name__kab name__kg name__lb name__li name__lij name__min name__ms name__nap name__nds name__nds_nl name__nrm name__pap name__pcd name__pms name__prg name__rgn name__rm name__sc name__sw name__vec name__vls name__vmf name__vo name__wo name__zu identifier__nlg identifier__snac wikipedia__fawikiquote wikipedia__eswikinews identifier__TED identifier__Britannica identifier__PTBNP identifier__SELIBR wikipedia__plwikiquote wikipedia__eswikisource name__sl identifier__bigenc_ru identifier__CiNii pseudonym identifier__youtube wikipedia__ast name__hy wikipedia__hy identifier__goodreads wikipedia__lb wikipedia__zh_yue name__yue identifier__BVMC identifier__BIBSYS identifier__BAV identifier__N6I wikipedia__ruwikinews wikipedia__tt name__tt identifier__NLP honorific_prefix wikipedia__hu identifier__CERL identifier__quora identifier__CONOR name__ee identifier__BNC wikipedia__sl identifier__NUKAT identifier__GNC identifier__dialnet
Q5750257
Carlos Enrique Soto
Carlos Enrique Soto
Carlos Enrique Soto
Carlos Enrique Soto
Carlos Enrique Soto
male
Carlos
Carlos Enrique Soto
businessperson
Carlos Enrique Soto
Q16941974
Luis Alfonso Hoyos
Luis Alfonso Hoyos
Luis Alfonso Hoyos
Luis Alfonso Hoyos
Luis Alfonso Hoyos
Luis Alfonso Hoyos
Luis Alfonso Hoyos
male
1971-10-29
Luis
politician
Luis Alfonso Hoyos
Q5881263
Gloria Inés Ramírez
Gloria Inés Ramírez
Gloria Inés Ramírez
Gloria Inés Ramírez
Gloria Inés Ramírez
Gloria Inés Ramírez
Gloria Inés Ramírez
female
1956
Gloria
politician
Gloria Inés Ramírez
Q5936257
Jorge Visbal Martelo
Jorge Visbal Martelo
Jorge Visbal Martelo
Jorge Visbal Martelo
Jorge Visbal Martelo
Jorge Visbal Martelo
Jorge Visbal Martelo
male
1953-06-26
Jorge
Jorge Visbal Martelo
Jorge Visbal Martelo
Visbal
diplomat
Jorge Visbal Martelo
Q5663451
Alberto Pumarejo
Alberto Pumarejo
Alberto Pumarejo
Alberto Pumarejo
Alberto Pumarejo
Alberto Pumarejo
male
1893-05-02
Alberto
Alberto Pumarejo
1970-08-14
Alberto Pumarejo
lawyer
Alberto Pumarejo
Q5654865
Luis Fernando Velasco
Luis Fernando Velasco
Luis Fernando Velasco
Luis Fernando Velasco
Luis Fernando Velasco
Luis Fernando Velasco
Luis Fernando Velasco
male
1964-10-18
Luis
Luis Fernando Velasco
Category:Luis Fernando Velasco
politician
Luis Fernando Velasco
Q20994998
Santa Lopesierra
Santa Lopesierra
Santa Lopesierra
Santa Lopesierra
male
1961-11-16
economist
Q18417131
Nadya Georgette Blel Scaff
Nadya Blel
Nadia Blel
Nadia Georgette Blel Scaff
Nadia Georgette Blel Scaff
Nadya Georgette Blel Scaff
female
1981-08-11
Nadia
nadiablel
nadia.blel
politician
Nadia Georgette Blel Scaff
Q5923431
Iván Díaz
Iván Díaz
Iván Díaz
Iván Díaz
Iván Díaz
Iván Díaz
Iván Díaz Mateus
male
1962
Iván
politician
Iván Díaz
Q8354084
David Char
David Char Navas
David Char Navas
David Char
David Char
David Char
David Char
male
David
David Char Navas
David Char Navas
politician
David Char

Statistics

Average successful run time: 2 minutes

Total run time: about 21 hours

Total cpu time used: about 2 hours

Total disk space used: 284 KB

History

  • Auto ran revision cf841dd9 and completed successfully .
    308 records updated in the database
    27 pages scraped
  • Auto ran revision cf841dd9 and completed successfully .
    1 record added, 307 records updated in the database
    27 pages scraped
  • Auto ran revision cf841dd9 and completed successfully .
    306 records updated in the database
    27 pages scraped
  • Auto ran revision cf841dd9 and completed successfully .
    307 records updated in the database
    27 pages scraped
  • Auto ran revision cf841dd9 and completed successfully .
    307 records updated in the database
    27 pages scraped
  • ...
  • Created on morph.io

Show complete history