tmtmtmtm / brasil-deputados-wikidata

Scrapes pt.wikipedia.org, query.wikidata.org, www.wikidata.org, and 1 other domain

Wikipédia, a enciclopédia livre


Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing coderay 1.1.2  Fetching colorize 0.8.1  Installing colorize 0.8.1  Fetching concurrent-ruby 1.0.5  Installing activesupport-inflector 0.1.0  Installing ast 2.3.0  Fetching diskcached 1.1.3  Installing concurrent-ruby 1.0.5  Fetching unf_ext 0.0.7.4  Installing diskcached 1.1.3  Fetching require_all 1.5.0  Installing require_all 1.5.0  Installing unf_ext 0.0.7.4 with native extensions  Fetching excon 0.60.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Installing excon 0.60.0  Fetching hashie 3.5.7  Installing hashie 3.5.7  Fetching httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Installing httpclient 2.8.3  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.4.0.2  Installing parser 2.4.0.2  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching i18n 0.9.3  Installing i18n 0.9.3  Fetching faraday 0.14.0  Installing faraday 0.14.0  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching rubocop 0.52.1  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@363f7ab)  Installing rubocop 0.52.1  Fetching faraday_middleware 0.12.2  Installing faraday_middleware 0.12.2  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing wikidata-client 0.0.12  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing faraday-cookie_jar 0.0.6  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@a2938a6)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (36.63s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Can't find Wikidata IDs for: Raimundo Matos in pt ‼ Q20061311 is_instance_of political party. Skipping ‼ Q3366694 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q1414708 is_instance_of political party. Skipping ‼ Q926973 is_instance_of political party. Skipping ‼ Q1234489 is_instance_of political party. Skipping ‼ Q732852 is_instance_of political party & Wikimedia duplicated page. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10304982 ‼ Q15564211 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q549835 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q9074685 ‼ Q43883004 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q1322897 is_instance_of political party. Skipping ‼ Q429972 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q18246320 ‼ Q3366792 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10308833 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10270650 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10304402 ‼ Q2054789 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q6701512 ‼ Q504000 is_instance_of communist party. Skipping Unknown value for P735 for Q10263803 ‼ Q2598527 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q384804 ‼ Q2731720 is_instance_of political party. Skipping ‼ Q1185830 is_instance_of political party. Skipping ‼ Q1322751 is_instance_of political party. Skipping ‼ Q10341139 is_instance_of . Skipping ‼ Q1576143 is_instance_of political party. Skipping ‼ Q657089 is_instance_of political party. Skipping ‼ Q1754827 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q519210 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q9746700 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3538 for Q178649 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3668 for Q178649 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q178649 ‼ Q2626213 is_instance_of political party. Skipping ‼ Q2054750 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4060 for Q953573 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3668 for Q953573

Data

Downloaded 1134 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (602 KB) Use the API

rows 10 / 751

id name__bg name__pt name__en name__de name__nb name__da name__nn name__sv name wikipedia__bg wikipedia__pt gender given_name original_wikiname name__es name__nl name__fr wikipedia__commons wikipedia__en wikipedia__es birth_date identifier__freebase image name__it name__pt_br wikipedia__de wikipedia__fr name__tw name__la name__war wikipedia__it wikipedia__la wikipedia__tw wikipedia__war identifier__VIAF name__he name__yue wikipedia__he wikipedia__zh_yue website family_name identifier__BNF identifier__SUDOC identifier__FAST name__eo wikipedia__eo name__pl wikipedia__pl wikipedia__sv wikipedia__ptwikiquote identifier__LCAuth name__ru name__yo wikipedia__ru wikipedia__yo name__fa wikipedia__fa name__ca name__gl name__ja name__fi name__cs wikipedia__cs wikipedia__fi wikipedia__ja wikipedia__no name__eml name__lmo wikipedia__eml wikipedia__gl wikipedia__lmo identifier__IMDB identifier__MusicBrainz name__sw wikipedia__nl wikipedia__simple wikipedia__sw identifier__ISNI identifier__GND identifier__allmovie name__el name__hu last_seen name__ko twitter instagram name__sco wikipedia__sco wikipedia__eowikiquote second_surname name__zh name__ro name__id name__lt name__ar wikipedia__ar wikipedia__ca wikipedia__id wikipedia__lt wikipedia__ro name__cy death_date name__mwl wikipedia__mwl name__zh_hans name__zh_hant name__zh_hk name__zh_cn name__zh_sg name__zh_tw name__qu name__be name__lv name__bn name__vi name__sk name__mn name__sr_el name__sr_ec name__tr name__th name__uk name__sl name__sgs name__ka name__az name__hr name__sr name__br name__mg name__sh name__io name__de_ch name__en_ca name__en_gb name__hy name__ms wikipedia__az wikipedia__bat_smg wikipedia__be wikipedia__bn wikipedia__br wikipedia__cswikiquote wikipedia__da wikipedia__el wikipedia__enwikiquote wikipedia__eswikiquote wikipedia__hr wikipedia__hu wikipedia__hy wikipedia__io wikipedia__itwikiquote wikipedia__ka wikipedia__ko wikipedia__lv wikipedia__mg wikipedia__mn wikipedia__ms wikipedia__nn wikipedia__plwikiquote wikipedia__qu wikipedia__sh wikipedia__sk wikipedia__sl wikipedia__slwikiquote wikipedia__sr wikipedia__th wikipedia__tr wikipedia__uk wikipedia__vi wikipedia__zh facebook name__af name__an name__ast name__bar name__bm name__co name__de_at name__et name__eu name__frc name__frp name__fur name__ga name__gd name__gsw name__ia name__ie name__jam name__kab name__kg name__lb name__li name__lij name__min name__nap name__nds name__nds_nl name__nrm name__oc name__pap name__pcd name__pms name__prg name__rgn name__rm name__sc name__scn name__vec name__vls name__vmf name__vo name__wa name__wo name__zu identifier__BNE identifier__filmportal_de identifier__OLID identifier__AlloCine identifier__elonet identifier__PORT identifier__kinopoisk identifier__CSFD identifier__DNF identifier__NNDB wikipedia__hywikiquote occupation wikipedia__et name__is identifier__quora identifier__google_knowledge identifier__songkick wikipedia__mk name__mk identifier__PTBNP name__ace name__tg wikipedia__tg wikipedia__azb identifier__FIFA identifier__youtube name__azb identifier__bigenc_ru wikipedia__ast identifier__Britannica identifier__GNC name__ne name__mai name__bho identifier__NTA identifier__GTAA
Q16336322
Alex Manente
Alex Manente
Alex Manente
Alex Manente
Alex Manente
male
Alex
Alex Manente
Alex Manente
Category:Alex Manente
1979-08-22
AlexManentePPS
Alex Manente
politician
Q25175923
Danilo Jorge de Barros Cabral
Danilo Jorge de Barros Cabral
Danilo Jorge de Barros Cabral
male
Danilo Jorge de Barros Cabral
Danilo Jorge de Barros Cabral
1967-04-21
Q10348756
Perpétua Almeida
Perpétua Almeida
Perpétua Almeida
Perpétua Almeida
Perpétua Almeida
Perpétua Almeida
Perpétua Almeida
Perpétua Almeida
Perpétua Almeida
female
Perpétua Almeida
Perpétua Almeida
1964-12-28
Perpétua Almeida
politician
Q7351701
Roberto Freire
Roberto Freire
Roberto Freire
Roberto Freire
Roberto Freire (político)
male
Roberto
Roberto João Pereira Freire
Roberto Freire
Roberto Freire
Roberto Freire
Category:Roberto Freire
Roberto Freire
Roberto Freire (político)
1942-04-20
115974063
081790171
Roberto Freire
Roberto João Pereira Freire
Roberto Freire
Roberto Freire
lawyer
Q48871856
José Geraldo Torres
José Geraldo Torres
José Geraldo Torres
José Geraldo Torres
Q20046141
Ricardo Teobaldo
Ricardo Teobaldo
Ricardo Teobaldo
male
Ricardo
Ricardo Teobaldo
politician
Q9086139
Teresa Surita
Teresa Surita
Teresa Surita
Teresa Surita
Teresa Surita
Teresa Surita
Teresa Surita
Teresa Surita
Teresa Surita
female
Teresa
Teresa Jucá
Teresa Surita
Teresa Surita
Teresa Surita
Category:Teresa Surita
Teresa Surita
Teresa Surita
1956-08-14
/m/0j3fxmv
Teresa Surita
טריסה סוריטה
Teresa Surita
Teresa Surita
teresasurita
Teresa Surita
politician
Q21290171
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
male
André
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
Category:André Figueiredo
1966-11-10
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
André Figueiredo
politician
Q23822823
João Arruda
João Arruda
João Arruda
male
João
João Arruda
João Arruda
Category:João Arruda
1976-05-22
https://upload.wikimedia.org/wikipedia/commons/e/eb/Plenário_do_Senado_(22532604261).jpg
politician
Q18707951
Floriano Pesaro
Floriano Pesaro
Floriano Pesaro
male
Floriano
Floriano Pesaro
Category:Floriano Pesaro
1968-04-14
https://upload.wikimedia.org/wikipedia/commons/c/cb/Floriano_Pesaro,_Secretário_de_Desenvolvimento_Social.jpg
Floriano Pesaro

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (602 KB) Use the API

rows 10 / 269

id last_seen
Q1507594
2016-04-03
Q9644523
2016-06-05
Q20045978
2016-06-05
Q9654172
2016-06-05
Q10364343
2016-06-05
Q520653
2016-06-05
Q10286912
2016-06-05
Q10308879
2016-06-05
Q10268879
2016-06-05
Q16336306
2016-06-05

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: about 2 hours

Total disk space used: 642 KB

History

  • Auto ran revision bb42043d and completed successfully .
    750 records updated in the database
    58 pages scraped
  • Auto ran revision bb42043d and completed successfully .
    748 records updated in the database
    58 pages scraped
  • Auto ran revision bb42043d and completed successfully .
    750 records updated in the database
  • Auto ran revision bb42043d and completed successfully .
    751 records updated in the database
  • Auto ran revision bb42043d and completed successfully .
    751 records updated in the database
  • ...
  • Created on morph.io

Show complete history