tmtmtmtm / brasil-deputados-wikidata

Scrapes pt.wikipedia.org, query.wikidata.org, www.wikidata.org, and 1 other domain

Wikipédia, a enciclopédia livre


Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing ast 2.3.0  Installing activesupport-inflector 0.1.0  Fetching colorize 0.8.1  Installing coderay 1.1.2  Fetching concurrent-ruby 1.0.5  Installing colorize 0.8.1  Fetching diskcached 1.1.3  Installing concurrent-ruby 1.0.5  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Fetching require_all 1.5.0  Installing require_all 1.5.0  Fetching excon 0.60.0  Installing unf_ext 0.0.7.4 with native extensions  Fetching multipart-post 2.0.0  Installing excon 0.60.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.7  Installing hashie 3.5.7  Fetching httpclient 2.8.3  Fetching json 2.1.0  Installing json 2.1.0 with native extensions  Installing httpclient 2.8.3  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.4.0.2  Installing parser 2.4.0.2  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching i18n 0.9.3  Installing i18n 0.9.3  Fetching faraday 0.14.0  Installing faraday 0.14.0  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching rubocop 0.52.1  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@363f7ab)  Installing rubocop 0.52.1  Fetching faraday_middleware 0.12.2  Installing faraday_middleware 0.12.2  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching wikidata-client 0.0.12  Installing domain_name 0.5.20170404  Installing wikidata-client 0.0.12  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Installing faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing rest-client 2.0.2  Fetching mediawiki_api 0.7.1  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@a2938a6)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (34.32s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Can't find Wikidata IDs for: Raimundo Matos in pt ‼ Q926973 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q6701512 ‼ Q429972 is_instance_of political party. Skipping ‼ Q3366792 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q549835 ‼ Q171257 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q1414708 is_instance_of political party. Skipping ‼ Q15564211 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10270650 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10308833 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q519210 ‼ Q1576143 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q384804 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3538 for Q178649 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3668 for Q178649 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q178649 ‼ Q657089 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q9746700 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10304402 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q9074685 ‼ Q1322751 is_instance_of political party. Skipping ‼ Q2054750 is_instance_of political party. Skipping ‼ Q1322897 is_instance_of political party. Skipping Unknown value for P735 for Q10263803 ‼ Q732852 is_instance_of political party & Wikimedia duplicated page. Skipping ‼ Q1185830 is_instance_of political party. Skipping ‼ Q2626213 is_instance_of political party. Skipping ‼ Q504000 is_instance_of communist party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q18246320 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4060 for Q953573 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3668 for Q953573 ‼ Q2598527 is_instance_of political party. Skipping ‼ Q2731720 is_instance_of political party. Skipping ‼ Q20061311 is_instance_of political party. Skipping ‼ Q3366694 is_instance_of Wikimedia disambiguation page. Skipping ‼ Q2054789 is_instance_of political party. Skipping ‼ Q1754827 is_instance_of political party. Skipping ‼ Q1234489 is_instance_of political party. Skipping ‼ Q43883004 is_instance_of Wikimedia disambiguation page. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10304982

Data

Downloaded 1012 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (569 KB) Use the API

rows 10 / 746

id name__bg name__pt name__en name__de name__nb name__da name__nn name__sv name wikipedia__bg wikipedia__pt gender given_name original_wikiname name__es name__nl name__fr wikipedia__commons wikipedia__en wikipedia__es birth_date identifier__freebase image name__it name__pt_br wikipedia__de wikipedia__fr name__tw name__la name__war wikipedia__it wikipedia__la wikipedia__tw wikipedia__war identifier__VIAF name__he name__yue wikipedia__he wikipedia__zh_yue website family_name identifier__BNF identifier__SUDOC identifier__FAST name__eo wikipedia__eo name__pl wikipedia__pl wikipedia__sv wikipedia__ptwikiquote identifier__LCAuth name__ru name__yo wikipedia__ru wikipedia__yo name__fa wikipedia__fa name__ca name__gl name__ja name__fi name__cs wikipedia__cs wikipedia__fi wikipedia__ja wikipedia__no name__eml name__lmo wikipedia__eml wikipedia__gl wikipedia__lmo identifier__IMDB identifier__MusicBrainz name__sw wikipedia__nl wikipedia__simple wikipedia__sw identifier__ISNI identifier__GND identifier__allmovie name__el name__hu last_seen name__ko twitter instagram name__sco wikipedia__sco wikipedia__eowikiquote second_surname name__zh name__ro name__id name__lt name__ar wikipedia__ar wikipedia__ca wikipedia__id wikipedia__lt wikipedia__ro name__cy death_date name__mwl wikipedia__mwl name__zh_hans name__zh_hant name__zh_hk name__zh_cn name__zh_sg name__zh_tw name__qu name__be name__lv name__bn name__vi name__sk name__mn name__sr_el name__sr_ec name__tr name__th name__uk name__sl name__sgs name__ka name__az name__hr name__sr name__br name__mg name__sh name__io name__de_ch name__en_ca name__en_gb name__hy name__ms wikipedia__az wikipedia__bat_smg wikipedia__be wikipedia__bn wikipedia__br wikipedia__cswikiquote wikipedia__da wikipedia__el wikipedia__enwikiquote wikipedia__eswikiquote wikipedia__hr wikipedia__hu wikipedia__hy wikipedia__io wikipedia__itwikiquote wikipedia__ka wikipedia__ko wikipedia__lv wikipedia__mg wikipedia__mn wikipedia__ms wikipedia__nn wikipedia__plwikiquote wikipedia__qu wikipedia__sh wikipedia__sk wikipedia__sl wikipedia__slwikiquote wikipedia__sr wikipedia__th wikipedia__tr wikipedia__uk wikipedia__vi wikipedia__zh facebook name__af name__an name__ast name__bar name__bm name__co name__de_at name__et name__eu name__frc name__frp name__fur name__ga name__gd name__gsw name__ia name__ie name__jam name__kab name__kg name__lb name__li name__lij name__min name__nap name__nds name__nds_nl name__nrm name__oc name__pap name__pcd name__pms name__prg name__rgn name__rm name__sc name__scn name__vec name__vls name__vmf name__vo name__wa name__wo name__zu identifier__BNE identifier__filmportal_de identifier__OLID identifier__AlloCine identifier__elonet identifier__PORT identifier__kinopoisk identifier__CSFD identifier__DNF identifier__NNDB wikipedia__hywikiquote occupation wikipedia__et name__is identifier__quora identifier__google_knowledge identifier__songkick wikipedia__mk name__mk identifier__PTBNP name__ace name__tg wikipedia__tg wikipedia__azb identifier__FIFA identifier__youtube name__azb
Q18243754
Christiane Yared
Christiane Yared
Christiane Yared
female
Christiane
Christiane Yared
1960-02-23
https://upload.wikimedia.org/wikipedia/commons/d/d6/CDH_-_Comissão_de_Direitos_Humanos_e_Legislação_Participativa_(25688527473).jpg
politician
Q10336092
Nelson Marchezan Júnior
Nelson Marchezan Júnior
Nelson Marchezan Júnior
Nelson Marchezan Júnior
Nelson Marchezan Júnior
male
Nelson
Nelson Marchezan Júnior
Nelson Marchezan Júnior
1971-11-30
https://upload.wikimedia.org/wikipedia/commons/4/44/Deputado_Nelson_Marchezan_Júnior.jpg
marchezan_
politician
Q28028883
Pollyana Gama
Pollyana Gama
Pollyana Gama
female
1975-05-13
politician
Q23905404
Izalci Lucas Ferreira
Izalci Lucas Ferreira
Izalci Lucas
male
Izalci Lucas Ferreira
Izalci Lucas Ferreira
Category:Izalci Lucas
1956-04-07
izalci
politician
Q30931741
Genecias Noronha
Genecias Noronha
Genecias Noronha
Genecias Noronha
Genecias Noronha
1963-03-16
politician
Q10390275
Vicente Paulo da Silva
Vicente Paulo da Silva
Vicente Paulo da Silva
Vicente Paulo da Silva
Vicente Paulo da Silva
Vicente Paulo da Silva
Vicente Paulo da Silva
male
Vicente
Vicentinho
Vicente Paulo da Silva
Vicente Paulo da Silva
Category:Vicente Paulo da Silva
1956-04-08
Vicente Paulo da Silva
Vicente Paulo da Silva
Vicente Paulo da Silva
Vicente Paulo da Silva
politician
Q28555860
Tadeu Alencar
Tadeu Alencar
Tadeu Alencar
Tadeu Alencar
male
Tadeu
Tadeu Alencar
Tadeu Alencar
1963-04-08
politician
Q10367339
Samuel Moreira
Samuel Moreira
Samuel Moreira
Samuel Moreira
Samuel Moreira
Samuel Moreira
Samuel Moreira
Samuel Moreira
Samuel Moreira
male
Samuel
Samuel Moreira
Samuel Moreira
Samuel Moreira
Samuel Moreira
Q10282292
Filipe de Almeida Pereira
Filipe de Almeida Pereira
Filipe de Almeida Pereira
Filipe de Almeida Pereira
Filipe de Almeida Pereira
male
Filipe
Filipe de Almeida Pereira
Filipe de Almeida Pereira
Filipe de Almeida Pereira
Filipe de Almeida Pereira
politician
Q16939730
Cezar Silvestre
Cezar Silvestre
Cezar Silvestre
Cezar Silvestre
Cezar Silvestre
male
Cezar
Cezar Silvestre
Cezar Silvestre
1954-08-01
Cezar Silvestre
Cezar Silvestre
politician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (569 KB) Use the API

rows 10 / 269

id last_seen
Q1507594
2016-04-03
Q9644523
2016-06-05
Q20045978
2016-06-05
Q9654172
2016-06-05
Q10364343
2016-06-05
Q520653
2016-06-05
Q10286912
2016-06-05
Q10308879
2016-06-05
Q10268879
2016-06-05
Q16336306
2016-06-05

Statistics

Average successful run time: 2 minutes

Total run time: about 23 hours

Total cpu time used: about 2 hours

Total disk space used: 609 KB

History

  • Auto ran revision bb42043d and completed successfully .
    744 records updated in the database
    58 pages scraped
  • Auto ran revision bb42043d and completed successfully .
    42 records added, 703 records updated in the database
    58 pages scraped
  • Auto ran revision bb42043d and completed successfully .
    704 records updated in the database
    57 pages scraped
  • Auto ran revision bb42043d and completed successfully .
    1 record added, 701 records updated in the database
    57 pages scraped
  • Auto ran revision bb42043d and completed successfully .
    703 records updated in the database
  • ...
  • Created on morph.io

Show complete history