tmtmtmtm / brasil-deputados-wikidata

Scrapes pt.wikipedia.org, query.wikidata.org, www.wikidata.org, and 1 other domain

Wikipédia, a enciclopédia livre


Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/..  Fetching dependency metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/everypolitician-ruby.git  Fetching https://github.com/openc/sqlite_magic.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching https://github.com/everypolitician/wikisnakker.git  Fetching https://github.com/everypolitician/wikidata-fetcher.git  Fetching activesupport-inflector 0.1.0  Fetching ast 2.3.0  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing ast 2.3.0  Installing activesupport-inflector 0.1.0  Installing coderay 1.1.2  Fetching colorize 0.8.1  Fetching concurrent-ruby 1.0.5  Fetching diskcached 1.1.3  Installing concurrent-ruby 1.0.5  Installing diskcached 1.1.3  Fetching unf_ext 0.0.7.4  Installing colorize 0.8.1  Fetching require_all 1.5.0  Fetching excon 0.60.0  Installing excon 0.60.0  Installing require_all 1.5.0  Fetching multipart-post 2.0.0  Installing multipart-post 2.0.0  Fetching hashie 3.5.7  Installing unf_ext 0.0.7.4 with native extensions  Installing hashie 3.5.7  Fetching httpclient 2.8.3  Fetching json 2.1.0  Installing httpclient 2.8.3  Installing json 2.1.0 with native extensions  Fetching method_source 0.9.0  Installing method_source 0.9.0  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching netrc 0.11.0  Installing netrc 0.11.0  Fetching open-uri-cached 0.0.5  Installing open-uri-cached 0.0.5  Fetching parallel 1.12.1  Installing parallel 1.12.1  Fetching powerpack 0.1.1  Installing powerpack 0.1.1  Fetching rainbow 3.0.0  Installing rainbow 3.0.0  Fetching ruby-progressbar 1.9.0  Installing ruby-progressbar 1.9.0  Fetching unicode-display_width 1.3.0  Installing unicode-display_width 1.3.0  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Fetching yajl-ruby 1.3.1  Installing yajl-ruby 1.3.1 with native extensions  Fetching parser 2.4.0.2  Installing parser 2.4.0.2  Fetching i18n 0.9.3  Installing i18n 0.9.3  Fetching everypolitician-popolo 0.8.0  Installing everypolitician-popolo 0.8.0  Fetching faraday 0.14.0  Installing faraday 0.14.0  Fetching pry 0.11.3  Installing pry 0.11.3  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Using wikisnakker 0.9.1 from https://github.com/everypolitician/wikisnakker.git (at master@72dbb8b)  Fetching rubocop 0.52.1  Installing rubocop 0.52.1  Using everypolitician 0.20.0 from https://github.com/everypolitician/everypolitician-ruby.git (at master@363f7ab)  Fetching faraday_middleware 0.12.2  Using sqlite_magic 0.0.6 from https://github.com/openc/sqlite_magic.git (at master@4df975e)  Fetching domain_name 0.5.20170404  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Installing faraday_middleware 0.12.2  Installing domain_name 0.5.20170404  Fetching wikidata-client 0.0.12  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching faraday-cookie_jar 0.0.6  Fetching rest-client 2.0.2  Installing wikidata-client 0.0.12  Installing faraday-cookie_jar 0.0.6  Fetching mediawiki_api 0.7.1  Installing rest-client 2.0.2  Installing mediawiki_api 0.7.1  Using wikidata-fetcher 0.21.0 from https://github.com/everypolitician/wikidata-fetcher.git (at master@a2938a6)  Bundle complete! 14 Gemfile dependencies, 47 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (37.66s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.0). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Can't find Wikidata IDs for: Raimundo Matos in pt ‼ Q1754827 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q6701512 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3538 for Q178649 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3668 for Q178649 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3219 for Q178649 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4060 for Q178649 ‼ Q1322751 is_instance_of political party. Skipping ‼ Q2054789 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q9746700 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10270650 ‼ Q2598527 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q18246320 ‼ Q429972 is_instance_of political party. Skipping ‼ Q926973 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10304402 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q9074685 ‼ Q1576143 is_instance_of political party. Skipping ‼ Q3366792 is_instance_of political party. Skipping ‼ Q10341139 is_instance_of . Skipping ‼ Q1414708 is_instance_of political party. Skipping ‼ Q657089 is_instance_of political party. Skipping ‼ Q2054750 is_instance_of political party. Skipping ‼ Q2731720 is_instance_of political party. Skipping ‼ Q1322897 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P4060 for Q953573 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P3668 for Q953573 ‼ Q15564211 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10308833 ‼ Q1185830 is_instance_of political party. Skipping ‼ Q2626213 is_instance_of political party. Skipping Unknown value for P735 for Q10263803 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q10304982 ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q519210 ‼ Q732852 is_instance_of political party & Wikimedia duplicated page. Skipping ‼ Q43883004 is_instance_of Wikimedia disambiguation page. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q549835 ‼ Q20061311 is_instance_of political party. Skipping ⁇ Unknown property: https://www.wikidata.org/wiki/Property:P2731 for Q384804 ‼ Q1234489 is_instance_of political party. Skipping ‼ Q504000 is_instance_of communist party. Skipping ‼ Q3366694 is_instance_of Wikimedia disambiguation page. Skipping

Data

Downloaded 1223 times by everypolitician MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (614 KB) Use the API

rows 10 / 751

id name__bg name__pt name__en name__de name__nb name__da name__nn name__sv name wikipedia__bg wikipedia__pt gender given_name original_wikiname name__es name__nl name__fr wikipedia__commons wikipedia__en wikipedia__es birth_date identifier__freebase image name__it name__pt_br wikipedia__de wikipedia__fr name__tw name__la name__war wikipedia__it wikipedia__la wikipedia__tw wikipedia__war identifier__VIAF name__he name__yue wikipedia__he wikipedia__zh_yue website family_name identifier__BNF identifier__SUDOC identifier__FAST name__eo wikipedia__eo name__pl wikipedia__pl wikipedia__sv wikipedia__ptwikiquote identifier__LCAuth name__ru name__yo wikipedia__ru wikipedia__yo name__fa wikipedia__fa name__ca name__gl name__ja name__fi name__cs wikipedia__cs wikipedia__fi wikipedia__ja wikipedia__no name__eml name__lmo wikipedia__eml wikipedia__gl wikipedia__lmo identifier__IMDB identifier__MusicBrainz name__sw wikipedia__nl wikipedia__simple wikipedia__sw identifier__ISNI identifier__GND identifier__allmovie name__el name__hu last_seen name__ko twitter instagram name__sco wikipedia__sco wikipedia__eowikiquote second_surname name__zh name__ro name__id name__lt name__ar wikipedia__ar wikipedia__ca wikipedia__id wikipedia__lt wikipedia__ro name__cy death_date name__mwl wikipedia__mwl name__zh_hans name__zh_hant name__zh_hk name__zh_cn name__zh_sg name__zh_tw name__qu name__be name__lv name__bn name__vi name__sk name__mn name__sr_el name__sr_ec name__tr name__th name__uk name__sl name__sgs name__ka name__az name__hr name__sr name__br name__mg name__sh name__io name__de_ch name__en_ca name__en_gb name__hy name__ms wikipedia__az wikipedia__bat_smg wikipedia__be wikipedia__bn wikipedia__br wikipedia__cswikiquote wikipedia__da wikipedia__el wikipedia__enwikiquote wikipedia__eswikiquote wikipedia__hr wikipedia__hu wikipedia__hy wikipedia__io wikipedia__itwikiquote wikipedia__ka wikipedia__ko wikipedia__lv wikipedia__mg wikipedia__mn wikipedia__ms wikipedia__nn wikipedia__plwikiquote wikipedia__qu wikipedia__sh wikipedia__sk wikipedia__sl wikipedia__slwikiquote wikipedia__sr wikipedia__th wikipedia__tr wikipedia__uk wikipedia__vi wikipedia__zh facebook name__af name__an name__ast name__bar name__bm name__co name__de_at name__et name__eu name__frc name__frp name__fur name__ga name__gd name__gsw name__ia name__ie name__jam name__kab name__kg name__lb name__li name__lij name__min name__nap name__nds name__nds_nl name__nrm name__oc name__pap name__pcd name__pms name__prg name__rgn name__rm name__sc name__scn name__vec name__vls name__vmf name__vo name__wa name__wo name__zu identifier__BNE identifier__filmportal_de identifier__OLID identifier__AlloCine identifier__elonet identifier__PORT identifier__kinopoisk identifier__CSFD identifier__DNF identifier__NNDB wikipedia__hywikiquote occupation wikipedia__et name__is identifier__quora identifier__google_knowledge identifier__songkick wikipedia__mk name__mk identifier__PTBNP name__ace name__tg wikipedia__tg wikipedia__azb identifier__FIFA identifier__youtube name__azb identifier__bigenc_ru wikipedia__ast identifier__Britannica identifier__GNC name__ne name__mai name__bho identifier__NTA identifier__GTAA
Q23892859
Benjamin Maranhão
Benjamin Maranhão
Benjamin Maranhão
Benjamin Maranhão
male
Benjamin
Benjamin Gomes Maranhão Neto
Benjamin Maranhão
Benjamin Maranhão
Benjamin Maranhão
politician
Q16336389
Aline Corrêa
Aline Corrêa
Aline Corrêa
Aline Corrêa
Aline Corrêa
female
Aline
Aline Lemos Corrêa de Oliveira Andrade
1973-03-25
politician
Q23893572
Beto Rosado
Beto Rosado
Beto Rosado
Beto Rosado
male
Beto
Beto Rosado
Beto Rosado
Beto Rosado
1982-02-01
https://upload.wikimedia.org/wikipedia/commons/d/d0/Beto_Rosado._Foto_Gabriela_Korossy,_Agência_Câmara.jpg
Beto Rosado
politician
Q20046015
Marcos Abrão
Marcos Abrão
Marcos Abrão
male
Marcos
Marcos Abrão
Marcos Abrão
1971-02-15
politician
Q24691762
Julião Amin
Julião Amin
Julião Amin
Julião Amin Castro
male
Julião Amin
Julião Amin
1946-10-01
https://upload.wikimedia.org/wikipedia/commons/9/96/CDH_-_Comissão_de_Direitos_Humanos_e_Legislação_Participativa_(24147058374).jpg
politician
Q16337777
Lourival Mendes
Lourival Mendes
Lourival Mendes
Lourival Mendes
Lourival Mendes
male
Lourival
Lourival Mendes
Lourival Mendes
1955-03-27
Lourival Mendes
politician
Q3179810
Yeda Crusius
Yeda Crusius
Yeda Crusius
Yeda Crusius
Yeda Crusius
Yeda Crusius
Yeda Crusius
Yeda Crusius
Yeda Crusius
female
Yeda Crusius
Yeda Crusius
Yeda Crusius
Yeda Crusius
Category:Yeda Crusius
Yeda Crusius
Yeda Crusius
1944
/m/02pq0yh
Yeda Crusius
Yeda Crusius
Yeda Crusius
Yeda Crusius
0000 0000 4095 3931
Yeda Crusius
Yeda Crusius
Йєда Красіус
Yeda Crusius
Йєда Красіус
economist
Q10363835
Rodrigo Batista de Castro
Rodrigo Batista de Castro
Rodrigo Batista de Castro
Rodrigo Batista de Castro
Rodrigo Batista de Castro
Rodrigo Batista de Castro
Rodrigo Batista de Castro
male
Rodrigo
Rodrigo Batista de Castro
Rodrigo Batista de Castro
Rodrigo Batista de Castro
1971-07-15
Rodrigo Batista de Castro
Rodrigo Batista de Castro
Rodrigo Batista de Castro
politician
Q6701512
Luiza Erundina
Luiza Erundina
Luiza Erundina
Luiza Erundina
Luiza Erundina
Luiza Erundina
Luiza Erundina
Luiza Erundina
Luiza Erundina
female
Luiza
Luiza Erundina
Luiza Erundina
Luiza Erundina
Luiza Erundina
Category:Luiza Erundina
Luiza Erundina
Luiza Erundina
1934-11-30
/m/05m1z6
Luiza Erundina
Luiza Erundina
Luiza Erundina
Luiza Erundina de Souza
Ludovica Erundina
Luiza Erundina
Luiza Erundina
Ludovica Erundina
Luiza Erundina de Souza
Luiza Erundina
10658244
Luiza Erundina
Luiza Erundina
0000 0000 5837 1032
119535068
Luiza Erundina
Luiza Erundina
politician
97482
Q10346741
Paulo Pereira da Silva
Paulo Pereira da Silva
Paulo Pereira da Silva
Paulo Pereira da Silva
Paulo Pereira da Silva
male
Paulo
Paulinho da Força
Paulo Pereira da Silva
Category:Paulo Pereira da Silva
Paulo Pereira da Silva
1956-01-25
https://upload.wikimedia.org/wikipedia/commons/7/7c/Paulinho_Força_Sindical.jpeg
Paulo Pereira da Silva
Paulo Pereira da Silva
Paulo Pereira da Silva
politician

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (614 KB) Use the API

rows 10 / 269

id last_seen
Q1507594
2016-04-03
Q9644523
2016-06-05
Q20045978
2016-06-05
Q9654172
2016-06-05
Q10364343
2016-06-05
Q520653
2016-06-05
Q10286912
2016-06-05
Q10308879
2016-06-05
Q10268879
2016-06-05
Q16336306
2016-06-05

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: about 2 hours

Total disk space used: 654 KB

History

  • Auto ran revision bb42043d and completed successfully .
    750 records updated in the database
    59 pages scraped
  • Auto ran revision bb42043d and completed successfully .
    751 records updated in the database
    59 pages scraped
  • Auto ran revision bb42043d and failed .
    nothing changed in the database
  • Auto ran revision bb42043d and completed successfully .
    748 records updated in the database
    59 pages scraped
  • Auto ran revision bb42043d and completed successfully .
    750 records updated in the database
  • ...
  • Created on morph.io

Show complete history