everypolitician-scrapers

everypolitician-scrapers

everypolitician-scrapers on GitHub

Members

chrismytton tmtmtmtm davewhiteland octopusinvitro ondenman mhl everypoliticianbot

122 scrapers

Ruby
dominican-republic-deputies-wikidata
https://morph.io/tmtmtmtm/dominican-republic-deputies-wikidata

raw.githubusercontent.com, cdn.rawgit.com, en.wikipedia.org

Ruby
korea-assembly

github.com, korea.assembly.go.kr, www.assembly.go.kr

Ruby
errored aland-lagting

www.lagtinget.ax

Ruby
errored twitter-mexico-diputados-friends
Scraping member accounts of Mexican Chamber of Deputies, who are all friends of the official Chamber on twitter

api.twitter.com

Ruby
errored twitter-finland
Ruby
errored twitter-list-el-salvador

api.twitter.com

Ruby
errored twitter-ireland-donie
Scraper to run through a Twitter List of Irish politicians

api.twitter.com

Ruby
errored austria-parlament

github.com, www.parlament.gv.at

Ruby
errored afghanistan-assembly

github.com, wolesi.website

Ruby
errored syria-peoples-council
Ruby
errored samoa-parliament
Ruby
errored croatia-parliament

github.com, www.sabor.hr

Ruby
twitter-list-croatia

api.twitter.com

Ruby
new-zealand-parliament-wikipedia

en.wikipedia.org

Ruby
french-assembly-twitter-list-scraper
Ruby
zambia-na-scraper

www.parliament.gov.zm

Ruby
slovakia-national-assembly-2016

github.com, www.nrsr.sk

Ruby
belarus-house-of-representatives-2016
scraper for Belarus House of Representatives, 2016 term

github.com, house.gov.by

Ruby
twitter-australia-senate

api.twitter.com

Ruby
laos-national-assembly-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
croatian-parliament-wikidata

en.wikipedia.org, sh.wikipedia.org, sr.wikipedia.org, and 2 others

Ruby
morocco-representatives-wikidata

fr.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
guernsey-2016
Scraper for the updated Guernsey site. Scrapes members of the 2016 term.

github.com, gov.gg

Ruby
twitter-israel

api.twitter.com

Ruby
twitter-list-canada

api.twitter.com

Ruby
mexico-deputies-wikidata
https://morph.io/everypolitician-scrapers/mexico-deputies-wikidata

api.morph.io, en.wikipedia.org, www.wikidata.org, and 1 other

Ruby
canada-politwitter

politwitter.ca

Ruby
australia-openaustralia

raw.githubusercontent.com, data.openaustralia.org

Ruby
twitter-argentina

api.twitter.com

Ruby
netherlands-tweede-kamer-wikipedia

nl.wikipedia.org

Ruby
cameroon-assembly-wikidata

fr.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
singapore-current

github.com, www.parliament.gov.sg

Ruby
bangladesh-parliament-scraper

www.parliament.gov.bd

Ruby
twitter_list_South_Korea

api.twitter.com

Ruby
denmark-folketing

github.com, www.thedanishparliament.dk

Ruby
twitter-scotland

api.twitter.com

Ruby
vanuatau-parliament-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
malaysian_parliament-wikidata

api.morph.io, en.wikipedia.org, ms.wikipedia.org, and 2 others

Ruby
slovakia-national-council-wikidata

sk.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
france-chamber-of-deputies-wikidata

fr.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
hong_kong_legislative_council_members
Fetch a list of the members of the Legislative Council of Hong Kong

github.com, www.legco.gov.hk

Ruby
twitter-list-spain-congreso

api.twitter.com

Ruby
estonia-positions

raw.githubusercontent.com, cdn.rawgit.com, www.wikidata.org

Ruby
pontifical-commission-for-vatican-state-wikipedia

en.wikipedia.org, www.gov.uk

Ruby
norway-stortingsrepresentanter-wikidata

no.wikipedia.org, en.wikipedia.org, www.wikidata.org, and 1 other

Ruby
korean-assembly-members-wikidata

ko.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
korea-popong-data

raw.githubusercontent.com

Ruby
russia-duma-2016

github.com, www.duma.gov.ru

Ruby
san_marino_council
Members of the Grand and General Council of San Marino

www.consigliograndeegenerale.sm

Ruby
sierra-leone-parliament
Ruby
northern-marianas-legislature-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
korea-popong-api

api.popong.com

Ruby
mongolia-khurai-wp-multiple-terms

en.wikipedia.org

Ruby
guernsey-states-wikidata

fr.wikipedia.org, en.wikipedia.org, www.wikidata.org, and 1 other

Ruby
twitter-list-peru-congreso

api.twitter.com

Ruby
drc-national-assembly-members-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
mexico-diputados

sitl.diputados.gob.mx

Ruby
egypt-parliament-wikidata

en.wikipedia.org, ar.wikipedia.org, www.wikidata.org, and 1 other

Ruby
argentina-senate

github.com, www.senado.gov.ar

Ruby
twitter-ireland-list
Wee scraper pulling twitter handles of Irish TDs from Elaine Byrne's list

api.twitter.com

Ruby
myanmar-lower-house-2016

api.openhluttaw.org

Ruby
morocco-house-of-representatives-2016
Ruby
palau-delegates-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com, and 1 other

Ruby
morocco-house-of-representatives

www.chambredesrepresentants.ma

Ruby
russia-duma
https://morph.io/tmtmtmtm/russia-duma

github.com, www.duma.gov.ru

Ruby
twitter-gov-uk-mps

api.twitter.com

Ruby
australia-senators-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
twitter-list-iran

api.twitter.com

Ruby
philippines-senate

www.senate.gov.ph

Ruby
lesotho-national-assembly-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com, and 2 others

Ruby
czech-chamber-of-deputies-wikidata

cs.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
dominican-republic-deputies
https://morph.io/tmtmtmtm/dominican-republic-deputies

www.camaradediputados.gob.do

Ruby
greek-mps-twitter

api.twitter.com

Ruby
australia-house-of-representatives-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
uk-house-of-commons-wikidata
https://morph.io/tmtmtmtm/uk-house-of-commons-wikidata

query.wikidata.org, www.wikidata.org, raw.githubusercontent.com

Ruby
bangladesh-parliament-wikidata

raw.githubusercontent.com, cdn.rawgit.com, en.wikipedia.org, and 3 others

Ruby
twitter-colombia-senate-list
Scraper to run through a twitter List of Colombian Senators

api.twitter.com

Ruby
nepalese-constituent-assembly-members

ne.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
guam-legislature-members

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
brunei-legislative-council-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
australia-openaustralia-senators

data.openaustralia.org

Ruby
welsh-national-assembly-twitter-list

api.twitter.com

Ruby
philippines-house-of-representatives

github.com, www.congress.gov.ph

Ruby
kosovan-parliament-wikidata

sq.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
twitter-list-meps

api.twitter.com

Ruby
twitter-list-netherlands

api.twitter.com

Ruby
us-constituencies-wikidata

query.wikidata.org, www.wikidata.org

Ruby
twitter-list-austria-nr-abgeordnete
Scraping: https://twitter.com/OeParl/lists/nr-abgeordnete

api.twitter.com

Ruby
mexico-diputados-2015

github.com, sitl.diputados.gob.mx

Ruby
twitter-list-belgium-vlaamse-regering
Scraping twitter accounts from https://twitter.com/vlaparl/lists/vlaamse-regering

api.twitter.com

Ruby
suriname-nationale-assemblee

www.dna.sr

Ruby
twitter-list-sweden

api.twitter.com

Ruby
chile-congress-wikidata

es.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
kazakhstan-mazhilis

github.com, www.parlam.kz

Ruby
pitcairn-island-council-wikidata

api.morph.io, en.wikipedia.org, www.wikidata.org, and 1 other

Ruby
angola-national-assembly-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
estonia-riigikogu

github.com, www.riigikogu.ee

Ruby
twitter-list-estonia

api.twitter.com

Ruby
italy-twitter-list

api.twitter.com

Ruby
australia-constituencies-wikidata

query.wikidata.org, www.wikidata.org

Ruby
mexico-deputies-wikipedia
https://morph.io/tmtmtmtm/mexico-deputies-wikipedia

en.wikipedia.org, www.londonambulance.nhs.uk

Ruby
png-parliament-wikidata

fr.wikipedia.org, en.wikipedia.org, de.wikipedia.org, and 4 others

Ruby
twitter-list-new-zealand-parliament

api.twitter.com

Ruby
argentina-senators-wikidata

es.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
twitter-list-turkish-politicians

api.twitter.com

Ruby
tuvalu-parliament-wikipedia

en.wikipedia.org

Ruby
vanuatu-parliament

github.com, parliament.gov.vu

Ruby
philippines-house-of-representatives-wikidata

en.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
italy-senate-wikidata

it.wikipedia.org, www.wikidata.org, raw.githubusercontent.com

Ruby
twitter-list-switzerland

api.twitter.com, www.example.com, www.southend.gov.uk

Ruby
peru-congreso

www.congreso.gob.pe, www.qvh.nhs.uk

Ruby
kenesh-kg
Ruby
errored spain_congreso_es
Details of members of the Spanish Congress from the official website congreso.es

www.congreso.es, github.com

Ruby
jamaica-elections-2016

jamaica-elections.com

Ruby
mexico-deputies-wikipedia-2015
https://morph.io/everypolitician-scrapers/mexico-deputies-wikipedia-2015

en.wikipedia.org

Python
falkland-islands
Falkland Islands Assembly Members
Ruby
uganda-parliament-wikipedia

en.wikipedia.org

Ruby
uganda-parliament-scraper

www.parliament.go.ug, github.com, raw.githubusercontent.com

Ruby
nigeria-national-assembly
french-assembly-twitter
french-assembly-twitter-list
Twitter list scraper
Ruby
nauru-2016-results
Results of the 2016 Nauru election

Statistics

Total run time used: 4 months

Total cpu time used: about 1 month

Total disk space used: 745 MB