This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/everypolitician/scraped.git  Fetching https://github.com/everypolitician/scraped_page_archive.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching rake 12.3.2  Fetching public_suffix 3.0.3  Fetching ast 2.4.0  Installing ast 2.4.0  Installing rake 12.3.2  Installing public_suffix 3.0.3  Using bundler 1.15.2  Fetching coderay 1.1.2  Installing coderay 1.1.2  Fetching safe_yaml 1.0.4  Fetching field_serializer 0.3.0  Installing field_serializer 0.3.0  Installing safe_yaml 1.0.4  Fetching git 1.3.0  Installing git 1.3.0  Fetching hashdiff 0.3.8  Fetching httpclient 2.8.3  Installing hashdiff 0.3.8  Fetching jaro_winkler 1.5.2  Installing jaro_winkler 1.5.2 with native extensions  Fetching method_source 0.9.2  Installing method_source 0.9.2  Fetching mini_portile2 2.4.0  Installing httpclient 2.8.3  Installing mini_portile2 2.4.0  Fetching minitest 5.11.3  Installing minitest 5.11.3  Fetching vcr 3.0.3  Fetching open-uri-cached 0.0.5  Installing vcr 3.0.3  Installing open-uri-cached 0.0.5  Fetching parallel 1.13.0  Installing parallel 1.13.0  Fetching powerpack 0.1.2  Installing powerpack 0.1.2  Fetching rainbow 3.0.0  Fetching require_all 2.0.0  Installing rainbow 3.0.0  Installing require_all 2.0.0  Fetching ruby-progressbar 1.10.0  Installing ruby-progressbar 1.10.0  Fetching unicode-display_width 1.4.1  Installing unicode-display_width 1.4.1  Fetching sqlite3 1.3.13  Fetching parser 2.6.0.0  Installing sqlite3 1.3.13 with native extensions  Installing parser 2.6.0.0  Fetching addressable 2.6.0  Installing addressable 2.6.0  Fetching crack 0.4.3  Fetching pry 0.12.2  Installing crack 0.4.3  Installing pry 0.12.2  Fetching nokogiri 1.10.1  Fetching minispec-metadata 2.0.0  Installing minispec-metadata 2.0.0  Fetching rubocop 0.63.0  Installing rubocop 0.63.0  Fetching webmock 2.0.3  Installing webmock 2.0.3  Fetching minitest-vcr 1.4.0  Installing nokogiri 1.10.1 with native extensions  Installing minitest-vcr 1.4.0  Fetching vcr-archive 0.3.0  Installing vcr-archive 0.3.0  Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@a998412)  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Using scraped 0.6.2 from https://github.com/everypolitician/scraped.git (at master@7fd4391)  Bundle complete! 12 Gemfile dependencies, 37 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Bundle completed (19.35s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 6696 times by everypolitician rtiwariops tmtmtmtm chrismytton ondenman mhl MikeRalphson crowbot fcoskun milh0use octopusinvitro

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (5.06 MB) Use the API

rows 10 / 10992

id name image given_name family_name sort_name birth_date gender identifier__bioguide identifier__thomas identifier__lis identifier__govtrack identifier__opensecrets identifier__votesmart identifier__fec identifier__cspan identifier__wikipedia identifier__house_history identifier__ballotpedia identifier__maplight identifier__icpsr identifier__wikidata identifier__google_entity_id house start_date state district party homepage phone fax area_id ocd_id term end_date identifier__bioguide_previous
B000944
Sherrod Brown
Sherrod
Brown
Brown, Sherrod
1952-11-09
male
B000944
00136
S307
400050
N00003535
27018
H2OH13033;S6OH00163
5051
Sherrod_Brown
9996
Sherrod_Brown
168
29389
Q381880
kg:/m/034s80
rep
1993-01-06
OH
13
Democrat
OH-13
ocd-division/country:us/state:oh/cd:13
103
1995-01-03
B000944
Sherrod Brown
Sherrod
Brown
Brown, Sherrod
1952-11-09
male
B000944
00136
S307
400050
N00003535
27018
H2OH13033;S6OH00163
5051
Sherrod_Brown
9996
Sherrod_Brown
168
29389
Q381880
kg:/m/034s80
rep
1995-01-06
OH
13
Democrat
OH-13
ocd-division/country:us/state:oh/cd:13
104
1997-01-03
B000944
Sherrod Brown
Sherrod
Brown
Brown, Sherrod
1952-11-09
male
B000944
00136
S307
400050
N00003535
27018
H2OH13033;S6OH00163
5051
Sherrod_Brown
9996
Sherrod_Brown
168
29389
Q381880
kg:/m/034s80
rep
1997-01-07
OH
13
Democrat
OH-13
ocd-division/country:us/state:oh/cd:13
105
1999-01-03
B000944
Sherrod Brown
Sherrod
Brown
Brown, Sherrod
1952-11-09
male
B000944
00136
S307
400050
N00003535
27018
H2OH13033;S6OH00163
5051
Sherrod_Brown
9996
Sherrod_Brown
168
29389
Q381880
kg:/m/034s80
rep
1999-01-06
OH
13
Democrat
OH-13
ocd-division/country:us/state:oh/cd:13
106
2001-01-03
B000944
Sherrod Brown
Sherrod
Brown
Brown, Sherrod
1952-11-09
male
B000944
00136
S307
400050
N00003535
27018
H2OH13033;S6OH00163
5051
Sherrod_Brown
9996
Sherrod_Brown
168
29389
Q381880
kg:/m/034s80
rep
2001-01-06
OH
13
Democrat
OH-13
ocd-division/country:us/state:oh/cd:13
107
2003-01-03
B000944
Sherrod Brown
Sherrod
Brown
Brown, Sherrod
1952-11-09
male
B000944
00136
S307
400050
N00003535
27018
H2OH13033;S6OH00163
5051
Sherrod_Brown
9996
Sherrod_Brown
168
29389
Q381880
kg:/m/034s80
rep
2003-01-07
OH
13
Democrat
OH-13
ocd-division/country:us/state:oh/cd:13
108
2005-01-03
B000944
Sherrod Brown
Sherrod
Brown
Brown, Sherrod
1952-11-09
male
B000944
00136
S307
400050
N00003535
27018
H2OH13033;S6OH00163
5051
Sherrod_Brown
9996
Sherrod_Brown
168
29389
Q381880
kg:/m/034s80
rep
2005-01-06
OH
13
Democrat
OH-13
ocd-division/country:us/state:oh/cd:13
109
2007-01-03
B000944
Sherrod Brown
Sherrod
Brown
Brown, Sherrod
1952-11-09
male
B000944
00136
S307
400050
N00003535
27018
H2OH13033;S6OH00163
5051
Sherrod_Brown
9996
Sherrod_Brown
168
29389
Q381880
kg:/m/034s80
sen
2011-01-06
OH
Democrat
202-224-2315
202-228-6321
OH
ocd-division/country:us/state:oh
112
2013-01-03
B000944
Sherrod Brown
Sherrod
Brown
Brown, Sherrod
1952-11-09
male
B000944
00136
S307
400050
N00003535
27018
H2OH13033;S6OH00163
5051
Sherrod_Brown
9996
Sherrod_Brown
168
29389
Q381880
kg:/m/034s80
sen
2009-01-06
OH
Democrat
202-224-2315
202-228-6321
OH
ocd-division/country:us/state:oh
111
2011-01-03
B000944
Sherrod Brown
Sherrod
Brown
Brown, Sherrod
1952-11-09
male
B000944
00136
S307
400050
N00003535
27018
H2OH13033;S6OH00163
5051
Sherrod_Brown
9996
Sherrod_Brown
168
29389
Q381880
kg:/m/034s80
sen
2007-01-06
OH
Democrat
202-224-2315
202-228-6321
OH
ocd-division/country:us/state:oh
110
2009-01-03

Statistics

Average successful run time: 3 minutes

Total run time: 3 days

Total cpu time used: about 6 hours

Total disk space used: 5.12 MB

History

  • Auto ran revision dd7b57be and completed successfully .
    1 record updated in the database
  • Auto ran revision dd7b57be and completed successfully .
    nothing changed in the database
  • Auto ran revision dd7b57be and completed successfully .
    nothing changed in the database
  • Auto ran revision dd7b57be and completed successfully .
    nothing changed in the database
  • Auto ran revision dd7b57be and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

us-congress-members / scraper.rb