everypolitician-scrapers / guernsey-2016

Scraper for the updated Guernsey site. Scrapes members of the 2016 term.

Scrapes github.com and gov.gg

Build software better, together.


Contributors ondenman chrismytton tmtmtmtm

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.1 -----> Installing dependencies using bundler 1.11.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/..........  Fetching version metadata from https://rubygems.org/..  Fetching https://github.com/everypolitician/field_serializer.git  Fetching https://github.com/everypolitician/scraped_page_archive.git  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Installing ast 2.3.0  Installing coderay 1.1.0  Installing public_suffix 2.0.4  Installing colorize 0.7.7  Using field_serializer 0.1.0 from https://github.com/everypolitician/field_serializer.git (at master@16d5d90)  Installing git 1.3.0  Installing hashdiff 0.3.1  Installing safe_yaml 1.0.4  Installing method_source 0.8.2  Installing mini_portile 0.6.2  Installing httpclient 2.6.0.1  Installing open-uri-cached 0.0.5  Installing powerpack 0.1.1  Installing slop 3.6.0  Installing rainbow 2.1.0  Installing require_all 1.3.3  Installing ruby-progressbar 1.8.1  Installing unicode-display_width 1.1.1  Using bundler 1.11.2  Installing sqlite3 1.3.10 with native extensions  Installing vcr 3.0.3  Installing parser 2.3.1.4  Installing addressable 2.5.0  Installing crack 0.4.3  Installing pry 0.10.1  Installing rubocop 0.43.0  Installing nokogiri 1.6.6.2 with native extensions  Installing webmock 2.0.3  Installing vcr-archive 0.3.0  Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@28f93d7)  Installing sqlite_magic 0.0.3  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 9 Gemfile dependencies, 32 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from webmock:  WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu  Bundle completed (20.75s)  Cleaning up the bundler cache.  Warning: the running version of Bundler is older than the version that created the lockfile. We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Found 40 members Found 40 members Found 40 members Found 40 members

Data

Downloaded 56 times by everypolitician ondenman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (20 KB) Use the API

rows 10 / 41

name area party address email website twitter facebook phone mobile term source
Independent
2016
Louis Emile Jean
Alderney
Independent
Val House, Le Val, Alderney, GY9 3UL, Channel Islands
Louis.Jean@deputies.gov.gg
01481 822648
2016
Jan Kuttelwascher
St Peter Port South
Independent
L'Hyvreuse House, L'Hyvreuse, St Peter Port, Guernsey, GY1 1UY, Channel Islands
Jan.Kuttelwascher@deputies.gov.gg
01481 726312
2016
Carl Meerveld
St Sampson
Independent
Charleston, Route Carre, L'Islet, St Sampson, Guernsey, GY2 4RE, Channel Islands
Carl.Meerveld@deputies.gov.gg
01481 248439
07781 447738
2016
Jennifer Merrett
St Sampson
Independent
St Sampson, Guernsey, Channel Islands
jennifer.merrett@deputies.gov.gg
0 7781 167121
2016
Gavin St Pier
St Sampson
Independent
Sir Charles Frossard House, La Charroterie, St Peter Port, Guernsey, GY1 1FH, Channel Islands
Gavin.StPier@deputies.gov.gg
07839 240167
2016
Jeremy Smithies
Vale
Independent
La Haize, Rue Des Haizes, Vale, Guernsey, GY3 5HB, Channel Islands
Jeremy.Smithies@deputies.gov.gg
01481 246675
07781 146675
2016
Emilie Yerby
West
Independent
Top Flat, 39-41 High Street, St Peter Port, Guernsey, GY1 2JT, Channel Islands
Emilie.Yerby@deputies.gov.gg
07781 141077
2016
John Gollop
St Peter Port North
Independent
28 Rosaire Court, Rosaire Apartments, St Peter Port, GY1 1XW, Channel Islands
John.Gollop@deputies.gov.gg
07781 144878
2016
Michelle Le Clerc
St Peter Port North
Independent
Dulwich, Upper St Jacques, St Peter Port, GY1 1SR, Channel Islands
Michelle.LeClerc@deputies.gov.gg
07781 150033
2016

Statistics

Average successful run time: 22 minutes

Total run time: about 16 hours

Total cpu time used: about 2 hours

Total disk space used: 8.05 MB

History

  • Auto ran revision bdcfd70e and completed successfully .
    40 records added, 40 records removed in the database
    206 pages scraped
  • Auto ran revision bdcfd70e and completed successfully .
    40 records added, 40 records removed in the database
    206 pages scraped
  • Auto ran revision bdcfd70e and completed successfully .
    40 records added, 40 records removed in the database
  • Auto ran revision bdcfd70e and completed successfully .
    40 records added, 40 records removed in the database
    206 pages scraped
  • Auto ran revision bdcfd70e and completed successfully .
    40 records added, 40 records removed in the database
    206 pages scraped
  • Auto ran revision bdcfd70e and completed successfully .
    40 records added, 40 records removed in the database
  • Auto ran revision bdcfd70e and completed successfully .
    nothing changed in the database
    206 pages scraped
  • Auto ran revision bdcfd70e and completed successfully .
    nothing changed in the database
    206 pages scraped
  • Auto ran revision 070ac10d and completed successfully .
    40 records added, 40 records removed in the database
  • Auto ran revision 070ac10d and completed successfully .
    nothing changed in the database
  • Auto ran revision 070ac10d and failed .
    nothing changed in the database
  • Auto ran revision 070ac10d and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision 070ac10d and completed successfully .
    40 records added, 39 records removed in the database
    286 pages scraped
  • Manually ran revision 070ac10d and completed successfully .
    40 records added in the database
  • Auto ran revision 070ac10d and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision 070ac10d and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision 070ac10d and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision 070ac10d and completed successfully .
    30 records added, 29 records removed in the database
    297 pages scraped
  • Auto ran revision 070ac10d and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision 070ac10d and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Manually ran revision c0afa1af and completed successfully .
    40 records added in the database
    286 pages scraped
  • Auto ran revision c0afa1af and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision c0afa1af and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision c0afa1af and failed .
    9 records added, 9 records removed in the database
    83 pages scraped
  • Auto ran revision c0afa1af and completed successfully .
    32 records added, 31 records removed in the database
    295 pages scraped
  • Auto ran revision c0afa1af and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision c0afa1af and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Manually ran revision c0afa1af and completed successfully .
    40 records added in the database
    286 pages scraped
  • Manually ran revision c0afa1af and failed .
    4 records added, 4 records removed in the database
    38 pages scraped
  • Auto ran revision c0afa1af and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision c0afa1af and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision c0afa1af and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision c0afa1af and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Auto ran revision c0afa1af and completed successfully .
    35 records added, 34 records removed in the database
    292 pages scraped
  • Auto ran revision f767d9a7 and completed successfully .
    40 records added, 40 records removed in the database
    286 pages scraped
  • Manually ran revision f767d9a7 and completed successfully .
    40 records added, 39 records removed in the database
    286 pages scraped
  • Auto ran and failed .
  • Auto ran revision f767d9a7 and completed successfully .
    nothing changed in the database
    279 pages scraped
  • Auto ran revision f767d9a7 and completed successfully .
    nothing changed in the database
    279 pages scraped
  • Manually ran revision f767d9a7 and completed successfully .
    39 records added, 39 records removed in the database
    279 pages scraped
  • Manually ran revision f767d9a7 and failed .
    17 records added, 17 records removed in the database
    36 pages scraped
  • Auto ran revision f767d9a7 and failed .
    24 records added, 24 records removed in the database
    53 pages scraped
  • Auto ran revision f767d9a7 and completed successfully .
    39 records added, 39 records removed in the database
    79 pages scraped
  • Manually ran revision 4687bf81 and completed successfully .
    39 records added in the database
  • Auto ran revision 24d27009 and completed successfully .
    nothing changed in the database
  • Auto ran revision 24d27009 and completed successfully .
    nothing changed in the database
  • Manually ran revision 24d27009 and completed successfully .
    nothing changed in the database
  • Manually ran revision b2501986 and completed successfully .
    nothing changed in the database
  • Manually ran revision b2501986 and completed successfully .
    nothing changed in the database
  • Manually ran revision b2501986 and completed successfully .
    nothing changed in the database
  • Manually ran revision b2501986 and failed .
  • Manually ran revision 1410b536 and completed successfully .
    nothing changed in the database
  • Created on morph.io

Scraper code

Ruby

guernsey-2016 / scraper.rb