tmtmtmtm / saint-lucia-assembly-wikipedia

README.md

This is a scraper that runs on Morph. To get started see the documentation

Contributors

Last run completed successfully 2017-06-27.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.3.3 [1G-----> Installing dependencies using bundler 1.13.7 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Fetching gem metadata from https://rubygems.org/......... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/everypolitician/scraped.git [1G Fetching https://github.com/everypolitician/scraped_page_archive.git [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching https://github.com/everypolitician/table_unspanner.git [1G Installing ast 2.3.0 [1G Installing rake 12.0.0 [1G Installing public_suffix 2.0.4 [1G Installing coderay 1.1.0 [1G Installing safe_yaml 1.0.4 [1G Installing field_serializer 0.3.0 [1G Installing git 1.3.0 [1G Installing hashdiff 0.3.1 [1G Installing httpclient 2.6.0.1 [1G Installing method_source 0.8.2 [1G Installing mini_portile2 2.1.0 [1G Installing minitest 5.10.1 [1G Installing vcr 3.0.3 [1G Installing open-uri-cached 0.0.5 [1G Installing powerpack 0.1.1 [1G Installing slop 3.6.0 [1G Installing rainbow 2.1.0 [1G Installing require_all 1.3.3 [1G Installing ruby-progressbar 1.8.1 [1G Installing unicode-display_width 1.1.2 [1G Using bundler 1.13.7 [1G Installing sqlite3 1.3.10 with native extensions [1G Installing addressable 2.5.0 [1G Installing parser 2.3.3.1 [1G Installing crack 0.4.3 [1G Installing minispec-metadata 2.0.0 [1G Installing minitest-around 0.4.0 [1G Installing pry 0.10.1 [1G Installing rubocop 0.46.0 [1G Installing nokogiri 1.7.0.1 with native extensions [1G Installing webmock 2.0.3 [1G Installing minitest-vcr 1.4.0 [1G Installing vcr-archive 0.3.0 [1G Using scraped_page_archive 0.5.0 from https://github.com/everypolitician/scraped_page_archive.git (at master@28f93d7) [1G Installing sqlite_magic 0.0.3 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Using scraped 0.2.0 from https://github.com/everypolitician/scraped.git (at master@c3fc06e) [1G Using table_unspanner 0.1.0 from https://github.com/everypolitician/table_unspanner.git (at master@a70a98a) [1G Bundle complete! 14 Gemfile dependencies, 38 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Post-install message from webmock: [1G WebMock 2.0 has some breaking changes. Please check the CHANGELOG: https://goo.gl/piDGLu [1G Bundle completed (24.63s) [1G Cleaning up the bundler cache. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 1022 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (18 KB) Use the API

rows 10 / 51

name	wikipedia__en	party_id	party	area	area_id	source	term
Lenard Montoute	Lenard Montoute	UWP	United Workers Party	Gros Islet	ocd-division/country:lc/constituency:gros-islet	https://en.wikipedia.org/wiki/House_of_Assembly_of_Saint_Lucia	10
Ezechiel Joseph	Ezechiel Joseph	UWP	United Workers Party	Babonneau	ocd-division/country:lc/constituency:babonneau	https://en.wikipedia.org/wiki/House_of_Assembly_of_Saint_Lucia	10
Stephenson King	Stephenson King	UWP	United Workers Party	Castries North	ocd-division/country:lc/constituency:castries-north	https://en.wikipedia.org/wiki/House_of_Assembly_of_Saint_Lucia	10
Philip Pierre	Philip Pierre	SLP	Saint Lucia Labour Party	Castries East	ocd-division/country:lc/constituency:castries-east	https://en.wikipedia.org/wiki/House_of_Assembly_of_Saint_Lucia	10
Sarah Flood-Beaubrun	Sarah Flood-Beaubrun	UWP	United Workers Party	Castries Central	ocd-division/country:lc/constituency:castries-central	https://en.wikipedia.org/wiki/House_of_Assembly_of_Saint_Lucia	10
Ernest Hilaire		SLP	Saint Lucia Labour Party	Castries South	ocd-division/country:lc/constituency:castries-south	https://en.wikipedia.org/wiki/House_of_Assembly_of_Saint_Lucia	10
Guy Joseph	Guy Joseph	UWP	United Workers Party	Castries South East	ocd-division/country:lc/constituency:castries-south-east	https://en.wikipedia.org/wiki/House_of_Assembly_of_Saint_Lucia	10
Dominic Fedee	Dominic Fedee	UWP	United Workers Party	Anse la Raye and Canaries	ocd-division/country:lc/constituency:anse-la-raye-and-canaries	https://en.wikipedia.org/wiki/House_of_Assembly_of_Saint_Lucia	10
Herold Stanislas		UWP	United Workers Party	Soufriere	ocd-division/country:lc/constituency:soufriere	https://en.wikipedia.org/wiki/House_of_Assembly_of_Saint_Lucia	10
Bradley Felix		UWP	United Workers Party	Choiseul	ocd-division/country:lc/constituency:choiseul	https://en.wikipedia.org/wiki/House_of_Assembly_of_Saint_Lucia	10

Statistics

Average successful run time: less than 20 seconds

Total run time: about 1 hour

Total cpu time used: 3 minutes

Total disk space used: 99.5 KB

History

Auto ran revision e8f1b35b and completed successfully 2017-06-27.

run time 47 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-26.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-25.

run time 40 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-24.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-23.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-22.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-21.

run time 6 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-20.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-19.

run time 42 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-18.

run time 42 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-17.

run time 42 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-16.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-15.

run time 42 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-14.

run time 41 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-13.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-12.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-11.

run time 43 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-10.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-09.

run time 41 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-08.

run time 44 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-07.

run time 55 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-06.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-05.

run time 41 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-04.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-03.

run time 38 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-02.

run time 5 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-06-01.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-31.

run time 7 minutes

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-30.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-29.

run time 3 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-28.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-27.

run time 47 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-26.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-25.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-24.

run time 46 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-23.

run time 50 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-22.

run time 1 minute

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-21.

run time 39 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-20.

run time 43 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-19.

run time 39 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-18.

run time 3 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-17.

run time 41 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-16.

run time 40 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-15.

run time 42 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-14.

run time 40 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-13.

run time 38 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-12.

run time 4 s

nothing changed in the database
Auto ran revision e8f1b35b and completed successfully 2017-05-11.

run time 41 s

51 records updated in the database
Auto ran revision 79739020 and completed successfully 2017-05-10.

run time 42 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-05-09.

run time 46 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-05-08.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-05-07.

run time 6 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-05-06.

run time 39 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-05-05.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-05-04.

run time 44 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-05-03.

run time 41 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-05-02.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-05-01.

run time 1 minute

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-30.

run time 57 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-29.

run time 41 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-28.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-27.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-26.

run time 3 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-25.

run time 3 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-24.

run time 3 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-23.

run time 43 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-22.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-21.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-20.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-19.

run time 3 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-18.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-17.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-16.

run time 40 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-15.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-14.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-13.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-12.

run time 39 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-11.

run time 42 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-10.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-09.

run time 3 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-08.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-07.

run time 13 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-06.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-05.

run time 40 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-04.

run time 3 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-03.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-02.

run time 6 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-04-01.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-31.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-30.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-29.

run time 3 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-28.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-27.

run time 3 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-26.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-25.

run time 1 minute

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-24.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-22.

run time 3 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-22.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-21.

run time 4 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-03-20.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-19.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-18.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-16.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-15.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-15.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-14.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-13.

run time 5 s

nothing changed in the database

4 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-10.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-09.

run time 40 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-08.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-07.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-06.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-05.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-03.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-02.

run time 4 s

nothing changed in the database

3 pages scraped
Auto ran revision 79739020 and completed successfully 2017-03-01.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-28.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-27.

run time 7 s

nothing changed in the database

19 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-26.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-25.

run time 4 s

nothing changed in the database

8 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-24.

run time 6 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-23.

run time 41 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-22.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-21.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-20.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-19.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-18.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-17.

run time 5 s

nothing changed in the database

15 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-16.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-15.

run time 8 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-14.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-11.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-11.

run time 4 s

nothing changed in the database

3 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-10.

run time 37 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-09.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-08.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-07.

run time 6 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-06.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-05.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-04.

run time 5 s

nothing changed in the database

3 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-03.

run time 8 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-02.

run time 5 s

nothing changed in the database

28 pages scraped
Auto ran revision 79739020 and completed successfully 2017-02-01.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-01-31.

run time 6 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-01-31.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-01-27.

run time 8 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-01-26.

run time 35 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-01-25.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran and failed 2017-01-25.

run time 0 s
Auto ran revision 79739020 and failed 2017-01-19.

run time 1 s

nothing changed in the database
Auto ran revision 79739020 and completed successfully 2017-01-18.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-01-17.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-01-16.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-01-14.

run time 4 s

nothing changed in the database

71 pages scraped
Auto ran revision 79739020 and completed successfully 2017-01-11.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision 79739020 and completed successfully 2017-01-10.

run time 4 s

51 records added in the database

2 pages scraped
Auto ran revision f1b78487 and failed 2017-01-09.

run time 5 s

nothing changed in the database

2 pages scraped
Auto ran revision f1b78487 and failed 2017-01-08.

run time 4 s

nothing changed in the database

2 pages scraped
Auto ran revision f1b78487 and failed 2017-01-07.

run time 6 s

51 records removed in the database

2 pages scraped
Manually ran revision 10d6c939 and completed successfully 2017-01-06.

run time 4 s

34 records added, 17 records removed, 17 records updated in the database

3 pages scraped
Manually ran revision db42be3a and completed successfully 2015-08-31.

run time 17 s

34 records added, 34 records removed in the database

1 page scraped
Manually ran revision 8a63585c and completed successfully 2015-08-15.

run time 23 s

34 records added in the database

1 page scraped
Created on morph.io 2015-08-15

Scraper code

Ruby

saint-lucia-assembly-wikipedia / scraper.rb

git clone URL