tmtmtmtm / lesotho-assembly
Scrapes api.morph.io and www.parliament.ls
Get structured data out of the web. Code collaboration through GitHub. Run your scrapers in the cloud.
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Ruby app detected
[1G-----> Compiling Ruby
[1G-----> Using Ruby version: ruby-2.0.0
[1G-----> Installing dependencies using bundler 1.15.2
[1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment
[1G Fetching gem metadata from https://rubygems.org/........
[1G Fetching version metadata from https://rubygems.org/.
[1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git
[1G Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.
[1G Using bundler 1.15.2
[1G Fetching coderay 1.1.0
[1G Installing coderay 1.1.0
[1G Fetching colorize 0.7.7
[1G Installing colorize 0.7.7
[1G Fetching execjs 2.5.2
[1G Installing execjs 2.5.2
[1G Fetching fuzzy_match 2.1.0
[1G Installing fuzzy_match 2.1.0
[1G Fetching httpclient 2.6.0.1
[1G Installing httpclient 2.6.0.1
[1G Fetching method_source 0.8.2
[1G Installing method_source 0.8.2
[1G Fetching mini_portile 0.6.2
[1G Installing mini_portile 0.6.2
[1G Fetching open-uri-cached 0.0.5
[1G Installing open-uri-cached 0.0.5
[1G Fetching slop 3.6.0
[1G Installing slop 3.6.0
[1G Fetching sqlite3 1.3.10
[1G Installing sqlite3 1.3.10 with native extensions
[1G Fetching nokogiri 1.6.6.2
[1G Installing nokogiri 1.6.6.2 with native extensions
[1G Fetching pry 0.10.1
[1G Installing pry 0.10.1
[1G Fetching sqlite_magic 0.0.3
[1G Installing sqlite_magic 0.0.3
[1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)
[1G Bundle complete! 7 Gemfile dependencies, 15 gems now installed.
[1G Gems in the groups development and test were not installed.
[1G Bundled gems are installed into ./vendor/bundle.
[1G Bundle completed (22.88s)
[1G Cleaning up the bundler cache.
[1G-----> Installing node-v6.11.1-linux-x64
[1G-----> Detecting rake tasks
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Data
Downloaded
1865 times
by
To download data sign in with GitHub
rows 1 / 1
| id | name | start_date | source |
|---|---|---|---|
|
9
|
9th Parliament
|
2015-03-10
|
To download data sign in with GitHub
rows 10 / 185
| name | area | party | term | source | area_id | gender | age |
|---|---|---|---|---|---|---|---|
|
Mamahele Radebe
|
Hololo
|
ABC
|
9
|
2
|
female
|
65
|
|
|
Leboea Mothuku
|
Qalo
|
ABC
|
9
|
4
|
male
|
60
|
|
|
Mokoto Francis Hloaele
|
Maliba-Matšo
|
DC
|
9
|
6
|
male
|
60
|
|
|
Phakiso Edwill Khama
|
Mphosong
|
DC
|
9
|
7
|
male
|
57
|
|
|
Tieho Gilbert Mamasiane
|
Pela-Tšoeu
|
DC
|
9
|
10
|
male
|
38
|
|
|
Tlali Khasu
|
Peka
|
ABC
|
9
|
17
|
male
|
62
|
|
|
Tsóeu Molise
|
Tsóana Makhulo
|
ABC
|
9
|
25
|
male
|
44
|
|
|
Molefi Africa Simon Makakane
|
Thupa-Kubu
|
ABC
|
9
|
26
|
male
|
41
|
|
|
Monaphathi Maraka
|
Berea
|
ABC
|
9
|
27
|
male
|
48
|
|
|
Pitso Maisa
|
Motimposo
|
ABC
|
9
|
30
|
male
|
42
|
Statistics
Average successful run time: less than a minute
Total run time: 2 days
Total cpu time used: 18 minutes
Total disk space used: 70.3 KB
History
-
Auto
ran
revision
cd3446b9
and
completed successfully
.
120 records added, 120 records removed in the database2 pages scraped
-
Auto
ran
revision
cd3446b9
and
completed successfully
.
120 records added, 120 records removed in the database2 pages scraped
-
Auto
ran
revision
cd3446b9
and
completed successfully
.
120 records added, 120 records removed in the database2 pages scraped
-
Auto
ran
revision
cd3446b9
and
failed
.
nothing changed in the database
-
Auto
ran
revision
cd3446b9
and
failed
.
nothing changed in the database
- ...
- Created on morph.io