tmtmtmtm / lesotho-assembly
Scrapes api.morph.io and www.parliament.ls
Get structured data out of the web. Code collaboration through GitHub. Run your scrapers in the cloud.
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Ruby app detected
[1G-----> Compiling Ruby
[1G-----> Using Ruby version: ruby-2.0.0
[1G-----> Installing dependencies using bundler 1.15.2
[1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment
[1G Fetching gem metadata from https://rubygems.org/........
[1G Fetching version metadata from https://rubygems.org/.
[1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git
[1G Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.
[1G Using bundler 1.15.2
[1G Fetching coderay 1.1.0
[1G Installing coderay 1.1.0
[1G Fetching colorize 0.7.7
[1G Installing colorize 0.7.7
[1G Fetching execjs 2.5.2
[1G Installing execjs 2.5.2
[1G Fetching fuzzy_match 2.1.0
[1G Installing fuzzy_match 2.1.0
[1G Fetching httpclient 2.6.0.1
[1G Installing httpclient 2.6.0.1
[1G Fetching method_source 0.8.2
[1G Installing method_source 0.8.2
[1G Fetching mini_portile 0.6.2
[1G Installing mini_portile 0.6.2
[1G Fetching open-uri-cached 0.0.5
[1G Installing open-uri-cached 0.0.5
[1G Fetching slop 3.6.0
[1G Installing slop 3.6.0
[1G Fetching sqlite3 1.3.10
[1G Installing sqlite3 1.3.10 with native extensions
[1G Fetching nokogiri 1.6.6.2
[1G Installing nokogiri 1.6.6.2 with native extensions
[1G Fetching pry 0.10.1
[1G Installing pry 0.10.1
[1G Fetching sqlite_magic 0.0.3
[1G Installing sqlite_magic 0.0.3
[1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)
[1G Bundle complete! 7 Gemfile dependencies, 15 gems now installed.
[1G Gems in the groups development and test were not installed.
[1G Bundled gems are installed into ./vendor/bundle.
[1G Bundle completed (22.88s)
[1G Cleaning up the bundler cache.
[1G-----> Installing node-v6.11.1-linux-x64
[1G-----> Detecting rake tasks
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Data
Downloaded
1865 times
by
To download data sign in with GitHub
rows 1 / 1
| id | name | start_date | source |
|---|---|---|---|
| id
9
|
name
9th Parliament
|
start_date
2015-03-10
|
source |
To download data sign in with GitHub
rows 10 / 185
| name | area | party | term | source | area_id | gender | age |
|---|---|---|---|---|---|---|---|
| name
Mamahele Radebe
|
area
Hololo
|
party
ABC
|
term
9
|
source | area_id
2
|
gender
female
|
age
65
|
| name
Leboea Mothuku
|
area
Qalo
|
party
ABC
|
term
9
|
source | area_id
4
|
gender
male
|
age
60
|
| name
Mokoto Francis Hloaele
|
area
Maliba-Matšo
|
party
DC
|
term
9
|
source | area_id
6
|
gender
male
|
age
60
|
| name
Phakiso Edwill Khama
|
area
Mphosong
|
party
DC
|
term
9
|
source | area_id
7
|
gender
male
|
age
57
|
| name
Tieho Gilbert Mamasiane
|
area
Pela-Tšoeu
|
party
DC
|
term
9
|
source | area_id
10
|
gender
male
|
age
38
|
| name
Tlali Khasu
|
area
Peka
|
party
ABC
|
term
9
|
source | area_id
17
|
gender
male
|
age
62
|
| name
Tsóeu Molise
|
area
Tsóana Makhulo
|
party
ABC
|
term
9
|
source | area_id
25
|
gender
male
|
age
44
|
| name
Molefi Africa Simon Makakane
|
area
Thupa-Kubu
|
party
ABC
|
term
9
|
source | area_id
26
|
gender
male
|
age
41
|
| name
Monaphathi Maraka
|
area
Berea
|
party
ABC
|
term
9
|
source | area_id
27
|
gender
male
|
age
48
|
| name
Pitso Maisa
|
area
Motimposo
|
party
ABC
|
term
9
|
source | area_id
30
|
gender
male
|
age
42
|
Statistics
Average successful run time: less than a minute
Total run time: 2 days
Total cpu time used: 18 minutes
Total disk space used: 70.3 KB
History
-
Auto
ran
revision
cd3446b9
and
completed successfully
.
120 records added, 120 records removed in the database2 pages scraped
-
Auto
ran
revision
cd3446b9
and
completed successfully
.
120 records added, 120 records removed in the database2 pages scraped
-
Auto
ran
revision
cd3446b9
and
completed successfully
.
120 records added, 120 records removed in the database2 pages scraped
-
Auto
ran
revision
cd3446b9
and
failed
.
nothing changed in the database
-
Auto
ran
revision
cd3446b9
and
failed
.
nothing changed in the database
- ...
- Created on morph.io