openaustralia / alaveteli_versions
Scrapes the version of every Alaveteli deployment
This is a scraper that runs on Morph.
To get started see the documentation
Development
Set up a local development copy of the scraper by running:
bash
git clone https://github.com/openaustralia/alaveteli_versions
cd alaveteli_versions
bundle
Then run regression tests and audit the scraper style with:
bash
bundle exec rake
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Ruby app detected
[1G-----> Compiling Ruby
[1G-----> Using Ruby version: ruby-2.3.4
[1G-----> Installing dependencies using bundler 1.15.2
[1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment
[1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.15.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.
[1G Fetching gem metadata from https://rubygems.org/......
[1G Fetching version metadata from https://rubygems.org/.
[1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git
[1G Fetching unf_ext 0.0.7.1
[1G Fetching httpclient 2.7.0.1
[1G Using bundler 1.15.2
[1G Fetching mime-types 2.6.2
[1G Installing mime-types 2.6.2
[1G Installing unf_ext 0.0.7.1 with native extensions
[1G Fetching net-http-digest_auth 1.4
[1G Installing net-http-digest_auth 1.4
[1G Fetching net-http-persistent 2.9.4
[1G Installing net-http-persistent 2.9.4
[1G Fetching mini_portile 0.6.2
[1G Installing httpclient 2.7.0.1
[1G Installing mini_portile 0.6.2
[1G Fetching ntlm-http 0.1.1
[1G Installing ntlm-http 0.1.1
[1G Fetching webrobots 0.1.1
[1G Installing webrobots 0.1.1
[1G Fetching sqlite3 1.3.11
[1G Fetching nokogiri 1.6.6.3
[1G Installing sqlite3 1.3.11 with native extensions
[1G Installing nokogiri 1.6.6.3 with native extensions
[1G Fetching unf 0.1.4
[1G Installing unf 0.1.4
[1G Fetching domain_name 0.5.25
[1G Installing domain_name 0.5.25
[1G Fetching http-cookie 1.0.2
[1G Installing http-cookie 1.0.2
[1G Fetching sqlite_magic 0.0.6
[1G Installing sqlite_magic 0.0.6
[1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)
[1G Fetching mechanize 2.7.3
[1G Installing mechanize 2.7.3
[1G Bundle complete! 10 Gemfile dependencies, 17 gems now installed.
[1G Gems in the groups development and test were not installed.
[1G Bundled gems are installed into ./vendor/bundle.
[1G Bundle completed (12.75s)
[1G Cleaning up the bundler cache.
[1G-----> Detecting rake tasks
[1G
[1G ###### WARNING:
[1G You have not declared a Ruby version in your Gemfile.
[1G To set your Ruby version add this line to your Gemfile:
[1G ruby '2.3.4'
[1G # See https://devcenter.heroku.com/articles/ruby-versions for more information.
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Discovering deployments...
Saving 0 records
Done.
Data
Downloaded
52 times
by
To download data sign in with GitHub
rows 10 / 36
| alaveteli_version | ruby_version | visible_request_count | alaveteli_git_commit | confirmed_user_count | name | url | version_url | error | visible_public_body_count | visible_comment_count | track_thing_count | widget_vote_count | public_body_change_request_count | request_classification_count | visible_followup_message_count | date_checked |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
0.20.0.14
|
1.8.7
|
29
|
823e58dc69960c600230b10604a0051359173f85
|
50
|
Sobunakirwa
|
|
|
|
|
|
|
|
|
|
||
|
0.20.0.14
|
1.9.3
|
17
|
48f07a68cb7373a9a032009ab760b5f4d156d6cd
|
39
|
Diritto Di Sapere
|
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
Je Veux Savoir
|
404 => Net::HTTPNotFound for http://www.nordouvert.ca/version.json/2015/06/15/je-veux-savoir-fin-d-une-belle-aventure.html -- unhandled response
|
|
|
|
|
|
|
|
|
||
|
0.19
|
1.8.7
|
991
|
d12c236fbd606fb38c01aebb39694a568740de06
|
939
|
Queremos Saber
|
|
|
|
|
|
|
|
|
|
||
|
0.21.0.26
|
1.8.7
|
10
|
5e2f00176f73736929fde4e1ab09f594ba5252cf
|
4
|
Marsoum 41
|
|
|
|
|
|
|
|
|
|
||
|
0.12
|
1.8.7
|
|
ad820340ad8bebffbe453ae337a4ec49dec6022f
|
|
Tu Derecho A Saber
|
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
Da Zanamo Svi
|
404 => Net::HTTPNotFound for http://daznamosvi.rs/sr/version.json -- unhandled response
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
Nós Queremos Saber
|
Didn't get JSON from API.
|
|
|
|
|
|
|
|
|
||
|
|
|
|
|
|
Pravo Da Znam
|
Net::HTTP::Persistent::Error: too many connection resets (due to Net::ReadTimeout - Net::ReadTimeout) after 0 requests on 47044091722280, last used 1531865782.47403 seconds ago
|
|
|
|
|
|
|
|
2018-07-17
|
||
|
|
|
|
|
|
RightToKnow
|
Net::HTTP::Persistent::Error: too many connection resets (due to Net::ReadTimeout - Net::ReadTimeout) after 0 requests on 46942657109440, last used 1551708277.0665338 seconds ago
|
|
|
|
|
|
|
|
2019-03-04
|
Statistics
Average successful run time: 2 minutes
Total run time: about 1 month
Total cpu time used: about 1 hour
Total disk space used: 139 KB
History
-
Auto
ran
revision
4a0c1181
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
4a0c1181
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
4a0c1181
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
4a0c1181
and
completed successfully
.
nothing changed in the database
-
Auto
ran
revision
4a0c1181
and
completed successfully
.
nothing changed in the database
- ...
- Created on morph.io