This is a scraper that runs on Morph. To get started see the documentation

Contributors mlandauer e-e-e henare MichaelBone

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Using bundler 1.15.2  Fetching unf_ext 0.0.7.2  Installing unf_ext 0.0.7.2 with native extensions  Fetching httpclient 2.7.2  Installing httpclient 2.7.2  Fetching mime-types 2.99.1  Installing mime-types 2.99.1  Fetching net-http-digest_auth 1.4  Installing net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile2 2.0.0  Installing mini_portile2 2.0.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.2  Installing webrobots 0.1.2  Fetching sqlite3 1.3.11  Installing sqlite3 1.3.11 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching nokogiri 1.6.7.2  Installing nokogiri 1.6.7.2 with native extensions  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching domain_name 0.5.20160310  Installing domain_name 0.5.20160310  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching mechanize 2.7.4  Installing mechanize 2.7.4  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (26.21s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Retrieving the default page. Retrieving the enquiry lists page. scraper.rb:16:in `<main>': undefined method `click' for nil:NilClass (NoMethodError)

Data

Downloaded 2230 times by openaustralia LoveMyData jesse-a-reilly TheZepto MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (469 KB) Use the API

rows 10 / 1268

council_reference address description info_url comment_url date_scraped on_notice_to date_received applicatant date_closing
361/656/2014/2T
Salisbury Oval, Brown Terrace, Salisbury SA 5108
Removal of a Significant Tree Located in a Council Reserve
mailto:city@salisbury.sa.gov.au
2014-04-09
2014-04-14
361/581/2014/2X
6 Nottingham Avenue, Salisbury East SA 5109
CARPORT FORWARD OF THE DWELLING AND VERANDAH
mailto:city@salisbury.sa.gov.au
2014-04-09
2014-04-09
361/497/2014/2X
4 Riverglen Court, Salisbury Downs SA 5108
CARPORT
mailto:city@salisbury.sa.gov.au
2014-04-09
2014-04-09
361/699/2014/2T
Located on a Council verge opposite 16 Straun Road, Ingle Farm SA 5098
Removal of a Significant Tree located on a Council Reserve
mailto:city@salisbury.sa.gov.au
2014-04-09
2014-04-22
361/608/2014/2X
33 Cynthia Road, Salisbury SA 5108
VERANDAH
mailto:city@salisbury.sa.gov.au
2014-04-09
2014-04-22
361/523/2014/2T
On Council Verge to the Rear of 25 Natalie Avenue (Bungaree Street), Salisbury SA 5108
Removal of Tree (Significant) Located on Council Verge
mailto:city@salisbury.sa.gov.au
2014-04-09
2014-04-22
361/713/2014/2X
53 Northwater Way, Burton SA 5110
VERANDAH ON EASTERN BOUNDARY (10.9m Length)
mailto:city@salisbury.sa.gov.au
2014-04-09
2014-04-28
361/453/2014/2B
6 8-12 Capital Street, , Mawson Lakes SA 5095
Mixed Use Development (3 Storey) comprising Supermarket, Eleven (11) Shops, Seventy Seven (77) Dwellings (Student Accomodation) and Associated Signage
mailto:city@salisbury.sa.gov.au
2014-04-09
2014-04-24
361/663/2014/2X
18 Tania Street, Paralowie SA 5108
OUTBUILDING (SHED)
mailto:city@salisbury.sa.gov.au
2014-04-09
2014-04-24
361/698/2014/2T
Adjacent 6 Mercedes Court, Pooraka SA 5095
Regulated Tree Removal on Council Reserve
mailto:city@salisbury.sa.gov.au
2014-04-09
2014-04-24

Statistics

Average successful run time: less than a minute

Total run time: about 1 month

Total cpu time used: 36 minutes

Total disk space used: 500 KB

History

  • Auto ran revision f1fe1338 and failed .
    nothing changed in the database
  • Auto ran revision f1fe1338 and failed .
    nothing changed in the database
  • Auto ran revision f1fe1338 and completed successfully .
    22 records added in the database
    13 pages scraped
  • Auto ran revision f1fe1338 and completed successfully .
    5 records added in the database
  • Auto ran revision f1fe1338 and completed successfully .
    6 records added in the database
    12 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

salisbury / scraper.rb