This is a scraper that runs on Morph. To get started see the documentation

Contributors mlandauer equivalentideas

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Using bundler 1.15.2  Fetching unf_ext 0.0.7.1  Installing unf_ext 0.0.7.1 with native extensions  Fetching httpclient 2.7.0.1  Installing httpclient 2.7.0.1  Fetching mime-types 2.6.2  Installing mime-types 2.6.2  Fetching net-http-digest_auth 1.4  Installing net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile 0.6.2  Installing mini_portile 0.6.2  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.1  Installing webrobots 0.1.1  Fetching sqlite3 1.3.11  Installing sqlite3 1.3.11 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching nokogiri 1.6.6.2  Installing nokogiri 1.6.6.2 with native extensions  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching domain_name 0.5.25  Installing domain_name 0.5.25  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (25.72s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Skipping already saved record AA19/0200 Skipping already saved record AA19/0202 Skipping already saved record AA19/0203 Skipping already saved record AA19/0204 Skipping already saved record AA19/0205 Skipping already saved record AA19/0206 Skipping already saved record AA19/0207 Skipping already saved record AA19/0208 Skipping already saved record AA19/0209 Skipping already saved record AA19/0210 Skipping already saved record AA19/0211 Skipping already saved record AA19/0212 Skipping already saved record AA19/0213 Skipping already saved record AA19/0214 Skipping already saved record AA19/0216 Getting page 2... Skipping already saved record AA19/0217 Skipping already saved record AA19/0218 Skipping already saved record AA19/0219 Skipping already saved record AA19/0220 Skipping already saved record AA19/0221 Skipping already saved record AA19/0222 Skipping already saved record AA19/0223 Skipping already saved record AA19/0224 Skipping already saved record AA19/0225 Skipping already saved record AA19/0226 Skipping already saved record AA19/0227 Skipping already saved record AA19/0228 Getting page 3... Skipping already saved record DA14/0556.08 Skipping already saved record AA19/0201 Skipping already saved record AA19/0215 Skipping already saved record DA15/0717.06 Skipping already saved record DA18/0060.01 Skipping already saved record DA18/0415.01 Skipping already saved record DA19/0191 Skipping already saved record CC18/0241.01 Skipping already saved record CC19/0131 Getting page 4... Skipping already saved record CC19/0132 Skipping already saved record CC19/0133 Skipping already saved record CC19/0135 Skipping already saved record CC19/0136 Skipping already saved record CC19/0137 Skipping already saved record CC19/0139 Skipping already saved record CC19/0140 Skipping already saved record CC19/0143 Skipping already saved record CC19/0144 Skipping already saved record CC19/0145 Skipping already saved record CC19/0146 Skipping already saved record CC19/0147 Skipping already saved record CC19/0148 Skipping already saved record CC19/0149 Skipping already saved record CC19/0150 Getting page 5... Skipping already saved record CC19/0151 Skipping already saved record CDC19/0079 Skipping already saved record DA19/0184 Skipping already saved record DA19/0187 Skipping already saved record DA19/0188 Skipping already saved record DA19/0190 Skipping already saved record DA19/0192 Skipping already saved record DA19/0194 Skipping already saved record DA19/0197 Skipping already saved record DA19/0198 Skipping already saved record DA19/0199 Skipping already saved record DA19/0200 Skipping already saved record DA19/0202 Getting page 6... Skipping already saved record DA19/0203 Skipping already saved record DA19/0205 Skipping already saved record DA19/0208 Skipping already saved record CC19/0134 Skipping already saved record CC19/0138 Skipping already saved record CC19/0141 Skipping already saved record CC19/0142 Skipping already saved record CDC19/0074 Skipping already saved record CDC19/0075 Skipping already saved record CDC19/0076 Skipping already saved record CDC19/0077 Skipping already saved record CDC19/0078 Skipping already saved record CDC19/0080 Skipping already saved record CDC19/0081 Getting page 7... Skipping already saved record DA19/0183 Skipping already saved record DA19/0185 Skipping already saved record DA19/0186 Skipping already saved record DA19/0193 Skipping already saved record DA19/0195 Skipping already saved record DA19/0206 Skipping already saved record DA19/0196 Skipping already saved record eBC19/0012 Skipping already saved record eBC19/0013 Skipping already saved record DA19/0181 Skipping already saved record DA19/0189 Skipping already saved record DA19/0204 Skipping already saved record eSPC19/0022 Skipping already saved record eSPC19/0023 Skipping already saved record eSPC19/0024

Data

Downloaded 2840 times by openaustralia LoveMyData WilliamYun jesse-a-reilly TheZepto Jedwards157 henare MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.88 MB) Use the API

rows 10 / 11141

council_reference date_received description address date_scraped info_url comment_url
DA07/0683.04
2014-03-24
Proposed Staged Development for Two (2) Dwelling Houses - Modification of Dwelling Location, Site Access & Vegetation Buffer Area
Old Narrandera Rd GOBBAGOMBALIN NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
DA11/0510.02
2014-03-26
187 Lot Residential Subdivision - Change Lot Layout (Number of Lots Reduced)
Deakin Ave LLOYD NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0142
2014-03-25
Dwelling, Garage, Patio, Portico & Shed - Addition of Roller Door & Underfloor Storage
3 Buckley Crt LAKE ALBERT NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0144
2014-03-26
NBN Tower
211 East Bomen Rd BOMEN NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0146
2014-03-27
Part Demolition of Garage & Dwelling, Alterations & Additions to Garage & Dwelling, Construction of First Floor Addition to Garage, Construction of Terrace, Pergola & Swimming Pool
29 Wollundry Ave WAGGA WAGGA NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0148
2014-03-27
Alterations & Additions to Registered Club (Commercial Club)
77 Gurwood St WAGGA WAGGA NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0150
2014-03-28
Dwelling, Garage & Alfresco
14 Pooginook Pl BOURKELANDS NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0152
2014-03-28
Dwelling, Garage & Alfresco
7 Pooginook Pl BOURKELANDS NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
DA11/0299.01
2014-03-27
Addition of 2nd Storey, Deck & Alterations to Dwelling - Delete Alterations to South West Side, Include a Solid Roof over Deck & Increase Size of Laundry
30 The Boulevarde KOORINGAL NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
DA12/0027.03
2014-03-28
Consolidation of 2 Lots & Construction of 2 Industrial Units to be Community Titled Subdivided with the Use of Unit 1 as a Wholesale Supplies - Reduce Building Footprint of Unit 2
85 Copland St EAST WAGGA WAGGA NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au

Statistics

Average successful run time: 1 minute

Total run time: 12 days

Total cpu time used: 38 minutes

Total disk space used: 3.91 MB

History

  • Auto ran revision b76f4e64 and completed successfully .
    12 records added in the database
  • Auto ran revision b76f4e64 and completed successfully .
    12 records added in the database
  • Auto ran revision b76f4e64 and completed successfully .
    nothing changed in the database
  • Auto ran revision b76f4e64 and completed successfully .
    22 records added in the database
  • Auto ran revision b76f4e64 and completed successfully .
    4 records added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wagga / scraper.rb