planningalerts-scrapers / wagga

Scrapes eservices.wagga.nsw.gov.au

Online Services - Home Page


This is a scraper that runs on Morph. To get started see the documentation

Contributors mlandauer equivalentideas

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.0.0 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Rubygems 2.0.14.1 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Using bundler 1.15.2  Fetching unf_ext 0.0.7.1  Installing unf_ext 0.0.7.1 with native extensions  Fetching httpclient 2.7.0.1  Installing httpclient 2.7.0.1  Fetching mime-types 2.6.2  Installing mime-types 2.6.2  Fetching net-http-digest_auth 1.4  Installing net-http-digest_auth 1.4  Fetching net-http-persistent 2.9.4  Installing net-http-persistent 2.9.4  Fetching mini_portile 0.6.2  Installing mini_portile 0.6.2  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.1  Installing webrobots 0.1.1  Fetching sqlite3 1.3.11  Installing sqlite3 1.3.11 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching nokogiri 1.6.6.2  Installing nokogiri 1.6.6.2 with native extensions  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching domain_name 0.5.25  Installing domain_name 0.5.25  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching mechanize 2.7.3  Installing mechanize 2.7.3  Bundle complete! 2 Gemfile dependencies, 17 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (31.73s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Skipping already saved record AA18/0678 Skipping already saved record AA18/0681 Skipping already saved record AA18/0687 Skipping already saved record AA18/0694 Skipping already saved record AA18/0696 Skipping already saved record AA18/0699 Skipping already saved record AA18/0701 Skipping already saved record AA18/0702 Skipping already saved record AA18/0704 Skipping already saved record AA18/0705 Skipping already saved record AA18/0679 Skipping already saved record AA18/0685 Skipping already saved record AA18/0690 Skipping already saved record AA18/0692 Getting page 2... Skipping already saved record AA18/0693 Skipping already saved record AA18/0698 Skipping already saved record AA18/0695 Skipping already saved record AA18/0680 Skipping already saved record AA18/0682 Skipping already saved record AA18/0683 Skipping already saved record AA18/0684 Skipping already saved record AA18/0686 Skipping already saved record AA18/0688 Skipping already saved record AA18/0689 Skipping already saved record AA18/0697 Skipping already saved record AA18/0703 Skipping already saved record AA18/0691 Skipping already saved record DA12/0332.05 Skipping already saved record DA16/0423.02 Getting page 3... Skipping already saved record DA17/0754.01 Skipping already saved record DA18/0086.01 Skipping already saved record DA18/0338.01 Skipping already saved record CC18/0396 Skipping already saved record CC18/0397 Skipping already saved record CC18/0399 Skipping already saved record CC18/0400 Skipping already saved record CC18/0401 Skipping already saved record CC18/0402 Skipping already saved record CC18/0404 Skipping already saved record CC18/0407 Skipping already saved record CC18/0408 Skipping already saved record CC18/0410 Getting page 4... Skipping already saved record CC18/0409 Skipping already saved record CC18/0395 Skipping already saved record CC18/0398 Skipping already saved record CC18/0403 Skipping already saved record CC18/0406 Skipping already saved record CDC18/0227 Skipping already saved record CDC18/0228 Skipping already saved record CDC18/0241 Skipping already saved record CDC18/0215 Skipping already saved record CDC18/0216 Skipping already saved record CDC18/0217 Skipping already saved record CDC18/0218 Skipping already saved record CDC18/0219 Skipping already saved record CDC18/0220 Getting page 5... Skipping already saved record CDC18/0221 Skipping already saved record CDC18/0222 Skipping already saved record CDC18/0223 Skipping already saved record CDC18/0224 Skipping already saved record CDC18/0225 Skipping already saved record CDC18/0226 Skipping already saved record CDC18/0229 Skipping already saved record CDC18/0230 Skipping already saved record CDC18/0231 Skipping already saved record CDC18/0232 Skipping already saved record CDC18/0233 Skipping already saved record CDC18/0234 Skipping already saved record CDC18/0235 Skipping already saved record CDC18/0236 Skipping already saved record CDC18/0237 Getting page 6... Skipping already saved record CDC18/0238 Skipping already saved record CDC18/0239 Skipping already saved record CDC18/0240 Skipping already saved record CDC18/0242 Skipping already saved record DA18/0515 Skipping already saved record DA18/0501 Skipping already saved record DA18/0517 Skipping already saved record DA18/0502 Skipping already saved record DA18/0505 Skipping already saved record DA18/0506 Skipping already saved record DA18/0507 Skipping already saved record DA18/0509 Skipping already saved record DA18/0511 Skipping already saved record DA18/0513 Getting page 7... Skipping already saved record DA18/0516 Skipping already saved record DA18/0503 Skipping already saved record DA18/0504 Skipping already saved record DA18/0508 Skipping already saved record DA18/0514 Skipping already saved record DA18/0510 Skipping already saved record eCDC18/0001 Skipping already saved record eBC18/0014 Skipping already saved record eTP18/0012

Data

Downloaded 2235 times by openaustralia LoveMyData jesse-a-reilly TheZepto henare MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.44 MB) Use the API

rows 10 / 9877

council_reference date_received description address date_scraped info_url comment_url
DA07/0683.04
2014-03-24
Proposed Staged Development for Two (2) Dwelling Houses - Modification of Dwelling Location, Site Access & Vegetation Buffer Area
Old Narrandera Rd GOBBAGOMBALIN NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
DA11/0510.02
2014-03-26
187 Lot Residential Subdivision - Change Lot Layout (Number of Lots Reduced)
Deakin Ave LLOYD NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0142
2014-03-25
Dwelling, Garage, Patio, Portico & Shed - Addition of Roller Door & Underfloor Storage
3 Buckley Crt LAKE ALBERT NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0144
2014-03-26
NBN Tower
211 East Bomen Rd BOMEN NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0146
2014-03-27
Part Demolition of Garage & Dwelling, Alterations & Additions to Garage & Dwelling, Construction of First Floor Addition to Garage, Construction of Terrace, Pergola & Swimming Pool
29 Wollundry Ave WAGGA WAGGA NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0148
2014-03-27
Alterations & Additions to Registered Club (Commercial Club)
77 Gurwood St WAGGA WAGGA NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0150
2014-03-28
Dwelling, Garage & Alfresco
14 Pooginook Pl BOURKELANDS NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
CC14/0152
2014-03-28
Dwelling, Garage & Alfresco
7 Pooginook Pl BOURKELANDS NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
DA11/0299.01
2014-03-27
Addition of 2nd Storey, Deck & Alterations to Dwelling - Delete Alterations to South West Side, Include a Solid Roof over Deck & Increase Size of Laundry
30 The Boulevarde KOORINGAL NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au
DA12/0027.03
2014-03-28
Consolidation of 2 Lots & Construction of 2 Industrial Units to be Community Titled Subdivided with the Use of Unit 1 as a Wholesale Supplies - Reduce Building Footprint of Unit 2
85 Copland St EAST WAGGA WAGGA NSW 2650
2014-04-05
mailto:council@wagga.nsw.gov.au

Statistics

Average successful run time: 2 minutes

Total run time: 12 days

Total cpu time used: 34 minutes

Total disk space used: 3.46 MB

History

  • Auto ran revision b76f4e64 and completed successfully .
    7 records added in the database
    7 pages scraped
  • Auto ran revision b76f4e64 and completed successfully .
    16 records added in the database
  • Auto ran revision b76f4e64 and completed successfully .
    17 records added in the database
    8 pages scraped
  • Auto ran revision b76f4e64 and completed successfully .
    nothing changed in the database
    8 pages scraped
  • Auto ran revision b76f4e64 and completed successfully .
    7 records added in the database
    8 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

wagga / scraper.rb