planningalerts-scrapers / kiama

Kiama Municipal Council development applications for PlanningAlerts

Scrapes da.kiama.nsw.gov.au

The official Kiama Municipal Council Development Application Tracker (DA Tracker)


This is a scraper that runs on Morph. To get started see the documentation

Contributors henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  The git source `git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git` uses the `git` protocol, which transmits data without encryption. Disable this warning with `bundle config git.allow_insecure true`, or switch to the `https` protocol to keep your data secure.  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git  Fetching i18n 0.7.0  Using json 1.8.3  Fetching minitest 5.8.4  Fetching thread_safe 0.3.5  Installing i18n 0.7.0  Installing minitest 5.8.4  Installing thread_safe 0.3.5  Fetching builder 3.2.2  Fetching multi_json 1.11.2  Installing builder 3.2.2  Installing multi_json 1.11.2  Fetching unf_ext 0.0.7.2  Fetching mime-types 2.99.1  Fetching netrc 0.11.0  Installing unf_ext 0.0.7.2 with native extensions  Installing netrc 0.11.0  Fetching rgeo 0.5.3  Installing mime-types 2.99.1  Fetching httpclient 2.7.1  Installing httpclient 2.7.1  Installing rgeo 0.5.3 with native extensions  Fetching sqlite3 1.3.11  Installing sqlite3 1.3.11 with native extensions  Using bundler 1.15.2  Fetching tzinfo 1.2.2  Installing tzinfo 1.2.2  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching activesupport 4.2.6  Installing activesupport 4.2.6  Fetching domain_name 0.5.20160309  Installing domain_name 0.5.20160309  Fetching activemodel 4.2.6  Installing activemodel 4.2.6  Fetching http-cookie 1.0.2  Installing http-cookie 1.0.2  Fetching rest-client 1.8.0  Installing rest-client 1.8.0  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Fetching scraperwiki 3.0.2  Installing scraperwiki 3.0.2  Fetching scraperwiki-morph 0.1.1  Installing scraperwiki-morph 0.1.1  Fetching rgeo-geojson 0.4.2  Installing rgeo-geojson 0.4.2  Fetching atdis 0.3.13  Installing atdis 0.3.13  Using atdisplanningalertsfeed 0.0.1 from git://github.com/planningalerts-scrapers/atdisplanningalertsfeed.git (at master@ce20de6)  Bundle complete! 1 Gemfile dependency, 26 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (16.88s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Saving page 1 of 9 Skipping already saved record 010.2017.00000340.002 Skipping already saved record 010.2018.00000286.001 Skipping already saved record 010.2015.00000332.003 Saving page 2 of 4 Skipping already saved record 010.2018.00000281.001 Skipping already saved record 010.2018.00000287.001 Skipping already saved record 010.2018.00000288.001 Skipping already saved record 010.2017.00000255.002 Skipping already saved record 010.2017.00000270.002 Skipping already saved record 010.2018.00000282.001 Skipping already saved record 010.2018.00000285.001 Skipping already saved record 010.2018.00000283.001 Skipping already saved record 010.2018.00000284.001 Skipping already saved record 010.2018.00000276.001 Saving page 3 of 4 Skipping already saved record 010.2018.00000275.001 Skipping already saved record 010.2018.00000198.002 Skipping already saved record 010.2016.00000318.002 Skipping already saved record 010.2018.00000279.001 Skipping already saved record 010.2018.00000277.001 Skipping already saved record 010.2018.00000278.001 Skipping already saved record 010.2011.00000185.002 Skipping already saved record 010.2018.00000273.001 Skipping already saved record 010.2018.00000274.001 Skipping already saved record 010.2016.00000281.003 Saving page 4 of 4 Skipping already saved record 010.2018.00000272.001 Skipping already saved record 010.2018.00000271.001

Data

Downloaded 1949 times by openaustralia LoveMyData Rogerlyle jesse-a-reilly TheZepto MikeRalphson duleorlovic

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (394 KB) Use the API

rows 10 / 1222

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to
010.2015.00000142.002
15 Wyalla RD, JAMBEROO, NSW 2533
torrens subdivision
2016-03-14
2016-02-23
010.2016.00000019.001
61 Alne Bank LA, GERRINGONG, NSW 2534
roof mounted hot water system
2016-03-14
2016-02-15
010.2016.00000033.001
94 Barney ST, KIAMA, NSW 2533
three (3) lot torrens title subdivision
2016-03-14
2016-03-02
2016-03-04
2016-03-18
010.2016.00000020.001
5 Minnamurra LA, JAMBEROO, NSW 2533
demolition of existing dwelling and construction of new dwelling
2016-03-14
2016-02-18
010.2015.00000049.002
31 Cliff DR, KIAMA DOWNS, NSW 2533
addition to dwelling additions and demolition addition to dwelling additions demolition
2016-03-14
2016-02-18
010.1998.00000299.002
21 Johnson ST, KIAMA DOWNS, NSW 2533
modified - refurbishment of existing shop & establishment of a bakery & fascia sign
2016-03-14
2016-03-04
010.2016.00000022.001
Terralong ST, KIAMA, NSW 2533
use of black beach for three (3) day festival
2016-03-14
2016-02-22
010.2015.00000292.002
101B Tingira CR, KIAMA, NSW 2533
modified - dwelling alterations and additions and attached deck
2016-03-14
2016-03-07
2016-03-08
2016-03-22
010.2016.00000037.001
88 Barton DR, KIAMA DOWNS, NSW 2533
three (3) lot residential subdivision including demolition of garage to facilitate access
2016-03-14
2016-03-04
2016-03-09
2016-03-23
010.2016.00000036.001
69 Werri ST, WERRI BEACH, NSW 2534
demolition of existing dwelling & ancillary structures
2016-03-14
2016-03-03
2016-03-09
2016-03-23

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: 21 minutes

Total disk space used: 416 KB

History

  • Auto ran revision 8c314282 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 8c314282 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 8c314282 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 8c314282 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 8c314282 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

kiama / scraper.rb