LoveMyData / coffs_harbour

Coffs Harbour City Council Development Applications


Coffs Harbour City Council Scraper

This site is a typical .NET site involves the followings.

  • RSS - Yes
  • HTTPS - MUST

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.4  Fetching httpclient 2.8.3  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching net-http-digest_auth 1.4.1  Installing unf_ext 0.0.7.4 with native extensions  Installing net-http-digest_auth 1.4.1  Fetching net-http-persistent 2.9.4  Installing httpclient 2.8.3  Installing net-http-persistent 2.9.4  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.2  Fetching sqlite3 1.3.13  Installing webrobots 0.1.2  Fetching mime-types 3.1  Installing sqlite3 1.3.13 with native extensions  Installing mime-types 3.1  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20170404  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.5  Installing mechanize 2.7.5  Bundle complete! 2 Gemfile dependencies, 18 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (52.26s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data in `thisweek`, changable via MORPH_PERIOD environment Saving record 1035/18DA, 3 RAMORNIE DRIVE TORMINA NSW 2452

Data

Downloaded 539 times by LoveMyData

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (627 KB) Use the API

rows 10 / 2101

council_reference description date_received address info_url comment_url date_scraped
0200/17DA
Above Ground Structures - RETAINING WALL
2016-09-05
9 KOOKABURRA CLOSE BOAMBEE EAST NSW 2452
mailto:coffs.council@chcc.nsw.gov.au
2016-09-12
0221/17DA
Change of Land Use D/A - Machinery Shed + Sign
2016-09-12
34 HULBERTS ROAD TOORMINA NSW 2452
mailto:coffs.council@chcc.nsw.gov.au
2016-09-12
0216/17DA
Change of Land Use D/A - Convert existing studio to granny flat
2016-09-09
30 A BRODIE DRIVE COFFS HARBOUR NSW 2450
mailto:coffs.council@chcc.nsw.gov.au
2016-09-12
0045/17DM
Development Application Modification - (ref statement of environmental effects)
2016-09-12
66 A MORGANS ROAD SANDY BEACH NSW 2456
mailto:coffs.council@chcc.nsw.gov.au
2016-09-12
0044/17DM
Development Application Modification - 0197/97DA (Historical) - HOLIDAY CABINS
2016-09-09
219 OLD COAST ROAD KORORA NSW 2450
mailto:coffs.council@chcc.nsw.gov.au
2016-09-12
0043/17DM
Dwelling additions - MODIFICATION ( extending deck)
2016-09-07
114 JORDANS WAY (ROW) KORORA NSW 2450
mailto:coffs.council@chcc.nsw.gov.au
2016-09-12
0042/17DM
Childcare Centre - MODIFICATION - (proposed storage area mis-described a 'laundry'
2016-09-07
2 B MOONEE BEACH ROAD MOONEE BEACH NSW 2450
mailto:coffs.council@chcc.nsw.gov.au
2016-09-12
0041/17DM
Dual Occupancy (Detached)
2016-09-05
1 WALKER CLOSE COFFS HARBOUR NSW 2450
mailto:coffs.council@chcc.nsw.gov.au
2016-09-12
0040/17DM
Strata title subdivision incorporating a mix of multi-unit housing & attached dual occupancy (177 dwelling units) with communal open space areas including a communal/recreation centre building - staged development - THE SUMMIT
2016-09-05
2 - 2 MASTRACOLAS ROAD COFFS HARBOUR NSW 2450
mailto:coffs.council@chcc.nsw.gov.au
2016-09-12
0198/17DA
Secondary Dwelling & Single Garage
2016-09-06
5 PANDANUS PLACE WOOLGOOLGA NSW 2456
mailto:coffs.council@chcc.nsw.gov.au
2016-09-12

Statistics

Average successful run time: 9 minutes

Total run time: 3 days

Total cpu time used: 13 minutes

Total disk space used: 656 KB

History

  • Auto ran revision 9bc04af8 and completed successfully .
    1 record added in the database
  • Auto ran revision 9bc04af8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9bc04af8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9bc04af8 and completed successfully .
    21 records added in the database
  • Auto ran revision 9bc04af8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

coffs_harbour / scraper.rb