LoveMyData / noosa_council

Noosa Council Development Applications


Noosa Council Scraper

  • Server - Microsoft
  • System - eProperty
  • Cookie tracking - No
  • Pagination - Yes
  • Javascript - Yes __doPostBack
  • Detail Page - Yes
  • Clearly defined data within a row - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors otherchirps henare LoveMyData

The scraper is running. It was queued automatically .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data in `thisweek`, changable via MORPH_PERIOD environment Scraping page 1 of 1 Saving record RAB22/0151 - 244 Highfield Rise POMONA QLD 4568 Skipping already saved record RAB22/0150 Saving record OPW22/0200 - Doonella Noosa 12 Jacksonia Pl NOOSAVILLE QLD 4566 Saving record OPW22/0201 - Laguna Villa 10 Edgar Bennett Ave NOOSA HEADS QLD 4567 Saving record OPW22/0202 - Noosa Blue 16 Noosa Dr NOOSA HEADS QLD 4567 Saving record OPW22/0203 - 17 Lake Entrance Bvd NOOSAVILLE QLD 4566 Skipping already saved record RAB22/0149 Skipping already saved record DBW22/0035.01 Skipping already saved record DBW22/0115 Skipping already saved record DBW22/0116 Skipping already saved record DBW22/0117 Saving record 51989.101.02 - Noosaville Plaza 10 Thomas St NOOSAVILLE QLD 4566

Data

Downloaded 1990 times by LoveMyData dcalde

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.99 MB) Use the API

rows 10 / 6572

council_reference address description info_url comment_url date_scraped date_received
OPW17/0192
Jalee 19 Henderson St SUNSHINE BEACH QLD 4567
19 Henderson Stret, Sunshine Beach - Vegetation Removal - Diamond Tre Services
mailto:mail@noosa.qld.gov.au
2017-06-02
2017-06-02
RAB17/0080
22 Mcanally Dr SUNSHINE BEACH QLD 4567
2 Mcanaly Dr SUNSHINE BEACH - Carport & Storerom in Front Boundary
mailto:mail@noosa.qld.gov.au
2017-06-02
2017-06-02
OPW17/0191
Bayona 30 Alderly Tce NOOSA HEADS QLD 4567
30 Alderly Terace, Nosa Heads - Vegetation Clearing - Profesional Tre Surgery
mailto:mail@noosa.qld.gov.au
2017-06-02
2017-06-02
RAB17/0079
4 Pipi Cres NOOSAVILLE QLD 4566
4 Pipi Cres NOSAVILE - Carport & Covered Deck within boundary setbacks
mailto:mail@noosa.qld.gov.au
2017-06-02
2017-06-02
OPW17/0190
The Emerald Noosa 42 Hastings St NOOSA HEADS QLD 4567
42 Hastings Stret, Nosa Heads - Vegetation Clearing - Nosa Tre Man
mailto:mail@noosa.qld.gov.au
2017-06-02
2017-05-31
PC17/0537
52 Seaview Tce SUNSHINE BEACH QLD 4567
Alterations & Aditions to Dweling - 52 Seaview Tce SUNSHINE BEACH
mailto:mail@noosa.qld.gov.au
2017-06-02
2017-05-31
PS17/0019
24 Ann St NOOSAVILLE QLD 4566
24 An St NOSAVILE - Building Format lots 1-2 & Comon Property, EMT A&B in Comon Property (Canceling Lot 9RP8159) - Skylines Surveyors
mailto:mail@noosa.qld.gov.au
2017-06-02
2017-05-30
PS17/0018
38 Pavilion St POMONA QLD 4568
38 Pavilion St POMONA - Standard Format Lots 1 & 2, EMT A in Lot 2 SP29373 (Canceling Lot 1 RP196984) - Max Waterson & Asoc
mailto:mail@noosa.qld.gov.au
2017-06-02
2017-05-30
PS17/0017
Lake Macdonald Dr LAKE MACDONALD QLD 4563
Botanical Gardens Lake Macdonald Dr LAKE MACDONALD - Standard Format - EMT B in Lot 1 RP167258 - Max Waterson & Asoc
mailto:mail@noosa.qld.gov.au
2017-06-02
2017-05-30
RAB17/0078
89 Lake Weyba Dr NOOSAVILLE QLD 4566
89 Lake Weyba Dr NOSAVILE - Carport within boundary setback
mailto:mail@noosa.qld.gov.au
2017-06-02
2017-05-30

Statistics

Average successful run time: 2 minutes

Total run time: 2 days

Total cpu time used: 37 minutes

Total disk space used: 3.04 MB

History

  • Auto ran revision dfddafc5 and completed successfully .
    6 records added in the database
  • Auto ran revision dfddafc5 and completed successfully .
    1 record added in the database
  • Auto ran revision dfddafc5 and completed successfully .
    nothing changed in the database
  • Auto ran revision dfddafc5 and completed successfully .
    5 records added in the database
  • Auto ran revision dfddafc5 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

noosa_council / scraper.rb