LoveMyData / lake_macquarie

Lake Macquarie Development Applications (ATDIS)

README.md

Lake Macquarie City Council Scraper

This council involves the followings

Server - .NET - ApplicationMaster
Accept Terms - Yes
Cookie tracking - Yes
UserAgent - No
Request actual DA page for data - No
Clearly defined data within a row - No, No, No, Very messy

Setup MORPH_PERIOD for data recovery, available options are

thisweek (default)
thismonth
lastmonth
custom = yyyy-mm (eg. 2017-01)

Enjoy

Contributors

Last run failed 2023-02-07 with status code 999.

Console output of last run

Data

Downloaded 977 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (844 KB) Use the API

rows 10 / 2473

council_reference	address	description	info_url	comment_url	date_scraped	date_received
DA-1690/2018	5 Jonquil Close TORONTO NSW 2283	Dual Occupancy Attached 1 into 2 Lot Torrens Title Subdivison	http://apptracking.lakemac.com.au/modules/ApplicationMaster/default.aspx?page=appwrapper&key=1173254	mailto:council@lakemac.nsw.gov.au	2018-11-28	2018-10-02
DA-1691/2018	38 Stingaree Point Drive DORA CREEK NSW 2264	Alfresco and Garage	http://apptracking.lakemac.com.au/modules/ApplicationMaster/default.aspx?page=appwrapper&key=1173265	mailto:council@lakemac.nsw.gov.au	2018-11-28	2018-10-02
DA-1512/2017/B	43 Croft Road ELEEBANA NSW 2282	Proposed Garage and Retaining Wall - Section 4.55 Amended Plans	http://apptracking.lakemac.com.au/modules/ApplicationMaster/default.aspx?page=appwrapper&key=1173285	mailto:council@lakemac.nsw.gov.au	2018-11-28	2018-10-02
DA-1692/2018	282 Pacific Highway BELMONT NORTH NSW 2280	Alterations and Additions	http://apptracking.lakemac.com.au/modules/ApplicationMaster/default.aspx?page=appwrapper&key=1173295	mailto:council@lakemac.nsw.gov.au	2018-11-28	2018-10-02
DA-1693/2018	52 Mahers Road MARTINSVILLE NSW 2265	Shed	http://apptracking.lakemac.com.au/modules/ApplicationMaster/default.aspx?page=appwrapper&key=1173335	mailto:council@lakemac.nsw.gov.au	2018-11-28	2018-10-02
DA-1694/2018	9 Trafalgar Crescent VALENTINE NSW 2280	Alterations to Existing Deck, Concrete Swimming Pool and Safety Barriers, Roofed Pergola and Retaining Walls	http://apptracking.lakemac.com.au/modules/ApplicationMaster/default.aspx?page=appwrapper&key=1173370	mailto:council@lakemac.nsw.gov.au	2018-11-28	2018-10-02
DA-1695/2018	99 Glad Gunson Drive ELEEBANA NSW 2282	Deck	http://apptracking.lakemac.com.au/modules/ApplicationMaster/default.aspx?page=appwrapper&key=1173441	mailto:council@lakemac.nsw.gov.au	2018-11-28	2018-10-02
DA-1696/2018	24 Tora Street TORONTO NSW 2283	Storage Shed	http://apptracking.lakemac.com.au/modules/ApplicationMaster/default.aspx?page=appwrapper&key=1173554	mailto:council@lakemac.nsw.gov.au	2018-11-28	2018-10-02
DA-1697/2018	1 Ernest Street BELMONT NSW 2280	Garaport & Workshop/Storage Shed	http://apptracking.lakemac.com.au/modules/ApplicationMaster/default.aspx?page=appwrapper&key=1173557	mailto:council@lakemac.nsw.gov.au	2018-11-28	2018-10-02
DA-1698/2018	10 McIntyre Street CARDIFF NSW 2285	Garage	http://apptracking.lakemac.com.au/modules/ApplicationMaster/default.aspx?page=appwrapper&key=1173559	mailto:council@lakemac.nsw.gov.au	2018-11-28	2018-10-02

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 22 minutes

Total disk space used: 873 KB

History

Auto ran and failed 2023-02-07.

run time 0 s
Auto ran and failed 2023-02-06.

run time 0 s
Auto ran and failed 2023-02-05.

run time 0 s
Auto ran and failed 2023-02-04.

run time 0 s
Auto ran and failed 2023-02-03.

run time 0 s
...
Created on morph.io 2018-11-28

Show complete history

Scraper code

Ruby

lake_macquarie / scraper.rb

git clone URL