LoveMyData / lake_macquarie

Lake Macquarie Development Applications (ATDIS)


Lake Macquarie City Council Scraper

This council involves the followings

  • Server - .NET - ApplicationMaster
  • Accept Terms - Yes
  • Cookie tracking - Yes
  • UserAgent - No
  • Request actual DA page for data - No
  • Clearly defined data within a row - No, No, No, Very messy

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth
  • custom = yyyy-mm (eg. 2017-01)

Enjoy

Contributors LoveMyData CloCkWeRX mlandauer

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 977 times by LoveMyData jacroft408 dcalde EMBLAPROJECTS MichaelBone

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (844 KB) Use the API

rows 10 / 2473

council_reference address description info_url comment_url date_scraped date_received
council_reference
DA-1690/2018
address
5 Jonquil Close TORONTO NSW 2283
description
Dual Occupancy Attached 1 into 2 Lot Torrens Title Subdivison
info_url comment_url
mailto:council@lakemac.nsw.gov.au
date_scraped
2018-11-28
date_received
2018-10-02
council_reference
DA-1691/2018
address
38 Stingaree Point Drive DORA CREEK NSW 2264
description
Alfresco and Garage
info_url comment_url
mailto:council@lakemac.nsw.gov.au
date_scraped
2018-11-28
date_received
2018-10-02
council_reference
DA-1512/2017/B
address
43 Croft Road ELEEBANA NSW 2282
description
Proposed Garage and Retaining Wall - Section 4.55 Amended Plans
info_url comment_url
mailto:council@lakemac.nsw.gov.au
date_scraped
2018-11-28
date_received
2018-10-02
council_reference
DA-1692/2018
address
282 Pacific Highway BELMONT NORTH NSW 2280
description
Alterations and Additions
info_url comment_url
mailto:council@lakemac.nsw.gov.au
date_scraped
2018-11-28
date_received
2018-10-02
council_reference
DA-1693/2018
address
52 Mahers Road MARTINSVILLE NSW 2265
description
Shed
info_url comment_url
mailto:council@lakemac.nsw.gov.au
date_scraped
2018-11-28
date_received
2018-10-02
council_reference
DA-1694/2018
address
9 Trafalgar Crescent VALENTINE NSW 2280
description
Alterations to Existing Deck, Concrete Swimming Pool and Safety Barriers, Roofed Pergola and Retaining Walls
info_url comment_url
mailto:council@lakemac.nsw.gov.au
date_scraped
2018-11-28
date_received
2018-10-02
council_reference
DA-1695/2018
address
99 Glad Gunson Drive ELEEBANA NSW 2282
description
Deck
info_url comment_url
mailto:council@lakemac.nsw.gov.au
date_scraped
2018-11-28
date_received
2018-10-02
council_reference
DA-1696/2018
address
24 Tora Street TORONTO NSW 2283
description
Storage Shed
info_url comment_url
mailto:council@lakemac.nsw.gov.au
date_scraped
2018-11-28
date_received
2018-10-02
council_reference
DA-1697/2018
address
1 Ernest Street BELMONT NSW 2280
description
Garaport & Workshop/Storage Shed
info_url comment_url
mailto:council@lakemac.nsw.gov.au
date_scraped
2018-11-28
date_received
2018-10-02
council_reference
DA-1698/2018
address
10 McIntyre Street CARDIFF NSW 2285
description
Garage
info_url comment_url
mailto:council@lakemac.nsw.gov.au
date_scraped
2018-11-28
date_received
2018-10-02

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 22 minutes

Total disk space used: 873 KB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

lake_macquarie / scraper.rb