LoveMyData / sutherland

README.md

Sutherland Shire Council Scraper

This site is a typical .NET site involves the followings.

  • Cookie - No
  • Pagnation - Yes
  • Javascript - Yes
  • Structured HTML - Good

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors mlandauer LoveMyData

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 1686 times by LoveMyData dcalde odnagroup

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.87 MB) Use the API

rows 10 / 6059

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to
DA17/0569
133 Fowler Rd ILLAWONG 2234
Construction & installation of shared jetty extending along the prolongation of the shared boundary & installation of ramp and pontoon
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0569
mailto:ssc@ssc.nsw.gov.au
2017-05-25
2017-05-23
2017-05-24
2017-06-07
DA17/0598
121 Linden St SUTHERLAND 2232
Construction of a cremator facility at Woronora Cemetary
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0598
mailto:ssc@ssc.nsw.gov.au
2017-05-25
2017-05-22
DA17/0600
Construction of new dwelling
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0600
mailto:ssc@ssc.nsw.gov.au
2017-05-25
2017-05-22
DA17/0601
12 Drummond Rd OYSTER BAY 2225
Construction of swimming pool, deck, retaining walls and pergola
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0601
mailto:ssc@ssc.nsw.gov.au
2017-05-25
2017-05-22
2017-05-26
2017-06-09
DA17/0602
468 Port Hacking Rd CARINGBAH 2229
Construction of 2 swimming pools in approved dual occupancy
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0602
mailto:ssc@ssc.nsw.gov.au
2017-05-25
2017-05-23
DA17/0603
Construction of new dwelling and retaining walls
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0603
mailto:ssc@ssc.nsw.gov.au
2017-05-25
2017-05-23
DA17/0604
117 Jannali Ave SUTHERLAND 2232
Two lot torrens title subdivision of approved dual occupancy
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0604
mailto:ssc@ssc.nsw.gov.au
2017-05-25
2017-05-23
DA17/0605
10 Warrangarree Dr WORONORA HEIGHTS 2233
Deck addition to existing residential dwelling
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0605
mailto:ssc@ssc.nsw.gov.au
2017-05-25
2017-05-23
DA17/0606
10 Wategos St GREENHILLS BEACH 2230
Construction of swimming pool
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0606
mailto:ssc@ssc.nsw.gov.au
2017-05-25
2017-05-23
DA17/0607
24 Stephen Rd ENGADINE 2233
Construction of retaining wall
http://ecerts.ssc.nsw.gov.au/eproperty/P1/eTrack/eTrackApplicationDetails.aspx?r=SSC.P1.WEBGUEST&f=$P1.ETR.APPDET.VIW&ApplicationId=DA17/0607
mailto:ssc@ssc.nsw.gov.au
2017-05-25
2017-05-23

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 32 minutes

Total disk space used: 2.9 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

sutherland / scraper.rb