LoveMyData / canada_bay

City Of Canada Bay Development Applications

README.md

City of Canada Bay Council scraper

This site is a typical .NET site involves the followings. * Pagnation - Not sure what happen after page 11? * Javascript - doPOSTBACK * Clearly defined data within a row - three cheers to this council

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default) * thismonth * lastmonth

It is now done and enjoy!!

Contributors LoveMyData

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 1809 times by LoveMyData MikeRalphson Lyndall Nigel78 dcalde odnagroup

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (4.53 MB) Use the API

rows 10 / 8417

id council_reference address description info_url comment_url date_scraped date_received
1
DA2015/0481
12 Thornley Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=DA2015/0481
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=DA2015/0481
2015-12-04
2015-11-30
2
DA2015/0480
1 Rider Boulevard Rhodes NSW 2138 Australia
Fitout and use of tenancies 45 and 46 for use as Rashay's restaurant
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=DA2015/0480
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=DA2015/0480
2015-12-04
2015-11-30
3
MOD2015/0207
19-21 Tennyson Road Breakfast Point NSW 2137 Australia
Modification Application - S96(1) Minor Modification
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=MOD2015/0207
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=MOD2015/0207
2015-12-04
2015-11-30
4
CDC2015/0329
2 Stanley Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Secondary Dwelling
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=CDC2015/0329
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=CDC2015/0329
2015-12-04
2015-11-30
5
CC2015/0307
12 Janet Street Drummoyne NSW 2047 Australia
Construction Certificate - Private Issued Construction Certificate - A single residenital dwelling (house, Duplex, etc)
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=CC2015/0307
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=CC2015/0307
2015-12-04
2015-11-30
6
CC2015/0306
39 Tavistock Street Drummoyne NSW 2047 Australia
Ground floor alterations and first floor addition to existing dwelling
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=CC2015/0306
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=CC2015/0306
2015-12-04
2015-11-30
7
CDC2015/0328
34 Boronia Street Concord West NSW 2138 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=CDC2015/0328
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=CDC2015/0328
2015-12-04
2015-11-30
8
DA2015/0479
13 Dening Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=DA2015/0479
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=DA2015/0479
2015-12-04
2015-11-30
9
OC2015/0455
82 Queen Street Concord West NSW 2138 Australia
Occupation Certificate - Private Issued Certificate
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=OC2015/0455
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=OC2015/0455
2015-12-04
2015-11-30
10
CDC2015/0327
2 Bayview Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=CDC2015/0327
https://eservices.canadabay.nsw.gov.au/eProperty/P1/eTrack/eTrackApplicationDetails.aspx?r=P1.WEBGUEST&f=%24P1.ETR.APPDET.VIW&ApplicationId=CDC2015/0327
2015-12-04
2015-11-30

Statistics

Average successful run time: less than a minute

Total run time: about 17 hours

Total cpu time used: 9 minutes

Total disk space used: 4.91 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

canada_bay / scraper.php