planningalerts-scrapers / canada_bay

City Of Canada Bay Development Applications

Scrapes eservices.canadabay.nsw.gov.au

Canada Bay - Home Page


City of Canada Bay Council scraper

This site is a typical .NET site involves the followings. * Pagnation - Not sure what happen after page 11? * Javascript - doPOSTBACK * Clearly defined data within a row - three cheers to this council

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default) * thismonth * lastmonth

It is now done and enjoy!!

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping page 1 of 11 Skipping already saved record PC2018/0108 Skipping already saved record PC2018/0107 Skipping already saved record PC2018/0106 Skipping already saved record MOD2018/0009 Skipping already saved record PC2018/0105 Skipping already saved record PC2018/0104 Skipping already saved record PC2018/0103 Skipping already saved record CDC2018/0017 Skipping already saved record PC2018/0102 Skipping already saved record PC2018/0100 Skipping already saved record PC2018/0099 Skipping already saved record CDC2018/0016 Skipping already saved record CDC2018/0015 Skipping already saved record PC2018/0097 Skipping already saved record OC2018/0027 Scraping page 2 of 11 Skipping already saved record CDC2018/0014 Skipping already saved record PC2018/0096 Skipping already saved record PC2018/0095 Skipping already saved record PC2018/0094 Skipping already saved record PC2018/0093 Skipping already saved record PC2018/0092 Skipping already saved record PC2018/0091 Skipping already saved record PC2018/0090 Skipping already saved record PC2018/0089 Skipping already saved record CDC2018/0013 Skipping already saved record PC2018/0088 Skipping already saved record CDC2018/0012 Skipping already saved record CDC2018/0011 Skipping already saved record PC2018/0087 Skipping already saved record PC2018/0086 Scraping page 3 of 11 Skipping already saved record PC2018/0085 Skipping already saved record CDC2018/0010 Skipping already saved record PC2018/0084 Skipping already saved record CC2018/0012 Skipping already saved record PC2018/0083 Skipping already saved record OC2018/0026 Skipping already saved record OC2018/0025 Skipping already saved record PC2018/0082 Skipping already saved record PC2018/0081 Skipping already saved record PC2018/0080 Skipping already saved record CDC2018/0009 Skipping already saved record OC2018/0024 Skipping already saved record PC2018/0079 Skipping already saved record PC2018/0078 Skipping already saved record OC2018/0023 Scraping page 4 of 11 Skipping already saved record PC2018/0077 Skipping already saved record PC2018/0076 Skipping already saved record PC2018/0075 Skipping already saved record DA2018/0016 Skipping already saved record PC2018/0074 Skipping already saved record PC2018/0073 Skipping already saved record PC2018/0072 Skipping already saved record MOD2018/0008 Skipping already saved record PC2018/0071 Skipping already saved record PC2018/0070 Skipping already saved record PC2018/0069 Skipping already saved record PC2018/0068 Skipping already saved record CC2018/0011 Skipping already saved record PC2018/0067 Skipping already saved record PC2018/0066 Scraping page 5 of 11 Skipping already saved record PC2018/0065 Skipping already saved record CC2018/0010 Skipping already saved record OC2018/0022 Skipping already saved record PC2018/0064 Skipping already saved record DA2018/0015 Skipping already saved record OC2018/0021 Skipping already saved record PC2018/0062 Skipping already saved record PC2018/0061 Skipping already saved record MOD2018/0007 Skipping already saved record CDC2018/0008 Skipping already saved record PC2018/0060 Skipping already saved record PC2018/0059 Skipping already saved record PC2018/0058 Skipping already saved record PC2018/0057 Skipping already saved record PC2018/0056 Scraping page 6 of 11 Skipping already saved record DA2018/0014 Skipping already saved record PC2018/0055 Skipping already saved record PC2018/0053 Skipping already saved record PC2018/0052 Skipping already saved record PC2018/0051 Skipping already saved record PC2018/0050 Skipping already saved record PC2018/0049 Skipping already saved record PC2018/0048 Skipping already saved record DA2018/0013 Skipping already saved record PC2018/0047 Skipping already saved record OC2018/0020 Skipping already saved record CC2018/0009 Skipping already saved record OC2018/0019 Skipping already saved record PC2018/0046 Skipping already saved record CC2018/0008 Scraping page 7 of 11 Skipping already saved record PC2018/0045 Skipping already saved record PC2018/0044 Skipping already saved record PC2018/0043 Skipping already saved record CDC2018/0007 Skipping already saved record OC2018/0018 Skipping already saved record CDC2018/0006 Skipping already saved record PC2018/0042 Skipping already saved record PC2018/0041 Skipping already saved record PC2018/0040 Skipping already saved record PC2018/0039 Skipping already saved record PC2018/0038 Skipping already saved record PC2018/0037 Skipping already saved record PC2018/0036 Skipping already saved record MOD2018/0006 Skipping already saved record PC2018/0035 Scraping page 8 of 11 Skipping already saved record PC2018/0034 Skipping already saved record PC2018/0032 Skipping already saved record PC2018/0031 Skipping already saved record PC2018/0030 Skipping already saved record OC2018/0017 Skipping already saved record PC2018/0028 Skipping already saved record PC2018/0027 Skipping already saved record DA2018/0012 Skipping already saved record PC2018/0026 Skipping already saved record PC2018/0025 Skipping already saved record PC2018/0024 Skipping already saved record PC2018/0023 Skipping already saved record PC2018/0022 Skipping already saved record DA2018/0011 Skipping already saved record DA2018/0010 Scraping page 9 of 11 Skipping already saved record OC2018/0016 Skipping already saved record OC2018/0015 Skipping already saved record PC2018/0021 Skipping already saved record PC2018/0020 Skipping already saved record PC2018/0019 Skipping already saved record DA2018/0009 Skipping already saved record PC2018/0016 Skipping already saved record PC2018/0015 Skipping already saved record CDC2018/0004 Skipping already saved record PC2018/0014 Skipping already saved record PC2018/0013 Skipping already saved record PC2018/0012 Skipping already saved record DA2018/0008 Skipping already saved record PC2018/0011 Skipping already saved record MOD2018/0004 Scraping page 10 of 11 Skipping already saved record PC2018/0010 Skipping already saved record DA2018/0007 Skipping already saved record OC2018/0014 Skipping already saved record DA2018/0006 Skipping already saved record DA2018/0005 Skipping already saved record PC2018/0009 Skipping already saved record PC2018/0008 Skipping already saved record PC2018/0007 Skipping already saved record PC2018/0006 Skipping already saved record PC2018/0005 Skipping already saved record OC2018/0013 Skipping already saved record OC2018/0012 Skipping already saved record OC2018/0011 Skipping already saved record OC2018/0010 Skipping already saved record CDC2018/0003 Scraping page 11 of 11 Skipping already saved record OC2018/0009 Skipping already saved record MOD2018/0002 Skipping already saved record OC2018/0008 Skipping already saved record OC2018/0007 Skipping already saved record OC2018/0006 Skipping already saved record OC2018/0005 Skipping already saved record CC2018/0003 Skipping already saved record CDC2018/0002 Skipping already saved record PC2018/0004 Skipping already saved record OC2018/0004 Skipping already saved record OC2018/0003 Skipping already saved record OC2018/0002 Skipping already saved record DA2018/0004 Skipping already saved record OC2018/0001 Skipping already saved record DA2018/0003

Data

Downloaded 781 times by openaustralia TheZepto MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.72 MB) Use the API

rows 10 / 4881

id council_reference address description info_url comment_url date_scraped date_received
1
DA2015/0481
12 Thornley Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
2015-12-07
2015-11-30
2
DA2015/0480
1 Rider Boulevard Rhodes NSW 2138 Australia
Fitout and use of tenancies 45 and 46 for use as Rashay's restaurant
2015-12-07
2015-11-30
3
MOD2015/0207
19-21 Tennyson Road Breakfast Point NSW 2137 Australia
Modification Application - S96(1) Minor Modification
2015-12-07
2015-11-30
4
CDC2015/0329
2 Stanley Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Secondary Dwelling
2015-12-07
2015-11-30
5
CC2015/0307
12 Janet Street Drummoyne NSW 2047 Australia
Construction Certificate - Private Issued Construction Certificate - A single residenital dwelling (house, Duplex, etc)
2015-12-07
2015-11-30
6
CC2015/0306
39 Tavistock Street Drummoyne NSW 2047 Australia
Ground floor alterations and first floor addition to existing dwelling
2015-12-07
2015-11-30
7
CDC2015/0328
34 Boronia Street Concord West NSW 2138 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
2015-12-07
2015-11-30
8
DA2015/0479
13 Dening Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
2015-12-07
2015-11-30
9
OC2015/0455
82 Queen Street Concord West NSW 2138 Australia
Occupation Certificate - Private Issued Certificate
2015-12-07
2015-11-30
10
CDC2015/0327
2 Bayview Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
2015-12-07
2015-11-30

Statistics

Average successful run time: 2 minutes

Total run time: about 21 hours

Total cpu time used: 8 minutes

Total disk space used: 3.08 MB

History

  • Auto ran revision d2347a46 and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    58 records added, 1 record updated in the database
    11 pages scraped
  • Auto ran revision d2347a46 and failed .
    nothing changed in the database
  • Auto ran revision d2347a46 and failed .
    nothing changed in the database
  • Auto ran revision d2347a46 and completed successfully .
    32 records added, 1 record updated in the database
    8 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

canada_bay / scraper.php