LoveMyData / canada_bay

City Of Canada Bay Development Applications

Scrapes eservices.canadabay.nsw.gov.au

Canada Bay - Home Page


City of Canada Bay Council scraper

This site is a typical .NET site involves the followings. * Pagnation - Not sure what happen after page 11? * Javascript - doPOSTBACK * Clearly defined data within a row - three cheers to this council

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default) * thismonth * lastmonth

It is now done and enjoy!!

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping page 1 of 3 Saving record PC2018/0375 Saving record CC2018/0039 Saving record SC2018/0001 Saving record CDC2018/0031 Saving record PC2018/0373 Saving record PC2018/0372 Saving record PC2018/0371 Saving record PC2018/0370 Saving record OC2018/0060 Saving record PC2018/0369 Saving record PC2018/0368 Saving record PC2018/0367 Saving record OC2018/0059 Saving record PC2018/0366 Saving record CDC2018/0030 Scraping page 2 of 3 Saving record OC2018/0058 Saving record DA2018/0050 Saving record PC2018/0365 Saving record DA2018/0049 Skipping already saved record PC2018/0364 Skipping already saved record PC2018/0363 Skipping already saved record PC2018/0362 Skipping already saved record PC2018/0361 Skipping already saved record DA2018/0048 Skipping already saved record PC2018/0360 Skipping already saved record PC2018/0359 Skipping already saved record DA2018/0047 Skipping already saved record PC2018/0358 Skipping already saved record PC2018/0357 Skipping already saved record CDC2018/0029 Scraping page 3 of 3 Skipping already saved record PC2018/0356 Skipping already saved record PC2018/0352 Skipping already saved record CDC2018/0028 Skipping already saved record PC2018/0350 Skipping already saved record OC2018/0057 Skipping already saved record OC2018/0056 Skipping already saved record PC2018/0349 Skipping already saved record CC2018/0038 Skipping already saved record OC2018/0055 Skipping already saved record MOD2018/0018 Skipping already saved record OC2018/0054 Skipping already saved record PC2018/0345 Skipping already saved record PC2018/0344 Skipping already saved record OC2018/0053 Skipping already saved record PC2018/0343

Data

Downloaded 566 times by LoveMyData MikeRalphson Lyndall Nigel78

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.69 MB) Use the API

rows 10 / 4870

id council_reference address description info_url comment_url date_scraped date_received
1
DA2015/0481
12 Thornley Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
2015-12-04
2015-11-30
2
DA2015/0480
1 Rider Boulevard Rhodes NSW 2138 Australia
Fitout and use of tenancies 45 and 46 for use as Rashay's restaurant
2015-12-04
2015-11-30
3
MOD2015/0207
19-21 Tennyson Road Breakfast Point NSW 2137 Australia
Modification Application - S96(1) Minor Modification
2015-12-04
2015-11-30
4
CDC2015/0329
2 Stanley Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Secondary Dwelling
2015-12-04
2015-11-30
5
CC2015/0307
12 Janet Street Drummoyne NSW 2047 Australia
Construction Certificate - Private Issued Construction Certificate - A single residenital dwelling (house, Duplex, etc)
2015-12-04
2015-11-30
6
CC2015/0306
39 Tavistock Street Drummoyne NSW 2047 Australia
Ground floor alterations and first floor addition to existing dwelling
2015-12-04
2015-11-30
7
CDC2015/0328
34 Boronia Street Concord West NSW 2138 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
2015-12-04
2015-11-30
8
DA2015/0479
13 Dening Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
2015-12-04
2015-11-30
9
OC2015/0455
82 Queen Street Concord West NSW 2138 Australia
Occupation Certificate - Private Issued Certificate
2015-12-04
2015-11-30
10
CDC2015/0327
2 Bayview Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
2015-12-04
2015-11-30

Statistics

Average successful run time: less than a minute

Total run time: about 11 hours

Total cpu time used: 5 minutes

Total disk space used: 3.06 MB

History

  • Auto ran revision d2347a46 and completed successfully .
    19 records added, 1 record updated in the database
    3 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    26 records added, 1 record updated in the database
    2 pages scraped
  • Auto ran revision d2347a46 and failed .
    nothing changed in the database
  • Auto ran revision d2347a46 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    10 records added, 1 record updated in the database
    4 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

canada_bay / scraper.php