LoveMyData / canada_bay

City Of Canada Bay Development Applications

Scrapes eservices.canadabay.nsw.gov.au

Canada Bay - Home Page


City of Canada Bay Council scraper

This site is a typical .NET site involves the followings. * Pagnation - Not sure what happen after page 11? * Javascript - doPOSTBACK * Clearly defined data within a row - three cheers to this council

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default) * thismonth * lastmonth

It is now done and enjoy!!

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping page 1 of 2 Saving record CC2018/0098 Saving record OC2018/0164 Saving record RDA2018/0289 Saving record RDA2018/0288 Saving record RDA2018/0287 Saving record OC2018/0163 Skipping already saved record PC2018/0828 Skipping already saved record PC2018/0827 Skipping already saved record MOD2018/0067 Skipping already saved record CDC2018/0089 Skipping already saved record RDA2018/0283 Skipping already saved record OC2018/0162 Skipping already saved record PC2018/0826 Skipping already saved record OC2018/0161 Skipping already saved record CC2018/0097 Scraping page 2 of 2 Skipping already saved record OC2018/0160 Skipping already saved record PC2018/0825 Skipping already saved record DA2018/0110 Skipping already saved record DA2018/0109 Skipping already saved record PC2018/0822 Skipping already saved record RDA2018/0280 Skipping already saved record RDA2018/0279 Skipping already saved record RDA2018/0278

Data

Downloaded 627 times by LoveMyData MikeRalphson Lyndall Nigel78

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.05 MB) Use the API

rows 10 / 5552

id council_reference address description info_url comment_url date_scraped date_received
1
DA2015/0481
12 Thornley Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
2015-12-04
2015-11-30
2
DA2015/0480
1 Rider Boulevard Rhodes NSW 2138 Australia
Fitout and use of tenancies 45 and 46 for use as Rashay's restaurant
2015-12-04
2015-11-30
3
MOD2015/0207
19-21 Tennyson Road Breakfast Point NSW 2137 Australia
Modification Application - S96(1) Minor Modification
2015-12-04
2015-11-30
4
CDC2015/0329
2 Stanley Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Secondary Dwelling
2015-12-04
2015-11-30
5
CC2015/0307
12 Janet Street Drummoyne NSW 2047 Australia
Construction Certificate - Private Issued Construction Certificate - A single residenital dwelling (house, Duplex, etc)
2015-12-04
2015-11-30
6
CC2015/0306
39 Tavistock Street Drummoyne NSW 2047 Australia
Ground floor alterations and first floor addition to existing dwelling
2015-12-04
2015-11-30
7
CDC2015/0328
34 Boronia Street Concord West NSW 2138 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
2015-12-04
2015-11-30
8
DA2015/0479
13 Dening Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
2015-12-04
2015-11-30
9
OC2015/0455
82 Queen Street Concord West NSW 2138 Australia
Occupation Certificate - Private Issued Certificate
2015-12-04
2015-11-30
10
CDC2015/0327
2 Bayview Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
2015-12-04
2015-11-30

Statistics

Average successful run time: less than a minute

Total run time: about 12 hours

Total cpu time used: 6 minutes

Total disk space used: 3.41 MB

History

  • Auto ran revision d2347a46 and completed successfully .
    6 records added, 1 record updated in the database
    2 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    13 records added, 1 record updated in the database
    2 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    4 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision d2347a46 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d2347a46 and completed successfully .
    9 records added, 1 record updated in the database
    5 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

canada_bay / scraper.php