planningalerts-scrapers / canada_bay

City Of Canada Bay Development Applications

Scrapes eservices.canadabay.nsw.gov.au

Canada Bay - Home Page


City of Canada Bay Council scraper

This site is a typical .NET site involves the followings. * Pagnation - Not sure what happen after page 11? * Javascript - doPOSTBACK * Clearly defined data within a row - three cheers to this council

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default) * thismonth * lastmonth

It is now done and enjoy!!

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping page 1 of 11 Saving record PC2018/0822 Saving record RDA2018/0280 Saving record RDA2018/0279 Saving record RDA2018/0278 Saving record PC2018/0821 Skipping already saved record RDA2018/0276 Skipping already saved record RDA2018/0261 Skipping already saved record PC2018/0820 Skipping already saved record PC2018/0819 Skipping already saved record DA2018/0108 Skipping already saved record OC2018/0159 Skipping already saved record OC2018/0158 Skipping already saved record PC2018/0818 Skipping already saved record DA2018/0107 Skipping already saved record DA2018/0106 Scraping page 2 of 11 Skipping already saved record MOD2018/0066 Skipping already saved record PC2018/0817 Skipping already saved record MOD2018/0065 Skipping already saved record OC2018/0157 Skipping already saved record PC2018/0816 Skipping already saved record CDC2018/0088 Skipping already saved record PC2018/0815 Skipping already saved record PC2018/0814 Skipping already saved record CDC2018/0087 Skipping already saved record PC2018/0813 Skipping already saved record PC2018/0811 Skipping already saved record PC2018/0809 Skipping already saved record OC2018/0156 Skipping already saved record CC2018/0096 Skipping already saved record CC2018/0095 Scraping page 3 of 11 Skipping already saved record OC2018/0155 Skipping already saved record OC2018/0154 Skipping already saved record PC2018/0807 Skipping already saved record CC2018/0094 Skipping already saved record OC2018/0153 Skipping already saved record PC2018/0806 Skipping already saved record CDC2018/0086 Skipping already saved record PC2018/0805 Skipping already saved record OC2018/0152 Skipping already saved record CDC2018/0085 Skipping already saved record PC2018/0804 Skipping already saved record PC2018/0802 Skipping already saved record OC2018/0151 Skipping already saved record OC2018/0150 Skipping already saved record SC2018/0005 Scraping page 4 of 11 Skipping already saved record PC2018/0801 Skipping already saved record PC2018/0799 Skipping already saved record PC2018/0798 Skipping already saved record PC2018/0796 Skipping already saved record RDA2018/0233 Skipping already saved record PC2018/0795 Skipping already saved record CDC2018/0084 Skipping already saved record MOD2018/0064 Skipping already saved record CDC2018/0083 Skipping already saved record DA2018/0105 Skipping already saved record MOD2018/0063 Skipping already saved record PC2018/0793 Skipping already saved record CDC2018/0082 Skipping already saved record CC2018/0093 Skipping already saved record PC2018/0789 Scraping page 5 of 11 Skipping already saved record PC2018/0788 Skipping already saved record PC2018/0787 Skipping already saved record PC2018/0786 Skipping already saved record CDC2018/0081 Skipping already saved record CDC2018/0080 Skipping already saved record OC2018/0149 Skipping already saved record PC2018/0785 Skipping already saved record CDC2018/0079 Skipping already saved record PC2018/0784 Skipping already saved record DA2018/0104 Skipping already saved record RDA2018/0227 Skipping already saved record RDA2018/0226 Skipping already saved record DA2018/0103 Skipping already saved record PC2018/0783 Skipping already saved record MOD2018/0062 Scraping page 6 of 11 Skipping already saved record PC2018/0782 Skipping already saved record PC2018/0781 Skipping already saved record PC2018/0780 Skipping already saved record MOD2018/0061 Skipping already saved record PC2018/0779 Skipping already saved record PC2018/0778 Skipping already saved record PC2018/0777 Skipping already saved record OC2018/0148 Skipping already saved record PC2018/0776 Skipping already saved record OC2018/0147 Skipping already saved record OC2018/0146 Skipping already saved record PC2018/0775 Skipping already saved record PC2018/0774 Skipping already saved record OC2018/0145 Skipping already saved record CDC2018/0078 Scraping page 7 of 11 Skipping already saved record CDC2018/0077 Skipping already saved record PC2018/0773 Skipping already saved record PC2018/0772 Skipping already saved record PC2018/0771 Skipping already saved record PC2018/0770 Skipping already saved record PC2018/0769 Skipping already saved record PC2018/0768 Skipping already saved record CC2018/0092 Skipping already saved record CC2018/0091 Skipping already saved record MOD2018/0059 Skipping already saved record PC2018/0766 Skipping already saved record PC2018/0764 Skipping already saved record RDA2018/0215 Skipping already saved record PC2018/0763 Skipping already saved record PC2018/0762 Scraping page 8 of 11 Skipping already saved record MOD2018/0058 Skipping already saved record PC2018/0761 Skipping already saved record PC2018/0760 Skipping already saved record PC2018/0759 Skipping already saved record PC2018/0758 Skipping already saved record PC2018/0757 Skipping already saved record CC2018/0090 Skipping already saved record DA2018/0102 Skipping already saved record OC2018/0144 Skipping already saved record OC2018/0143 Skipping already saved record OC2018/0142 Skipping already saved record OC2018/0141 Skipping already saved record SC2018/0004 Skipping already saved record PC2018/0756 Skipping already saved record PC2018/0755 Scraping page 9 of 11 Skipping already saved record PC2018/0754 Skipping already saved record PC2018/0753 Skipping already saved record PC2018/0752 Skipping already saved record PC2018/0751 Skipping already saved record PC2018/0750 Skipping already saved record PC2018/0749 Skipping already saved record PC2018/0748 Skipping already saved record DA2018/0101 Skipping already saved record DA2018/0100 Skipping already saved record PC2018/0747 Skipping already saved record PC2018/0746 Skipping already saved record PC2018/0745 Skipping already saved record PC2018/0744 Skipping already saved record DA2018/0099 Skipping already saved record PC2018/0743 Scraping page 10 of 11 Skipping already saved record PC2018/0742 Skipping already saved record PC2018/0741 Skipping already saved record PC2018/0740 Skipping already saved record PC2018/0739 Skipping already saved record PC2018/0738 Skipping already saved record PC2018/0737 Skipping already saved record PC2018/0736 Skipping already saved record PC2018/0735 Skipping already saved record OC2018/0140 Skipping already saved record PC2018/0734 Skipping already saved record RDA2018/0206 Skipping already saved record CC2018/0088 Skipping already saved record MOD2018/0057 Skipping already saved record PC2018/0733 Skipping already saved record PC2018/0732 Scraping page 11 of 11 Skipping already saved record OC2018/0139 Skipping already saved record OC2018/0138 Skipping already saved record MOD2018/0056 Skipping already saved record PC2018/0730 Skipping already saved record CC2018/0087 Skipping already saved record OC2018/0137 Skipping already saved record CC2018/0086 Skipping already saved record PC2018/0726 Skipping already saved record RDA2018/0199 Skipping already saved record PC2018/0725 Skipping already saved record PC2018/0724 Skipping already saved record PC2018/0723 Skipping already saved record PC2018/0722 Skipping already saved record PC2018/0721 Skipping already saved record PC2018/0720

Data

Downloaded 994 times by openaustralia TheZepto MikeRalphson Horizons444

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.28 MB) Use the API

rows 10 / 5972

id council_reference address description info_url comment_url date_scraped date_received
1
DA2015/0481
12 Thornley Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
2015-12-07
2015-11-30
2
DA2015/0480
1 Rider Boulevard Rhodes NSW 2138 Australia
Fitout and use of tenancies 45 and 46 for use as Rashay's restaurant
2015-12-07
2015-11-30
3
MOD2015/0207
19-21 Tennyson Road Breakfast Point NSW 2137 Australia
Modification Application - S96(1) Minor Modification
2015-12-07
2015-11-30
4
CDC2015/0329
2 Stanley Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Secondary Dwelling
2015-12-07
2015-11-30
5
CC2015/0307
12 Janet Street Drummoyne NSW 2047 Australia
Construction Certificate - Private Issued Construction Certificate - A single residenital dwelling (house, Duplex, etc)
2015-12-07
2015-11-30
6
CC2015/0306
39 Tavistock Street Drummoyne NSW 2047 Australia
Ground floor alterations and first floor addition to existing dwelling
2015-12-07
2015-11-30
7
CDC2015/0328
34 Boronia Street Concord West NSW 2138 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
2015-12-07
2015-11-30
8
DA2015/0479
13 Dening Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
2015-12-07
2015-11-30
9
OC2015/0455
82 Queen Street Concord West NSW 2138 Australia
Occupation Certificate - Private Issued Certificate
2015-12-07
2015-11-30
10
CDC2015/0327
2 Bayview Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
2015-12-07
2015-11-30

Statistics

Average successful run time: 2 minutes

Total run time: about 22 hours

Total cpu time used: 9 minutes

Total disk space used: 3.65 MB

History

  • Auto ran revision d2347a46 and completed successfully .
    5 records added, 1 record updated in the database
    11 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    1 record added, 1 record updated in the database
    11 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    19 records added, 1 record updated in the database
    11 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    16 records added, 1 record updated in the database
    11 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    13 records added, 1 record updated in the database
    11 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

canada_bay / scraper.php