planningalerts-scrapers / canada_bay

City Of Canada Bay Development Applications

Scrapes eservices.canadabay.nsw.gov.au

Canada Bay - Home Page


City of Canada Bay Council scraper

This site is a typical .NET site involves the followings. * Pagnation - Not sure what happen after page 11? * Javascript - doPOSTBACK * Clearly defined data within a row - three cheers to this council

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default) * thismonth * lastmonth

It is now done and enjoy!!

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping page 1 of 10 Skipping already saved record OC2018/0531 Skipping already saved record OC2018/0530 Skipping already saved record DA2018/0394 Skipping already saved record PC2018/2804 Skipping already saved record PC2018/2803 Skipping already saved record CC2018/0315 Skipping already saved record PC2018/2802 Skipping already saved record OC2018/0529 Skipping already saved record PC2018/2801 Skipping already saved record PC2018/2800 Skipping already saved record MOD2018/0199 Skipping already saved record DA2018/0393 Skipping already saved record OC2018/0528 Skipping already saved record SC2018/0035 Skipping already saved record RDA2018/0933 Scraping page 2 of 10 Skipping already saved record PC2018/2799 Skipping already saved record PC2018/2798 Skipping already saved record OC2018/0527 Skipping already saved record PC2018/2797 Skipping already saved record DA2018/0392 Skipping already saved record DA2018/0391 Skipping already saved record CC2018/0314 Skipping already saved record MOD2018/0198 Skipping already saved record PC2018/2796 Skipping already saved record DA2018/0390 Skipping already saved record PC2018/2795 Skipping already saved record PC2018/2794 Skipping already saved record PC2018/2793 Skipping already saved record OC2018/0526 Skipping already saved record OC2018/0525 Scraping page 3 of 10 Skipping already saved record PC2018/2792 Skipping already saved record PC2018/2791 Skipping already saved record PC2018/2790 Skipping already saved record PC2018/2789 Skipping already saved record OC2018/0524 Skipping already saved record PC2018/2788 Skipping already saved record PC2018/2787 Skipping already saved record PC2018/2786 Skipping already saved record MOD2018/0197 Skipping already saved record MOD2018/0196 Skipping already saved record DA2018/0389 Skipping already saved record CC2018/0069 Skipping already saved record PC2018/2785 Skipping already saved record PC2018/2784 Skipping already saved record PC2018/2783 Scraping page 4 of 10 Skipping already saved record PC2018/2782 Skipping already saved record SC2018/0034 Skipping already saved record DA2018/0388 Skipping already saved record OC2018/0523 Skipping already saved record PC2018/2781 Skipping already saved record PC2018/2780 Skipping already saved record PC2018/2779 Skipping already saved record DA2018/0387 Skipping already saved record CDC2018/0313 Skipping already saved record OC2018/0522 Skipping already saved record PC2018/2778 Skipping already saved record PC2018/2777 Skipping already saved record PC2018/2775 Skipping already saved record PC2018/2774 Skipping already saved record PC2018/2773 Scraping page 5 of 10 Skipping already saved record CDC2018/0312 Skipping already saved record PC2018/2772 Skipping already saved record MOD2018/0195 Skipping already saved record PC2018/2771 Skipping already saved record PC2018/2770 Skipping already saved record CDC2018/0311 Skipping already saved record OC2018/0521 Skipping already saved record OC2018/0520 Skipping already saved record RDA2018/0914 Skipping already saved record PC2018/2769 Skipping already saved record PC2018/2768 Skipping already saved record PC2018/2766 Skipping already saved record OC2018/0519 Skipping already saved record OC2018/0518 Skipping already saved record OC2018/0517 Scraping page 6 of 10 Skipping already saved record OC2018/0516 Skipping already saved record PC2018/2765 Skipping already saved record CDC2018/0310 Skipping already saved record PC2018/2764 Skipping already saved record DA2018/0386 Skipping already saved record RDA2018/0910 Skipping already saved record CC2018/0313 Skipping already saved record PC2018/2763 Skipping already saved record PC2018/2762 Skipping already saved record DA2018/0385 Skipping already saved record OC2018/0515 Skipping already saved record PC2018/2761 Skipping already saved record OC2018/0514 Skipping already saved record CC2018/0312 Skipping already saved record PC2018/2760 Scraping page 7 of 10 Skipping already saved record DA2018/0384 Skipping already saved record PC2018/2759 Skipping already saved record DA2018/0383 Skipping already saved record PC2018/2757 Skipping already saved record PC2018/2756 Skipping already saved record PC2018/2755 Skipping already saved record PC2018/2754 Skipping already saved record PC2018/2753 Skipping already saved record DA2018/0382 Skipping already saved record PC2018/2752 Skipping already saved record MOD2018/0194 Skipping already saved record PC2018/2751 Skipping already saved record PC2018/2750 Skipping already saved record OC2018/0513 Skipping already saved record PC2018/2749 Scraping page 8 of 10 Skipping already saved record PC2018/2748 Skipping already saved record MOD2018/0193 Skipping already saved record PC2018/2747 Skipping already saved record DA2018/0381 Skipping already saved record PC2018/2746 Skipping already saved record DA2018/0380 Skipping already saved record MOD2018/0192 Skipping already saved record MOD2018/0191 Skipping already saved record PC2018/2745 Skipping already saved record MOD2018/0190 Skipping already saved record OC2018/0512 Skipping already saved record CC2018/0311 Skipping already saved record CC2018/0310 Skipping already saved record OC2018/0511 Skipping already saved record OC2018/0510 Scraping page 9 of 10 Skipping already saved record PC2018/2744 Skipping already saved record PC2018/2743 Skipping already saved record DA2018/0379 Skipping already saved record PC2018/2742 Skipping already saved record PC2018/2741 Skipping already saved record PC2018/2740 Skipping already saved record PC2018/2739 Skipping already saved record PC2018/2737 Skipping already saved record CC2018/0309 Skipping already saved record PC2018/2736 Skipping already saved record CC2018/0308 Skipping already saved record SC2018/0033 Skipping already saved record CC2018/0307 Skipping already saved record OC2018/0509 Skipping already saved record OC2018/0508 Scraping page 10 of 10 Skipping already saved record OC2018/0507 Skipping already saved record OC2018/0506 Skipping already saved record CC2018/0306 Skipping already saved record PC2018/2735

Data

Downloaded 1235 times by openaustralia jesse-a-reilly TheZepto MikeRalphson Horizons444

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (4.62 MB) Use the API

rows 10 / 8563

id council_reference address description info_url comment_url date_scraped date_received
1
DA2015/0481
12 Thornley Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
2015-12-07
2015-11-30
2
DA2015/0480
1 Rider Boulevard Rhodes NSW 2138 Australia
Fitout and use of tenancies 45 and 46 for use as Rashay's restaurant
2015-12-07
2015-11-30
3
MOD2015/0207
19-21 Tennyson Road Breakfast Point NSW 2137 Australia
Modification Application - S96(1) Minor Modification
2015-12-07
2015-11-30
4
CDC2015/0329
2 Stanley Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Secondary Dwelling
2015-12-07
2015-11-30
5
CC2015/0307
12 Janet Street Drummoyne NSW 2047 Australia
Construction Certificate - Private Issued Construction Certificate - A single residenital dwelling (house, Duplex, etc)
2015-12-07
2015-11-30
6
CC2015/0306
39 Tavistock Street Drummoyne NSW 2047 Australia
Ground floor alterations and first floor addition to existing dwelling
2015-12-07
2015-11-30
7
CDC2015/0328
34 Boronia Street Concord West NSW 2138 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
2015-12-07
2015-11-30
8
DA2015/0479
13 Dening Street Drummoyne NSW 2047 Australia
Development Application - Other (Not categorised elsewhere eg. tree/sign)
2015-12-07
2015-11-30
9
OC2015/0455
82 Queen Street Concord West NSW 2138 Australia
Occupation Certificate - Private Issued Certificate
2015-12-07
2015-11-30
10
CDC2015/0327
2 Bayview Street Concord NSW 2137 Australia
Complying Development Certificate - Private Issued Complying Development Certificate - Housing Alterations and Additions
2015-12-07
2015-11-30

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 15 minutes

Total disk space used: 4.98 MB

History

  • Auto ran revision d2347a46 and completed successfully .
    nothing changed in the database
    10 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    14 records added, 1 record updated in the database
    115 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    9 records added, 1 record updated in the database
    9 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    18 records added, 1 record updated in the database
    8 pages scraped
  • Auto ran revision d2347a46 and completed successfully .
    15 records added, 1 record updated in the database
    7 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

canada_bay / scraper.php