LoveMyData / hurstville

Hurstville City Council Development Applications

Scrapes daenquiry.hurstville.nsw.gov.au

IIS7

README.md

Hurstville City Council scraper

This site was a bit tricky to get the data out

We have Terms need to agreed and then keep track the cookie and finally deal with JavaScript.

It is now done and enjoy!!

Contributors

Last run completed successfully 2018-04-24.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping page 1 of 7 Skipping already saved record DA2018/0118 Skipping already saved record DA2018/0119 Skipping already saved record DA2018/0120 Skipping already saved record DA2018/0121 Skipping already saved record DA2018/0122 Skipping already saved record DA2018/0123 Skipping already saved record DA2018/0123 Skipping already saved record DA2018/0124 Skipping already saved record DA2018/0125 Skipping already saved record DA2018/0126 Scraping page 2 of 7 Skipping already saved record DA2018/0126 Skipping already saved record DA2018/0127 Skipping already saved record DA2018/0128 Skipping already saved record DA2018/0129 Skipping already saved record DA2018/0130 Skipping already saved record DA2018/0131 Skipping already saved record DA2018/0132 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0133 Scraping page 3 of 7 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0134 Skipping already saved record DA2018/0135 Skipping already saved record DA2018/0136 Skipping already saved record DA2018/0137 Skipping already saved record DA2018/0138 Skipping already saved record DA2018/0139 Scraping page 4 of 7 Skipping already saved record DA2018/0140 Skipping already saved record DA2018/0141 Skipping already saved record DA2018/0142 Skipping already saved record DA2018/0143 Skipping already saved record DA2018/0143 Skipping already saved record DA2018/0144 Skipping already saved record DA2018/0145 Skipping already saved record DA2018/0146 Skipping already saved record DA2018/0147 Skipping already saved record DA2018/0148 Scraping page 5 of 7 Skipping already saved record DA2018/0149 Skipping already saved record DA2018/0150 Skipping already saved record DA2018/0151 Skipping already saved record DA2018/0152 Skipping already saved record DA2018/0153 Skipping already saved record DA2018/0154 Skipping already saved record DA2018/0155 Saving record DA2018/0156 Saving record DA2018/0157 Saving record DA2018/0158 Scraping page 6 of 7 Skipping already saved record MOD2018/0043 Skipping already saved record MOD2018/0044 Skipping already saved record MOD2018/0045 Skipping already saved record MOD2018/0046 Skipping already saved record MOD2018/0047 Skipping already saved record MOD2018/0048 Skipping already saved record MOD2018/0049 Skipping already saved record MOD2018/0050 Skipping already saved record MOD2018/0051 Skipping already saved record MOD2018/0052 Scraping page 7 of 7 Saving record MOD2018/0053

Data

Downloaded 439 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (905 KB) Use the API

rows 10 / 1720

id	council_reference	address	description	info_url	comment_url	date_scraped	date_received
1	DA2015/0348	106 Gungah Bay Road, OATLEY, NSW AUSTRALIA	Residential Single Dwelling- Construction of a two storey dwelling with attached garage and detached granny flat.	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=93495	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0348&Body=	2015-11-27	2015-10-1
2	DA2015/0349	20 Old Forest Road, LUGARNO, NSW AUSTRALIA	Demolition of Existing Dwelling and construction of one-two storey attached dual occupancy	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=93583	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0349&Body=	2015-11-27	2015-10-2
3	DA2015/0350	127-141 Forest Road, HURSTVILLE, NSW AUSTRALIA	Fitout of premises for restaurant	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=93628	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0350&Body=	2015-11-27	2015-10-6
4	DA2015/0351	10 Lillian Road, RIVERWOOD, NSW AUSTRALIA	New two storey dwelling	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=93674	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0351&Body=	2015-11-27	2015-10-7
5	DA2015/0352	48 Woodlands Avenue, LUGARNO, NSW AUSTRALIA	New elevated covered deck to north/eastern side of dwelling	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=93708	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0352&Body=	2015-11-27	2015-10-7
6	DA2015/0353	3 Jacques Avenue, PEAKHURST, NSW AUSTRALIA	Demolition of existing dwelling; new two storey attached dual occupancy development	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=93833	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0353&Body=	2015-11-27	2015-10-9
7	DA2015/0354	13 Wattle Street, PEAKHURST, NSW AUSTRALIA	Alterations and additions to dwelling - single storey addition to rear; new garage and carport to rear	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=93861	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0354&Body=	2015-11-27	2015-10-9
8	DA2015/0355	23 Marine Drive, OATLEY, NSW AUSTRALIA	Demolition of existing; tree removal; new tow-three storey dwelling with swimming pool and detached outbuilding to rear	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=93888	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0355&Body=	2015-11-27	2015-10-12
9	DA2015/0356	16 Lesley Crescent, MORTDALE, NSW AUSTRALIA	Two storey addition to the front of an existing dwelling	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=93895	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0356&Body=	2015-11-27	2015-10-12
10	DA2015/0357	48 Baumans Road, PEAKHURST, NSW AUSTRALIA	First floor addition to the existing dwelling	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=93936	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0357&Body=	2015-11-27	2015-10-12

Statistics

Average successful run time: 2 minutes

Total run time: 3 days

Total cpu time used: 5 minutes

Total disk space used: 1.26 MB

History

Auto ran revision 930d9050 and completed successfully 2018-04-24.

run time 22 s

4 records added, 1 record updated in the database

10 pages scraped
Auto ran revision 930d9050 and completed successfully 2018-04-23.

run time 20 s

1 record added, 1 record updated in the database

9 pages scraped
Auto ran revision 930d9050 and completed successfully 2018-04-22.

run time 26 s

nothing changed in the database

9 pages scraped
Auto ran revision 930d9050 and completed successfully 2018-04-21.

run time 21 s

nothing changed in the database

9 pages scraped
Auto ran revision 930d9050 and completed successfully 2018-04-20.

run time 22 s

1 record added, 1 record updated in the database

9 pages scraped
...
Created on morph.io 2015-11-26

Show complete history

Scraper code

PHP

hurstville / scraper.php

git clone URL