planningalerts-scrapers / hurstville

Hurstville City Council Development Applications

Scrapes daenquiry.hurstville.nsw.gov.au

IIS7

README.md

Hurstville City Council scraper

This site was a bit tricky to get the data out

We have Terms need to agreed and then keep track the cookie and finally deal with JavaScript.

It is now done and enjoy!!

Contributors

Last run completed successfully 2018-04-21.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping page 1 of 6 Skipping already saved record DA2018/0118 Skipping already saved record DA2018/0119 Skipping already saved record DA2018/0120 Skipping already saved record DA2018/0121 Skipping already saved record DA2018/0122 Skipping already saved record DA2018/0123 Skipping already saved record DA2018/0123 Skipping already saved record DA2018/0124 Skipping already saved record DA2018/0125 Skipping already saved record DA2018/0126 Scraping page 2 of 6 Skipping already saved record DA2018/0126 Skipping already saved record DA2018/0127 Skipping already saved record DA2018/0128 Skipping already saved record DA2018/0129 Skipping already saved record DA2018/0130 Skipping already saved record DA2018/0131 Skipping already saved record DA2018/0132 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0133 Scraping page 3 of 6 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0133 Skipping already saved record DA2018/0134 Skipping already saved record DA2018/0135 Skipping already saved record DA2018/0136 Skipping already saved record DA2018/0137 Skipping already saved record DA2018/0138 Skipping already saved record DA2018/0139 Scraping page 4 of 6 Skipping already saved record DA2018/0140 Skipping already saved record DA2018/0141 Skipping already saved record DA2018/0142 Skipping already saved record DA2018/0143 Skipping already saved record DA2018/0143 Skipping already saved record DA2018/0144 Skipping already saved record DA2018/0145 Skipping already saved record DA2018/0146 Skipping already saved record DA2018/0147 Skipping already saved record DA2018/0148 Scraping page 5 of 6 Skipping already saved record DA2018/0149 Skipping already saved record DA2018/0150 Skipping already saved record DA2018/0151 Skipping already saved record DA2018/0152 Skipping already saved record DA2018/0153 Skipping already saved record DA2018/0154 Skipping already saved record DA2018/0155 Skipping already saved record MOD2018/0043 Skipping already saved record MOD2018/0044 Skipping already saved record MOD2018/0045 Scraping page 6 of 6 Skipping already saved record MOD2018/0046 Skipping already saved record MOD2018/0047 Skipping already saved record MOD2018/0048 Skipping already saved record MOD2018/0049 Skipping already saved record MOD2018/0050 Skipping already saved record MOD2018/0051

Data

Downloaded 1002 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (899 KB) Use the API

rows 10 / 1709

id	council_reference	address	description	info_url	comment_url	date_scraped	date_received
1	DA2015/0396	135 Belmore Road, PEAKHURST, NSW AUSTRALIA	Residential - Demolition of existing structures, new two level detached dual occupancy with front fence	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=95000	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0396&Body=	2015-11-30	2015-11-02
2	DA2015/0397	3 / 47 Josephine Street, RIVERWOOD, NSW AUSTRALIA	Residential Alterations and Additions- Extend existing bedroom towards existing balcony	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=95177	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0397&Body=	2015-11-30	2015-11-05
3	DA2015/0398	10 / 47 Josephine Street, RIVERWOOD, NSW AUSTRALIA	Residential Alterations and Additions- Extend existing bedroom towards existing balcony	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=95179	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0398&Body=	2015-11-30	2015-11-05
4	DA2015/0399	7 Beaumaris Crescent, MORTDALE, NSW AUSTRALIA	Proposed extension and remodel to the existing single level fibro home. proposed swimming pool and entertainment areas to the rear of the yard	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=95188	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0399&Body=	2015-11-30	2015-11-05
5	DA2015/0400	18 Glenwall Street, KINGSGROVE, NSW AUSTRALIA	Residential Alterations and Additions-Extending the house up and forward	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=95248	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0400&Body=	2015-11-30	2015-11-06
6	DA2015/0401	11 Mavis Avenue, PEAKHURST, NSW AUSTRALIA	Demolition of existing dwelling proposed construction of two story dual occupancy and front fence.	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=95257	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0401&Body=	2015-11-30	2015-11-06
7	DA2015/0402	60 Margaret Street, KINGSGROVE, NSW AUSTRALIA	Residential Alterations and Additions- proposed rebuild of the garage	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=95268	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0402&Body=	2015-11-30	2015-11-06
8	DA2015/0403	2 / 2A Cross Street, HURSTVILLE, NSW AUSTRALIA	Residential Alterations and Additions - Enclosure of existing balcony	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=95396	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0403&Body=	2015-11-30	2015-11-10
9	DA2015/0404	102 Gungah Bay Road, OATLEY, NSW AUSTRALIA	Residential Single Dwelling - Demolition of existing residence and construction of a new 2 storey residence with inground swimming pool and cabana	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=95424	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0404&Body=	2015-11-30	2015-11-10
10	DA2015/0405	25A Koorabel Street, LUGARNO, NSW AUSTRALIA	Residential Single Dwelling - Construction of a two storey dwelling with double garage associated landscaping and swimming pool	http://daenquiry.hurstville.nsw.gov.au/masterviewui/Modules/applicationmaster/default.aspx?page=wrapper&key=95462	mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0405&Body=	2015-11-30	2015-11-11

Statistics

Average successful run time: 6 minutes

Total run time: 3 days

Total cpu time used: 5 minutes

Total disk space used: 1.25 MB

History

Auto ran revision 35a5b118 and completed successfully 2018-04-21.

run time 21 s

nothing changed in the database

9 pages scraped
Auto ran revision 35a5b118 and completed successfully 2018-04-20.

run time 20 s

1 record added, 1 record updated in the database

9 pages scraped
Auto ran revision 35a5b118 and completed successfully 2018-04-19.

run time 22 s

4 records added, 1 record updated in the database

9 pages scraped
Auto ran revision 35a5b118 and completed successfully 2018-04-18.

run time 22 s

3 records added, 1 record updated in the database

11 pages scraped
Auto ran revision 35a5b118 and completed successfully 2018-04-17.

run time 20 s

3 records added, 1 record updated in the database

8 pages scraped
...
Created on morph.io 2015-11-30

Show complete history

Scraper code

PHP

hurstville / scraper.php

git clone URL