planningalerts-scrapers / hurstville

Hurstville City Council Development Applications

Scrapes daenquiry.hurstville.nsw.gov.au

IIS7


Hurstville City Council scraper

This site was a bit tricky to get the data out

We have Terms need to agreed and then keep track the cookie and finally deal with JavaScript.

It is now done and enjoy!!

Contributors LoveMyData henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.lock; using PHP ^5.5.17  - php (5.6.36)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.33) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 1 install, 0 updates, 0 removals  - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Scraping page 1 of 5 Skipping already saved record DA2018/0216 Skipping already saved record DA2018/0217 Skipping already saved record DA2018/0217 Skipping already saved record DA2018/0218 Skipping already saved record DA2018/0219 Skipping already saved record DA2018/0220 Skipping already saved record DA2018/0221 Skipping already saved record DA2018/0222 Skipping already saved record DA2018/0223 Skipping already saved record DA2018/0224 Scraping page 2 of 5 Skipping already saved record DA2018/0225 Skipping already saved record DA2018/0226 Skipping already saved record DA2018/0227 Skipping already saved record DA2018/0228 Skipping already saved record DA2018/0229 Skipping already saved record DA2018/0230 Skipping already saved record DA2018/0231 Skipping already saved record DA2018/0232 Skipping already saved record DA2018/0233 Skipping already saved record DA2018/0234 Scraping page 3 of 5 Skipping already saved record DA2018/0235 Skipping already saved record DA2018/0236 Skipping already saved record DA2018/0237 Skipping already saved record DA2018/0238 Saving record DA2018/0239 Saving record DA2018/0240 Skipping already saved record MOD2018/0067 Skipping already saved record MOD2018/0068 Skipping already saved record MOD2018/0069 Skipping already saved record MOD2018/0070 Scraping page 4 of 5 Skipping already saved record MOD2018/0071 Skipping already saved record MOD2018/0072 Skipping already saved record MOD2018/0073 Skipping already saved record MOD2018/0074 Skipping already saved record MOD2018/0075 Skipping already saved record MOD2018/0075 Saving record MOD2018/0076 Saving record MOD2018/0077 Saving record MOD2018/0078 Saving record MOD2018/0079 Scraping page 5 of 5 Skipping already saved record Rev2018/0007 Skipping already saved record Rev2018/0008 Skipping already saved record Rev2018/0009

Data

Downloaded 1073 times by openaustralia jesse-a-reilly TheZepto tatol86 Horizons444 MikeRalphson adamclayton

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (960 KB) Use the API

rows 10 / 1825

id council_reference address description info_url comment_url date_scraped date_received
1
DA2015/0396
135 Belmore Road, PEAKHURST, NSW AUSTRALIA
Residential - Demolition of existing structures, new two level detached dual occupancy with front fence
mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0396&Body=
2015-11-30
2015-11-02
2
DA2015/0397
3 / 47 Josephine Street, RIVERWOOD, NSW AUSTRALIA
Residential Alterations and Additions- Extend existing bedroom towards existing balcony
mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0397&Body=
2015-11-30
2015-11-05
3
DA2015/0398
10 / 47 Josephine Street, RIVERWOOD, NSW AUSTRALIA
Residential Alterations and Additions- Extend existing bedroom towards existing balcony
mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0398&Body=
2015-11-30
2015-11-05
4
DA2015/0399
7 Beaumaris Crescent, MORTDALE, NSW AUSTRALIA
Proposed extension and remodel to the existing single level fibro home. proposed swimming pool and entertainment areas to the rear of the yard
mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0399&Body=
2015-11-30
2015-11-05
5
DA2015/0400
18 Glenwall Street, KINGSGROVE, NSW AUSTRALIA
Residential Alterations and Additions-Extending the house up and forward
mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0400&Body=
2015-11-30
2015-11-06
6
DA2015/0401
11 Mavis Avenue, PEAKHURST, NSW AUSTRALIA
Demolition of existing dwelling proposed construction of two story dual occupancy and front fence.
mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0401&Body=
2015-11-30
2015-11-06
7
DA2015/0402
60 Margaret Street, KINGSGROVE, NSW AUSTRALIA
Residential Alterations and Additions- proposed rebuild of the garage
mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0402&Body=
2015-11-30
2015-11-06
8
DA2015/0403
2 / 2A Cross Street, HURSTVILLE, NSW AUSTRALIA
Residential Alterations and Additions - Enclosure of existing balcony
mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0403&Body=
2015-11-30
2015-11-10
9
DA2015/0404
102 Gungah Bay Road, OATLEY, NSW AUSTRALIA
Residential Single Dwelling - Demolition of existing residence and construction of a new 2 storey residence with inground swimming pool and cabana
mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0404&Body=
2015-11-30
2015-11-10
10
DA2015/0405
25A Koorabel Street, LUGARNO, NSW AUSTRALIA
Residential Single Dwelling - Construction of a two storey dwelling with double garage associated landscaping and swimming pool
mailto:hccmail@hurstville.nsw.gov.au?subject=Development Application Enquiry: DA2015/0405&Body=
2015-11-30
2015-11-11

Statistics

Average successful run time: 5 minutes

Total run time: 3 days

Total cpu time used: 5 minutes

Total disk space used: 1.31 MB

History

  • Auto ran revision 35a5b118 and completed successfully .
    6 records added, 1 record updated in the database
    8 pages scraped
  • Auto ran revision 35a5b118 and completed successfully .
    nothing changed in the database
    7 pages scraped
  • Auto ran revision 35a5b118 and completed successfully .
    nothing changed in the database
    7 pages scraped
  • Auto ran revision 35a5b118 and completed successfully .
    1 record added, 1 record updated in the database
    7 pages scraped
  • Auto ran revision 35a5b118 and completed successfully .
    4 records added, 1 record updated in the database
    7 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

hurstville / scraper.php