Hornsby Shire Council Scraper

Hornsby Shire Council site is very easy to scrape, only need to scape a single page to get the entire month of DAs. No pagination, yay... Three cheers to this council !!!

However, the lack of HTML class, id, etc to identify the data, it requires a few 'explode' in PHP to get the right information.

By default: it will look for 'thisweek' of DAs, for data recovery you can set the MORPHPERIOD=thismonth or MORPHPERIOD=lastmonth

Still, not bad...Thanks and Enjoy

Contributors henare mlandauer LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 680 times by LoveMyData MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (964 KB) Use the API

rows 10 / 2437

id council_reference address description info_url comment_url date_scraped date_received
1
DA/1328/2014/A
274 Quarter Sessions Road WESTLEIGH NSW 2120 AUSTRALIA
Section 96 (1a) - Residential - Alterations & Additions
mailto:devmail@hornsby.nsw.gov.au?subject=Development Application Enquiry: DA/1328/2014/A
2015-12-03
2015-11-02
2
DA/1428/2015
40 Jenner Road DURAL NSW 2158 AUSTRALIA
Residential - Alterations & Additions - Awning
mailto:devmail@hornsby.nsw.gov.au?subject=Development Application Enquiry: DA/1428/2015
2015-12-03
2015-11-02
3
DA/1429/2015
21 Lyndelle Place CARLINGFORD NSW 2118 AUSTRALIA
Residential - Alterations & Additions - Balcony Extension
mailto:devmail@hornsby.nsw.gov.au?subject=Development Application Enquiry: DA/1429/2015
2015-12-03
2015-11-02
4
DA/1431/2015
7 Sherwood Close PENNANT HILLS NSW 2120 AUSTRALIA
Residential - Alterations & Additions - Carport
mailto:devmail@hornsby.nsw.gov.au?subject=Development Application Enquiry: DA/1431/2015
2015-12-03
2015-11-02
5
DA/1432/2015
Westleigh Shopping Centre 4-8 Eucalyptus Drive WESTLEIGH NSW 2120 AUSTRALIA
Commercial / Retail / Office - Retail Premises - Alterations & Additions
mailto:devmail@hornsby.nsw.gov.au?subject=Development Application Enquiry: DA/1432/2015
2015-12-03
2015-11-02
6
DA/231/2013/A
9 Carters Road DURAL NSW 2158 AUSTRALIA
Section 96 (1a) - Residential - Alterations & Additions
mailto:devmail@hornsby.nsw.gov.au?subject=Development Application Enquiry: DA/231/2013/A
2015-12-03
2015-11-02
7
DA/1433/2015
50 Casuarina Drive CHERRYBROOK NSW 2126 AUSTRALIA
Residential - Alterations & Additions - Decks
mailto:devmail@hornsby.nsw.gov.au?subject=Development Application Enquiry: DA/1433/2015
2015-12-03
2015-11-02
8
DA/1425/2014/A
11-15 Moores Road GLENORIE NSW 2157 AUSTRALIA
Section 96 (1a) - Industrial - Warehouse - Alterations & Additions
mailto:devmail@hornsby.nsw.gov.au?subject=Development Application Enquiry: DA/1425/2014/A
2015-12-03
2015-11-02
9
DA/1435/2015
3 Brecks Way PENNANT HILLS NSW 2120 AUSTRALIA
Residential - Alterations & Additions
mailto:devmail@hornsby.nsw.gov.au?subject=Development Application Enquiry: DA/1435/2015
2015-12-03
2015-11-03
10
DA/1436/2015
155 Peats Ferry Rd HORNSBY NSW 2077 AUSTRALIA
Amended Plans - Commercial / Retail / Office - Restaurant - Alterations & Additions - Covered Walkway
mailto:devmail@hornsby.nsw.gov.au?subject=Development Application Enquiry: DA/1436/2015
2015-12-03
2015-11-03

Statistics

Average successful run time: 2 minutes

Total run time: 3 days

Total cpu time used: 5 minutes

Total disk space used: 1.31 MB

History

  • Auto ran revision 938dd62d and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 938dd62d and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 938dd62d and completed successfully .
    nothing changed in the database
    106 pages scraped
  • Auto ran revision 938dd62d and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 938dd62d and completed successfully .
    nothing changed in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

hornsby / scraper.php