planningalerts-scrapers / shellharbour

Shellharbour City Council Development Application

Scrapes eservices.shellharbour.nsw.gov.au


Shellharbour City Council Scraper

Shellharbour Council involves the followings * Cookie tracking - No * Pagnation - No * Javascript - No * Clearly defined data within a table - Yes, three cheers to this council

Enjoy

Contributors LoveMyData henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.lock; using PHP ^5.5.17  - php (5.6.36)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.33) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 1 install, 0 updates, 0 removals  - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Skipping already saved record or ignore corrupted data - DA0064/2018 Skipping already saved record or ignore corrupted data - DA0171/2018 Skipping already saved record or ignore corrupted data - DA0182/2018 Skipping already saved record or ignore corrupted data - DA0187/2018 Skipping already saved record or ignore corrupted data - DA0190/2018 Skipping already saved record or ignore corrupted data - DA0198/2018 Skipping already saved record or ignore corrupted data - DA0200/2018 Skipping already saved record or ignore corrupted data - DA0205/2018 Skipping already saved record or ignore corrupted data - DAM0039/2018 Skipping already saved record or ignore corrupted data - DA0211/2018 Skipping already saved record or ignore corrupted data - DA0218/2018 Skipping already saved record or ignore corrupted data - DA0219/2018 Skipping already saved record or ignore corrupted data - DA0220/2018 Skipping already saved record or ignore corrupted data - DA0223/2018 Skipping already saved record or ignore corrupted data - DA0229/2018 Skipping already saved record or ignore corrupted data - DA0235/2018 Skipping already saved record or ignore corrupted data - DA0238/2018 Skipping already saved record or ignore corrupted data - DA0239/2018 Skipping already saved record or ignore corrupted data - DA0240/2018 Skipping already saved record or ignore corrupted data - DA0245/2018 Skipping already saved record or ignore corrupted data - DA0246/2018 Skipping already saved record or ignore corrupted data - DA0258/2018 Skipping already saved record or ignore corrupted data - DA0264/2018 Skipping already saved record or ignore corrupted data - DA0266/2018 Saving record DA0276/2018

Data

Downloaded 1059 times by openaustralia jesse-a-reilly TheZepto mattykn MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (553 KB) Use the API

rows 10 / 1044

id council_reference address description info_url comment_url date_scraped on_notice_to
1
685/2015
4 Valley View CRES, ALBION PARK, Australia
Two Townhouses with Garages and Torrens Title Subdivision (Dual Occupancy)
2015-12-14
2015-12-23
2
678/2015
5 Valley View CRES, ALBION PARK, Australia
Two Townhouses with Garages and Torrens Title Subdivision (Dual Occupancy)
2015-12-14
2015-12-23
3
695/2015
15 Fields DR, ALBION PARK, Australia
Two Storey Dwelling With Garage
2015-12-14
2015-12-15
4
689/2015
22 Whistlers RUN, ALBION PARK, Australia
Two, Two Lot Torrens Title Subdivisions
2015-12-14
2016-01-08
5
DA 698/2015
Russell ST, ALBION PARK, Australia
Use of Shop 8 as a Cafe (Michel's Patisserie) with Alfresco Dining
2015-12-14
2015-12-21
6
DAM 555/2015
22 Whistlers RUN, ALBION PARK, Australia
Change to consent condition requiring high sill window to larger window
2015-12-14
2016-01-04
7
0627/2015
2 Jarrah WY, ALBION PARK RAIL, Australia
Re-Notification due to increase in dwelling height - Dual Occupancy Comprising of Retention of Existing Dwelling & Demolition of Existing Carport, Proposed Townhouse with Garage & Torrens Title Subdivision
2015-12-14
2015-12-16
8
DAM0544/2015
1/32 Airport RD, ALBION PARK RAIL, Australia
Amendment to Event Dates (change from 3 days in May to 3 calendar days) - Wings Over the Illawarra
2015-12-14
2015-12-23
9
680/2015
16 Shaban ST, ALBION PARK RAIL, Australia
Industrial Unit
2015-12-14
2015-12-14
10
DA0697/2015
70 Princes HWY, ALBION PARK RAIL, Australia
Garage and Attached Deck
2015-12-14
2015-12-21

Statistics

Average successful run time: half a minute

Total run time: about 6 hours

Total cpu time used: 5 minutes

Total disk space used: 927 KB

History

  • Auto ran revision 9fbe02ad and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision 9fbe02ad and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 9fbe02ad and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9fbe02ad and completed successfully .
    10 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision 9fbe02ad and completed successfully .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

shellharbour / scraper.php