planningalerts-scrapers / lismore

Lismore City Council Development Applications

Scrapes tracker.lismore.nsw.gov.au

The official Lismore City Council Application Tracker


Lismore City Council Scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 1 week) * thismonth * lastmonth

Enjoy

Contributors LoveMyData equivalentideas

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.lock; using PHP ^5.5.17  - php (5.6.36)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.33) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 1 install, 0 updates, 0 removals  - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data between 16/06/2018 and 23/06/2018, changable via MORPH_PERIOD environment Saving record 5.2015.165.2 - 224 Invercauld Rd, Goonellabah 2480 NSW Saving record 10.2018.226.1 - 37 Hart Rd, Larnook 2480 NSW Saving record 5.2018.226.1 - 37 Hart Rd, Larnook 2480 NSW Skipping already saved record 10.2018.189.1 Saving record 10.2018.195.1 - 11 Newhaven Dr, Goonellabah 2480 NSW Saving record 5.2018.225.1 - 252 Oliver Av, Goonellabah 2480 NSW Skipping already saved record 5.2018.224.1 Saving record 5.1998.7.4 - 9 Fredericks Rd, Caniaba 2480 NSW Saving record 10.2017.1.1 - 237 Broadwater Rd, Dungarubba 2480 NSW Skipping already saved record 13.2015.76.2 Skipping already saved record 5.2018.222.1 Skipping already saved record 10.2018.222.1 Skipping already saved record 10.2018.221.1 Skipping already saved record 5.2018.221.1 Skipping already saved record 5.2018.223.1 Skipping already saved record 10.2018.223.1 Skipping already saved record 10.2017.333.1 Skipping already saved record 13.2006.667.5

Data

Downloaded 1046 times by openaustralia jesse-a-reilly TheZepto MikeRalphson LoveMyData

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (668 KB) Use the API

rows 10 / 2229

id council_reference address description info_url comment_url date_scraped date_received
1
2015/357/1
354 Broadwater Road DUNGARUBBA NSW 2480, Australia
DA15/357 - 354 Broadwater Road, Broadwater - Industry (concrete posts) Industry (manufacture of concrete posts)
2015-12-26
2015-12-22
2
2015/356/1
1055 Bruxner Highway GOONELLABAH NSW 2480, Australia
DA15/356 - 1055 Bruxcner Highway - Modular Bio Village Modular Bio Village and associated community farm (SEPP 36)
2015-12-26
2015-12-22
3
2015/354/1
647 Cowlong Road ELTHAM NSW 2480, Australia
DA15/354 - 647 Cowlong Road - Above ground pool Above ground pool, decking, fencing and screening
2015-12-26
2015-12-21
4
2015/353/1
89 Dudley Drive GOONELLABAH NSW 2480, Australia
DA15/353 - 89 Dudley Drive - Dwelling and retaining wall & BLV Dwelling and retaining wall, plus a building line variation to 5.6m to Kadina Street (unformed)
2015-12-26
2015-12-21
5
2015/358/1
Unit 1 8 Graeme Avenue GOONELLABAH NSW 2480, Australia
Dwelling
2015-12-26
2015-12-23
6
2015/359/1
10 Rhodes Street SOUTH LISMORE NSW 2480, Australia
Place of Public Worship
2015-12-26
2015-12-23
7
2015/355/1
17 Standing Street THE CHANNON NSW 2480, Australia
DA15/355 - 17 Standing Street - Demolish existing enclosed verahdah Demolish existing enclosed verahdah and construct an open verandah and extend front room 1m
2015-12-26
2015-12-22
8
2015/324/1
5 Acacia Avenue GOONELLABAH NSW 2480, Australia
DA15/234 - 5 Acacia Avenue - Shed, carport, retaining wall and BLV Shed, carport and retaining wall with a building line variation to 2.5m to Acacia Avenue
2015-12-26
2015-11-20
9
2004/532/5
33 Acacia Avenue GOONELLABAH NSW 2480, Australia
Section 96(1A) modification for adjustments to tree removal list Section 96(1A) modification for adjustments to tree removal list
2015-12-26
2015-11-20
10
2013/299/5
1344 Bangalow Road CLUNES NSW 2480, Australia
Section96(1A) modification to reduce the length of the building by 5m Section 96(1A) modification to reduce the length of the function centre by 5m
2015-12-26
2015-11-06

Statistics

Average successful run time: less than a minute

Total run time: about 10 hours

Total cpu time used: 4 minutes

Total disk space used: 1.02 MB

History

  • Auto ran revision ccbb6c62 and completed successfully .
    7 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision ccbb6c62 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision ccbb6c62 and completed successfully .
    8 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision ccbb6c62 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision ccbb6c62 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

lismore / scraper.php