planningalerts-scrapers / lismore

Lismore City Council Development Applications

Scrapes tracker.lismore.nsw.gov.au and www.herefordshire.gov.uk

The official Lismore City Council Application Tracker


Lismore City Council Scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 1 week) * thismonth * lastmonth

Enjoy

Contributors LoveMyData equivalentideas

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data between 03/12/2018 and 10/12/2018, changable via MORPH_PERIOD environment Skipping already saved record 10.2018.318.1 Skipping already saved record 10.2018.453.1 Skipping already saved record 5.2018.453.1 Skipping already saved record 5.2018.448.1 Skipping already saved record 5.2018.452.1 Skipping already saved record 5.2018.451.1 Skipping already saved record 5.2016.258.3 Skipping already saved record 10.2018.37.1 Skipping already saved record 10.2018.451.1 Skipping already saved record 5.2018.450.1 Skipping already saved record 8.2018.41.1 Skipping already saved record 5.2018.449.1 Skipping already saved record 10.2018.350.1 Skipping already saved record 8.2018.42.1 Skipping already saved record 10.2018.358.1 Skipping already saved record 10.2018.447.1 Skipping already saved record 5.2018.447.1 Skipping already saved record 10.2018.254.1 Skipping already saved record 5.2018.446.1 Skipping already saved record 5.2018.445.1

Data

Downloaded 1210 times by openaustralia jesse-a-reilly TheZepto MikeRalphson LoveMyData

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (813 KB) Use the API

rows 10 / 2751

id council_reference address description info_url comment_url date_scraped date_received
1
2015/357/1
354 Broadwater Road DUNGARUBBA NSW 2480, Australia
DA15/357 - 354 Broadwater Road, Broadwater - Industry (concrete posts) Industry (manufacture of concrete posts)
2015-12-26
2015-12-22
2
2015/356/1
1055 Bruxner Highway GOONELLABAH NSW 2480, Australia
DA15/356 - 1055 Bruxcner Highway - Modular Bio Village Modular Bio Village and associated community farm (SEPP 36)
2015-12-26
2015-12-22
3
2015/354/1
647 Cowlong Road ELTHAM NSW 2480, Australia
DA15/354 - 647 Cowlong Road - Above ground pool Above ground pool, decking, fencing and screening
2015-12-26
2015-12-21
4
2015/353/1
89 Dudley Drive GOONELLABAH NSW 2480, Australia
DA15/353 - 89 Dudley Drive - Dwelling and retaining wall & BLV Dwelling and retaining wall, plus a building line variation to 5.6m to Kadina Street (unformed)
2015-12-26
2015-12-21
5
2015/358/1
Unit 1 8 Graeme Avenue GOONELLABAH NSW 2480, Australia
Dwelling
2015-12-26
2015-12-23
6
2015/359/1
10 Rhodes Street SOUTH LISMORE NSW 2480, Australia
Place of Public Worship
2015-12-26
2015-12-23
7
2015/355/1
17 Standing Street THE CHANNON NSW 2480, Australia
DA15/355 - 17 Standing Street - Demolish existing enclosed verahdah Demolish existing enclosed verahdah and construct an open verandah and extend front room 1m
2015-12-26
2015-12-22
8
2015/324/1
5 Acacia Avenue GOONELLABAH NSW 2480, Australia
DA15/234 - 5 Acacia Avenue - Shed, carport, retaining wall and BLV Shed, carport and retaining wall with a building line variation to 2.5m to Acacia Avenue
2015-12-26
2015-11-20
9
2004/532/5
33 Acacia Avenue GOONELLABAH NSW 2480, Australia
Section 96(1A) modification for adjustments to tree removal list Section 96(1A) modification for adjustments to tree removal list
2015-12-26
2015-11-20
10
2013/299/5
1344 Bangalow Road CLUNES NSW 2480, Australia
Section96(1A) modification to reduce the length of the building by 5m Section 96(1A) modification to reduce the length of the function centre by 5m
2015-12-26
2015-11-06

Statistics

Average successful run time: half a minute

Total run time: about 11 hours

Total cpu time used: 5 minutes

Total disk space used: 1.16 MB

History

  • Auto ran revision ccbb6c62 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision ccbb6c62 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision ccbb6c62 and completed successfully .
    2 records added, 1 record updated in the database
    38 pages scraped
  • Auto ran revision ccbb6c62 and completed successfully .
    10 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision ccbb6c62 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

lismore / scraper.php