planningalerts-scrapers / griffith

Scrapes datracking.griffith.nsw.gov.au

The official Griffith City Council Application Tracker


Griffith City Council scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 10 days) * thismonth * lastmonth * custom = yyyy-mm ( eg. 2017-01 )

Enjoy

Contributors mlandauer LoveMyData equivalentideas henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data between 08/07/2018 and 18/07/2018, changable via MORPH_PERIOD environment Saving record 158/2018.1 - 17 Zappacosta Cr, Yoogali 2680 NSW Skipping already saved record 156/2018.1 Skipping already saved record 157/2018.1 Skipping already saved record 216/2015.2 Skipping already saved record 154/2018.1 Skipping already saved record 155/2018.1 Skipping already saved record 214/2017.3 Skipping already saved record 214/2017.1 Skipping already saved record 246/2017.1 Skipping already saved record 42/2017.1 Skipping already saved record 543/2018.1 Skipping already saved record 152/2018.1 Skipping already saved record 153/2018.1

Data

Downloaded 1470 times by openaustralia LoveMyData jesse-a-reilly TheZepto MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (492 KB) Use the API

rows 10 / 1573

info_url council_reference date_received description address date_scraped comment_url
DA 67/2014/1
2014-04-04
Alterations and aditions to existing schol
5 Warambol ST GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 65/2014/1
2014-04-03
New Comercial Car Wash
2 Oakes RD GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 64/2014/1
2014-04-02
Proposed smal bar within an existing building
20 Bana AV GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 66/2014/1
2014-04-03
Aditions to existing dweling and a detached shed
8 Hilston ST GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 207/2013/2
2014-04-03
Single dweling with atached garage and detached shed
2 Veri ST GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 68/2014/1
2014-04-10
Two attached dwellings
35 Binya ST GRIFFITH, NSW
2014-04-10
mailto:council@griffith.nsw.gov.au
DA 27/2014/2
2014-04-10
New Dwelling - Residential and Alteration/Addition to existing Garage/ New Dwelling - Residential Alteration/Addition to existing Garage/Carport/Shed/Awning - Res/Rural
18 Leonard RD HANWOOD, NSW
2014-04-10
mailto:council@griffith.nsw.gov.au
DA 194/2013/2
2014-04-11
Modify - Detached Shed & Tennis Court
3 Gardenia CT YOOGALI, NSW
2014-04-11
mailto:council@griffith.nsw.gov.au
DA 69/2014/1
2014-04-14
Two lot subdivision
117 Hanwood AV HANWOOD, NSW
2014-04-14
mailto:council@griffith.nsw.gov.au
DA 155/2012/2
2014-04-14
S.96 Modification Part 1 (6) Both sides of road being North & South should only be (North along developed property)
2 Oakes RD GRIFFITH, NSW
2014-04-14
mailto:council@griffith.nsw.gov.au

Statistics

Average successful run time: 1 minute

Total run time: 4 days

Total cpu time used: 27 minutes

Total disk space used: 599 KB

History

  • Auto ran revision 74f16f1b and completed successfully .
    1 record added in the database
    5 pages scraped
  • Auto ran revision 74f16f1b and completed successfully .
    3 records added in the database
    802 pages scraped
  • Auto ran revision 74f16f1b and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 74f16f1b and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 74f16f1b and completed successfully .
    1 record added in the database
    5 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

griffith / scraper.php