Griffith City Council scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 10 days) * thismonth * lastmonth * custom = yyyy-mm ( eg. 2017-01 )

Enjoy

Contributors mlandauer LoveMyData equivalentideas henare jamezpolley

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data between 16/05/2019 and 26/05/2019, changable via MORPH_PERIOD environment PHP Fatal error: Uncaught Error: Call to a member function set() on null in /app/scraper.php:39 Stack trace: #0 {main} thrown in /app/scraper.php on line 39

Data

Downloaded 2085 times by openaustralia DevAppProject LoveMyData WilliamYun jesse-a-reilly TheZepto MikeRalphson Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (565 KB) Use the API

rows 10 / 1821

info_url council_reference date_received description address date_scraped comment_url
DA 67/2014/1
2014-04-04
Alterations and aditions to existing schol
5 Warambol ST GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 65/2014/1
2014-04-03
New Comercial Car Wash
2 Oakes RD GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 64/2014/1
2014-04-02
Proposed smal bar within an existing building
20 Bana AV GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 66/2014/1
2014-04-03
Aditions to existing dweling and a detached shed
8 Hilston ST GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 207/2013/2
2014-04-03
Single dweling with atached garage and detached shed
2 Veri ST GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 68/2014/1
2014-04-10
Two attached dwellings
35 Binya ST GRIFFITH, NSW
2014-04-10
mailto:council@griffith.nsw.gov.au
DA 27/2014/2
2014-04-10
New Dwelling - Residential and Alteration/Addition to existing Garage/ New Dwelling - Residential Alteration/Addition to existing Garage/Carport/Shed/Awning - Res/Rural
18 Leonard RD HANWOOD, NSW
2014-04-10
mailto:council@griffith.nsw.gov.au
DA 194/2013/2
2014-04-11
Modify - Detached Shed & Tennis Court
3 Gardenia CT YOOGALI, NSW
2014-04-11
mailto:council@griffith.nsw.gov.au
DA 69/2014/1
2014-04-14
Two lot subdivision
117 Hanwood AV HANWOOD, NSW
2014-04-14
mailto:council@griffith.nsw.gov.au
DA 155/2012/2
2014-04-14
S.96 Modification Part 1 (6) Both sides of road being North & South should only be (North along developed property)
2 Oakes RD GRIFFITH, NSW
2014-04-14
mailto:council@griffith.nsw.gov.au

Statistics

Average successful run time: 1 minute

Total run time: 4 days

Total cpu time used: 28 minutes

Total disk space used: 676 KB

History

  • Auto ran revision 7fe51153 and failed .
    nothing changed in the database
  • Auto ran revision 7fe51153 and failed .
    nothing changed in the database
  • Auto ran revision 7fe51153 and failed .
    nothing changed in the database
  • Auto ran revision 7fe51153 and failed .
    nothing changed in the database
  • Auto ran revision 7fe51153 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

griffith / scraper.php