Griffith City Council scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 10 days) * thismonth * lastmonth * custom = yyyy-mm ( eg. 2017-01 )

Enjoy

Contributors mlandauer LoveMyData

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping...   ! ERROR: Failed to download minimal PHP for bootstrapping.  Please try again, or contact support if this problem persists. 

Data

Downloaded 1658 times by LoveMyData henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (378 KB) Use the API

rows 10 / 1326

id council_reference address description info_url comment_url date_scraped date_received
1
554/2016.1
68 Zirilli Av, Griffith 2680 NSW
Dwelling with attached garage
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-16
2
553/2016.1
21 Zirilli Av, Griffith 2680 NSW
Dwelling with attached garage
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-24
3
176/2016.1
220 Banna Av, Griffith 2680 NSW
Retail fitout for Australian Unity Client Centre
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-19
4
188/2016.1
62 Hyandra St, Griffith 2680 NSW
Shed
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-31
5
239/2015.1
20 Barellan St, Griffith 2680 NSW
Carport
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-30
6
179/2016.1
79 Spence Rd, Griffith 2680 NSW
Dwelling with attached garage
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-23
7
190/2016.1
54 Pilloni Rd, Yoogali 2680 NSW
New Shed/Awning
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-31
8
192/2016.1
38-40 Kidman Wy, Griffith 2680 NSW
Industrial shed for ancillary to existing trucking business
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-31
9
189/2016.1
7 Gordon Av, Griffith 2680 NSW
Shed
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-31
10
76/2016.1
Railway Pde, Yenda 2681 NSW
Patio
mailto:admin@griffith.nsw.gov.au
2016-09-12
2016-08-30

Statistics

Average successful run time: half a minute

Total run time: about 13 hours

Total cpu time used: 4 minutes

Total disk space used: 504 KB

History

  • Auto ran revision 900ebcfa and failed .
    nothing changed in the database
  • Auto ran revision 900ebcfa and failed .
    nothing changed in the database
  • Auto ran revision 900ebcfa and failed .
    nothing changed in the database
  • Auto ran revision 900ebcfa and failed .
    nothing changed in the database
  • Auto ran revision 900ebcfa and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

griffith / scraper.php