Kogarah City Council Scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 1 week) * thismonth * lastmonth

Enjoy

Contributors mlandauer henare LoveMyData equivalentideas

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping...   ! ERROR: Failed to download minimal PHP for bootstrapping.  Please try again, or contact support if this problem persists. 

Data

Downloaded 2598 times by openaustralia LoveMyData DevAppProject WilliamYun jesse-a-reilly TheZepto irwin-r tatol86 horizons444 MikeRalphson razz969 Jedwards157 Jeremy-Charlton

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (508 KB) Use the API

rows 10 / 1465

council_reference date_received description address date_scraped comment_url info_url
009/2011/00000116/003
2014-04-03
Section 96 Modification
80 Queens RD CONNELLS POINT, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000060/001
2014-04-02
Alts & adds to existing dwelling including basement & pool
36 Beach ST BLAKEHURST, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000062/001
2014-04-04
Demolition of existing dwelling
71 West CR HURSTVILLE GROVE, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000064/001
2014-04-04
New two storey dwelling
12 Merton ST KOGARAH BAY, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000066/001
2014-04-04
Alterations & addtions to the existing dwelling house
201 West ST BLAKEHURST, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000059/001
2014-04-01
New front fence
26 Terry ST BLAKEHURST, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000061/001
2014-04-03
Change of use to cafe including fit out
25 Kyle PDE KYLE BAY, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000063/001
2014-04-04
Shop fitout to Restaurant
237 Rocky Point RD RAMSGATE, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000065/001
2014-04-04
Additional level to mixed commercial/residential building
7 Hogben ST KOGARAH, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000067/001
2014-04-07
Demolition/new 2 storey dwelling/detached gym & garage/pool/fence
61 Queens RD CONNELLS POINT, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au

Statistics

Average successful run time: less than a minute

Total run time: about 1 month

Total cpu time used: 27 minutes

Total disk space used: 890 KB

History

  • Auto ran revision c17c9361 and failed .
    nothing changed in the database
  • Auto ran revision c17c9361 and failed .
    nothing changed in the database
  • Auto ran revision c17c9361 and failed .
    nothing changed in the database
  • Auto ran revision c17c9361 and failed .
    nothing changed in the database
  • Auto ran revision c17c9361 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

kogarah / scraper.php