Kogarah City Council Scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 1 week) * thismonth * lastmonth

Enjoy

Contributors mlandauer henare LoveMyData equivalentideas

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data between 15/06/2018 and 22/06/2018, changable via MORPH_PERIOD environment PHP Warning: Invalid argument supplied for foreach() in /app/scraper.php on line 61

Data

Downloaded 1783 times by openaustralia LoveMyData jesse-a-reilly TheZepto tatol86 Horizons444 Jeremy-Charlton MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (508 KB) Use the API

rows 10 / 1465

council_reference date_received description address date_scraped comment_url info_url
009/2011/00000116/003
2014-04-03
Section 96 Modification
80 Queens RD CONNELLS POINT, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000060/001
2014-04-02
Alts & adds to existing dwelling including basement & pool
36 Beach ST BLAKEHURST, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000062/001
2014-04-04
Demolition of existing dwelling
71 West CR HURSTVILLE GROVE, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000064/001
2014-04-04
New two storey dwelling
12 Merton ST KOGARAH BAY, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000066/001
2014-04-04
Alterations & addtions to the existing dwelling house
201 West ST BLAKEHURST, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000059/001
2014-04-01
New front fence
26 Terry ST BLAKEHURST, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000061/001
2014-04-03
Change of use to cafe including fit out
25 Kyle PDE KYLE BAY, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000063/001
2014-04-04
Shop fitout to Restaurant
237 Rocky Point RD RAMSGATE, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000065/001
2014-04-04
Additional level to mixed commercial/residential building
7 Hogben ST KOGARAH, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au
009/2014/00000067/001
2014-04-07
Demolition/new 2 storey dwelling/detached gym & garage/pool/fence
61 Queens RD CONNELLS POINT, NSW
2014-04-07
mailto:kmcmail@kogarah.nsw.gov.au

Statistics

Average successful run time: 1 minute

Total run time: 30 days

Total cpu time used: 26 minutes

Total disk space used: 887 KB

History

  • Auto ran revision 6e32ecf6 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6e32ecf6 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6e32ecf6 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6e32ecf6 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6e32ecf6 and completed successfully .
    nothing changed in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

kogarah / scraper.php