LoveMyData / georges_river

Georges River Council scraper

Scrapes www2.kogarah.nsw.gov.au


Georges River council scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 1 week) * thismonth * lastmonth

Enjoy

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data between 26/11/2016 and 03/12/2016, changable via MORPH_PERIOD environment Skipping already saved record 9/2016/254/1 Skipping already saved record 9/2016/257/1 Skipping already saved record 17/2016/32/1 Skipping already saved record 9/2016/256/1 Skipping already saved record 17/2016/31/1 Skipping already saved record 9/2016/255/1 Skipping already saved record 8/2016/103/1 Skipping already saved record 9/2016/66/2 Skipping already saved record 9/2016/253/1 Skipping already saved record 9/2016/252/1 Skipping already saved record 9/2011/62/3 Skipping already saved record 8/2016/102/1

Data

Downloaded 2 times by equivalentideas LoveMyData

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (63 KB) Use the API

rows 10 / 195

id council_reference address description info_url comment_url date_scraped date_received
1
9/2015/271/2
12 East Cr, Hurstville Grove 2220 NSW
Section 96 Modification - to setback carport 500mm from existing garage
mailto:mail@kogarah.nsw.gov.au
2016-09-11
2016-08-08
2
8/2016/82/1
301/15 Kensington St, Kogarah 2217 NSW
Office fit out including full height partitioning
mailto:mail@kogarah.nsw.gov.au
2016-09-11
2016-08-31
3
9/2015/216/2
14 Claremont St, Penshurst 2222 NSW
Section 96 Modification - additional window and changes to material finishes to approved building works
mailto:mail@kogarah.nsw.gov.au
2016-09-11
2016-08-08
4
9/2016/178/1
8 Coogarah St, Blakehurst 2221 NSW
Alterations and additions to existing dwelling, including construction of a new garage and carport
mailto:mail@kogarah.nsw.gov.au
2016-09-11
2016-08-26
5
9/2016/174/1
15 Lynwood St, Blakehurst 2221 NSW
Demolition, new attached two (2) storey dual occupancy, front fence & Torrens subdivision
mailto:mail@kogarah.nsw.gov.au
2016-09-11
2016-08-24
6
9/2013/212/3
9 Edna Av, Penshurst 2222 NSW
Section 96 Modification - Alterations and additions to approved building works as already modified
mailto:mail@kogarah.nsw.gov.au
2016-09-11
2016-08-22
7
9/2013/122/2
46 Townson St, Blakehurst 2221 NSW
Section 96 Modification - Alterations and additions to approved new dwelling
mailto:mail@kogarah.nsw.gov.au
2016-09-11
2016-08-22
8
9/2016/179/1
14 Wentworth Av, Blakehurst 2221 NSW
Demolition of an existing dwelling and construction of a new two (2) storey dwelling and swimming pool
mailto:mail@kogarah.nsw.gov.au
2016-09-11
2016-08-29
9
9/2016/175/1
14 Harslett Cr, Beverley Park 2217 NSW
Demolition of existing dwelling, construction of new two (2) storey dwelling and inground pool
mailto:mail@kogarah.nsw.gov.au
2016-09-11
2016-08-24
10
9/2013/131/3
227 Terry St, Connells Point 2221 NSW
Section 96 Modification (ii)
mailto:mail@kogarah.nsw.gov.au
2016-09-11
2016-08-31

Statistics

Average successful run time: half a minute

Total run time: 27 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 447 KB

History

  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    11 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    1 record added, 1 record updated in the database
    1234 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    2 records added, 1 record updated in the database
    2 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    2 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    2 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    7 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    2 records added, 1 record updated in the database
    3 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    6 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    5 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    2 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    5 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    6 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    81 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    2 records added, 1 record updated in the database
    5 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    5 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    1 record added, 1 record updated in the database
    2 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    9 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    2 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    4 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    3 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision efdc12e8 and completed successfully .
    2 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision efdc12e8 and completed successfully .
    6 records added, 1 record updated in the database
  • Manually ran revision efdc12e8 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision efdc12e8 and completed successfully .
    17 records added, 1 record updated in the database
    1 page scraped
  • Manually ran revision efdc12e8 and completed successfully .
    53 records added in the database
    1 page scraped
  • Manually ran revision efdc12e8 and completed successfully .
    12 records added in the database
    1 page scraped
  • Created on morph.io

Scraper code

PHP

georges_river / scraper.php