planningalerts-scrapers / griffith

Scrapes datracking.griffith.nsw.gov.au and www.trafford.gov.uk

The official Griffith City Council Application Tracker


Griffith City Council scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 10 days) * thismonth * lastmonth * custom = yyyy-mm ( eg. 2017-01 )

Enjoy

Contributors mlandauer LoveMyData equivalentideas henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data between 11/09/2018 and 21/09/2018, changable via MORPH_PERIOD environment Skipping already saved record 215/2017.1 Skipping already saved record 215/2017.1 Saving record 215/2018.1 - 458 Lake View Branch Canal Rd, Nericon 2680 NSW Skipping already saved record 215/2018.1 Skipping already saved record 137/2017.1 Skipping already saved record 224/2016.2 Skipping already saved record 214/2018.1 Skipping already saved record 206/2018.1 Skipping already saved record 212/2018.1 Skipping already saved record 213/2018.1 Skipping already saved record 209/2018.1 Skipping already saved record 177/2018.1 Skipping already saved record 210/2018.1 Skipping already saved record 208/2018.1 Skipping already saved record 231/2017.4 Skipping already saved record 245/2017.2 Skipping already saved record 211/2018.1 Skipping already saved record 140/2018.1 Skipping already saved record 562/2018.1 Skipping already saved record 207/2018.1

Data

Downloaded 1534 times by openaustralia LoveMyData jesse-a-reilly TheZepto MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (518 KB) Use the API

rows 10 / 1662

info_url council_reference date_received description address date_scraped comment_url
DA 67/2014/1
2014-04-04
Alterations and aditions to existing schol
5 Warambol ST GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 65/2014/1
2014-04-03
New Comercial Car Wash
2 Oakes RD GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 64/2014/1
2014-04-02
Proposed smal bar within an existing building
20 Bana AV GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 66/2014/1
2014-04-03
Aditions to existing dweling and a detached shed
8 Hilston ST GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 207/2013/2
2014-04-03
Single dweling with atached garage and detached shed
2 Veri ST GRIFITH, NSW
2014-04-07
mailto:council@griffith.nsw.gov.au
DA 68/2014/1
2014-04-10
Two attached dwellings
35 Binya ST GRIFFITH, NSW
2014-04-10
mailto:council@griffith.nsw.gov.au
DA 27/2014/2
2014-04-10
New Dwelling - Residential and Alteration/Addition to existing Garage/ New Dwelling - Residential Alteration/Addition to existing Garage/Carport/Shed/Awning - Res/Rural
18 Leonard RD HANWOOD, NSW
2014-04-10
mailto:council@griffith.nsw.gov.au
DA 194/2013/2
2014-04-11
Modify - Detached Shed & Tennis Court
3 Gardenia CT YOOGALI, NSW
2014-04-11
mailto:council@griffith.nsw.gov.au
DA 69/2014/1
2014-04-14
Two lot subdivision
117 Hanwood AV HANWOOD, NSW
2014-04-14
mailto:council@griffith.nsw.gov.au
DA 155/2012/2
2014-04-14
S.96 Modification Part 1 (6) Both sides of road being North & South should only be (North along developed property)
2 Oakes RD GRIFFITH, NSW
2014-04-14
mailto:council@griffith.nsw.gov.au

Statistics

Average successful run time: 1 minute

Total run time: 4 days

Total cpu time used: 27 minutes

Total disk space used: 625 KB

History

  • Auto ran revision 74f16f1b and completed successfully .
    1 record added in the database
    38 pages scraped
  • Auto ran revision 74f16f1b and completed successfully .
    1 record added in the database
    5 pages scraped
  • Auto ran revision 74f16f1b and completed successfully .
    2 records added in the database
    5 pages scraped
  • Auto ran revision 74f16f1b and completed successfully .
    1 record added in the database
    5 pages scraped
  • Auto ran revision 74f16f1b and completed successfully .
    nothing changed in the database
    5 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

griffith / scraper.php