LoveMyData / cessnock

Cessnock City Council Development Applications

Scrapes datracker.cessnock.nsw.gov.au

Cessnock City Council home page.


Cessnock City Council scraper

  • Server - .NET - ApplicationMaster
  • Accept Terms - Yes
  • Cookie tracking - Yes and managed by PGBrowser
  • Pagnation - No
  • Javascript - No
  • UserAgent - No
  • Request actual DA page for data - No
  • Clearly defined data within a row - Yes
  • JSON - Yes, in the payload

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default) * thismonth * lastmonth * custom = yyyy-mm (eg. 2017-01)

Enjoy

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.1)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - apache (2.4.29)  - nginx (1.8.1) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 4 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (100%)   - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)   - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (100%)   - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data between 01/01/2018 and 31/01/2018, changable via MORPH_PERIOD environment Saving record 12/2017/73/1 - 18 Gollan Av, North Rothbury 2335 NSW Skipping already saved record 12/2017/156/1 Saving record 15/2018/5/1 - 803 Old North Rd, Rothbury 2320 NSW Skipping already saved record 15/2018/4/1 Skipping already saved record 10/2018/21/1 Saving record 10/2018/28/1 - 29 Edden St, Bellbird 2325 NSW Skipping already saved record 8/2018/28/1 Skipping already saved record 8/2018/21/1 Skipping already saved record 10/2018/29/1 Skipping already saved record 8/2018/29/1 Skipping already saved record 15/2018/3/1 Skipping already saved record 8/2018/31/1 Skipping already saved record 44/2018/16/1 Skipping already saved record 8/2018/26/1 Skipping already saved record 110/2018/1/1 Skipping already saved record 44/2018/5/1 Skipping already saved record 44/2018/4/1 Skipping already saved record 8/2018/22/1 Skipping already saved record 8/2014/315/4 Skipping already saved record 10/2018/30/1 Skipping already saved record 8/2018/30/1 Skipping already saved record 8/2018/25/1 Skipping already saved record 12/2017/686/1 Skipping already saved record 44/2018/10/1 Skipping already saved record 12/2017/86/2 Skipping already saved record 8/2018/17/1 Skipping already saved record 44/2018/15/1 Skipping already saved record 10/2017/187/1 Skipping already saved record 10/2018/27/1 Skipping already saved record 8/2018/27/1 Skipping already saved record 44/2018/14/1 Skipping already saved record 8/2018/15/1 Skipping already saved record 8/2018/16/1 Skipping already saved record 44/2018/13/1 Skipping already saved record 10/2018/26/1 Skipping already saved record 8/2018/20/1 Skipping already saved record 10/2017/740/1 Skipping already saved record 9/2018/4/1 Skipping already saved record 10/2018/14/1 Skipping already saved record 8/2018/14/1 Skipping already saved record 8/2017/677/2 Skipping already saved record 8/2018/18/1 Skipping already saved record 10/2018/24/1 Skipping already saved record 8/2018/24/1 Skipping already saved record 10/2018/23/1 Skipping already saved record 8/2018/23/1 Skipping already saved record 45/2018/1/1 Skipping already saved record 47/2018/1/1 Skipping already saved record 12/2017/62/1 Skipping already saved record 9/2018/10/1 Skipping already saved record 8/2017/617/2 Skipping already saved record 9/2018/9/1 Skipping already saved record 9/2018/8/1 Skipping already saved record 10/2017/702/1 Skipping already saved record 9/2018/1/1 Skipping already saved record 10/2018/11/1 Skipping already saved record 8/2018/11/1 Skipping already saved record 9/2018/7/1 Skipping already saved record 9/2017/276/2 Skipping already saved record 10/2017/732/1 Skipping already saved record 12/2017/176/1 Skipping already saved record 8/2018/9/1 Skipping already saved record 10/2018/9/1 Skipping already saved record 8/2018/7/1 Skipping already saved record 10/2018/6/1 Skipping already saved record 8/2018/6/1 Skipping already saved record 44/2018/11/1 Skipping already saved record 9/2018/6/1 Skipping already saved record 12/2015/554/1 Skipping already saved record 10/2017/721/1 Skipping already saved record 12/2017/189/1 Skipping already saved record 9/2018/5/1 Skipping already saved record 8/2016/522/2 Skipping already saved record 8/2015/588/2 Skipping already saved record 34/2018/1/1 Skipping already saved record 44/2018/12/1 Skipping already saved record 44/2018/6/1 Skipping already saved record 12/2017/52/1 Skipping already saved record 44/2018/8/1 Skipping already saved record 15/2018/2/1 Skipping already saved record 44/2018/9/1 Skipping already saved record 10/2018/19/1 Skipping already saved record 8/2018/19/1 Skipping already saved record 8/2007/757/9 Skipping already saved record 12/2017/434/1 Skipping already saved record 44/2018/3/1 Skipping already saved record 44/2018/7/1 Skipping already saved record 12/2016/413/1 Skipping already saved record 10/2017/634/1 Skipping already saved record 12/2017/95/1 Skipping already saved record 10/2013/649/10 Skipping already saved record 14/2013/649/4 Skipping already saved record 15/2018/1/1 Skipping already saved record 8/2018/13/1 Skipping already saved record 8/2018/12/1 Skipping already saved record 12/2015/402/1 Skipping already saved record 12/2006/902/1 Skipping already saved record 12/2017/549/1 Skipping already saved record 10/2018/8/1 Skipping already saved record 8/2018/8/1 Skipping already saved record 8/2018/10/1 Skipping already saved record 8/2017/348/2 Skipping already saved record 44/2018/2/1 Skipping already saved record 10/2018/5/1 Skipping already saved record 8/2018/5/1 Skipping already saved record 8/2018/3/1 Skipping already saved record 10/2018/3/1 Skipping already saved record 9/2018/3/1 Skipping already saved record 44/2018/1/1 Skipping already saved record 9/2018/2/1 Skipping already saved record 10/2018/2/1 Skipping already saved record 8/2018/2/1 Skipping already saved record 10/2018/4/1 Skipping already saved record 8/2018/4/1

Data

Downloaded 545 times by LoveMyData MikeRalphson henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.41 MB) Use the API

rows 10 / 4553

id council_reference address description info_url comment_url date_scraped date_received
1
DA 2015/498
56 Station ST BRANXTON, NSW AUSTRALIA
Garage
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000498/001&Body=
2015-11-27
2015-10-1
2
DA 2015/499
4 Maitland ST ABERMAIN, NSW AUSTRALIA
Two Lot Strata Subdivision
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000499/001&Body=
2015-11-27
2015-10-1
3
DA 2015/190/2
4 Bennett ST MILLFIELD, NSW AUSTRALIA
Section 96 (1A) to alter Carparking and Access Requirements
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000190/002&Body=
2015-11-27
2015-10-2
4
DA 2015/500
27 Busby st CLIFTLEIGH, NSW AUSTRALIA
Single Storey Dwelling with Attached Garage
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000500/001&Body=
2015-11-27
2015-10-2
5
DA 2015/501
4 Daniel ST CESSNOCK, NSW AUSTRALIA
Dual Occupancy Dwelling
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000501/001&Body=
2015-11-27
2015-10-2
6
DA 2015/502
1748 Wine Country DR NORTH ROTHBURY, NSW AUSTRALIA
Single Storey Dwelling
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000502/001&Body=
2015-11-27
2015-10-2
7
DA 2015/503
1 Ninth ST WESTON, NSW AUSTRALIA
Dwelling Additions
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000503/001&Body=
2015-11-27
2015-10-2
8
DA 2015/504
6 Waratah ST KURRI KURRI, NSW AUSTRALIA
Garage
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000504/001&Body=
2015-11-27
2015-10-6
9
DA 2015/505
11 O'Brien ST CESSNOCK, NSW AUSTRALIA
Single Storey Dwelling with Attached Garage
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000505/001&Body=
2015-11-27
2015-10-6
10
DA 2015/506
10 Ainsworth CR NORTH ROTHBURY, NSW AUSTRALIA
Single Storey Dwelling with Attached Garage
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000506/001&Body=
2015-11-27
2015-10-6

Statistics

Average successful run time: less than a minute

Total run time: about 9 hours

Total cpu time used: 5 minutes

Total disk space used: 1.52 MB

History

  • Auto ran revision 0c26b8ae and completed successfully .
    3 records added, 1 record updated in the database
    5 pages scraped
  • Auto ran revision 0c26b8ae and completed successfully .
    36 records added, 1 record updated in the database
    5 pages scraped
  • Auto ran revision 0c26b8ae and failed .
    nothing changed in the database
  • Auto ran revision 0c26b8ae and failed .
    nothing changed in the database
  • Auto ran revision 0c26b8ae and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

cessnock / scraper.php