LoveMyData / cessnock

Cessnock City Council Development Applications

Scrapes datracker.cessnock.nsw.gov.au

Cessnock City Council home page.


Cessnock City Council scraper

  • Server - .NET - ApplicationMaster
  • Accept Terms - Yes
  • Cookie tracking - Yes and managed by PGBrowser
  • Pagnation - No
  • Javascript - No
  • UserAgent - No
  • Request actual DA page for data - No
  • Clearly defined data within a row - Yes
  • JSON - Yes, in the payload

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default) * thismonth * lastmonth * custom = yyyy-mm (eg. 2017-01)

Enjoy

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.4)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.33) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 4 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (100%)   - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)   - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (100%)   - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data between 01/04/2018 and 30/04/2018, changable via MORPH_PERIOD environment Skipping already saved record 44/2018/126/1 Skipping already saved record 10/2018/86/1 Skipping already saved record 8/2018/234/1 Skipping already saved record 44/2018/134/1 Skipping already saved record 44/2018/125/1 Skipping already saved record 10/2017/34/1 Skipping already saved record 12/2016/594/2 Skipping already saved record 10/2017/708/1 Skipping already saved record 12/2017/140/2 Skipping already saved record 10/2018/206/1 Skipping already saved record 8/2018/233/1 Skipping already saved record 10/2018/205/1 Skipping already saved record 15/2018/27/1 Skipping already saved record 9/2018/87/1 Skipping already saved record 8/2018/232/1 Skipping already saved record 8/2018/231/1 Skipping already saved record 8/2018/198/1 Skipping already saved record 10/2018/231/1 Skipping already saved record 8/2006/897/3 Skipping already saved record 10/2017/727/1 Skipping already saved record 8/2018/230/1 Skipping already saved record 10/2018/229/1 Skipping already saved record 8/2018/229/1 Skipping already saved record 10/2018/230/1 Skipping already saved record 8/2018/227/1 Skipping already saved record 44/2018/133/1 Skipping already saved record 8/2018/228/1 Skipping already saved record 44/2018/132/1 Skipping already saved record 44/2018/131/1 Skipping already saved record 10/2018/91/1 Skipping already saved record 10/2018/225/1 Skipping already saved record 44/2018/123/1 Skipping already saved record 8/2018/225/1 Skipping already saved record 15/2018/30/1 Skipping already saved record 44/2018/124/1 Skipping already saved record 10/2018/226/1 Skipping already saved record 8/2018/226/1 Skipping already saved record 44/2018/121/1 Skipping already saved record 8/2018/205/1 Skipping already saved record 8/2018/206/1 Skipping already saved record 8/2018/224/1 Skipping already saved record 9/2018/88/1 Skipping already saved record 8/2018/215/1 Skipping already saved record 12/2014/201/1 Skipping already saved record 10/2018/223/1 Skipping already saved record 8/2018/223/1 Skipping already saved record 10/2017/543/2 Skipping already saved record 48/2018/1/1 Skipping already saved record 8/2017/543/2 Skipping already saved record 44/2018/114/1 Skipping already saved record 12/2016/12/2 Skipping already saved record 14/2014/114/1 Skipping already saved record 10/2018/197/1 Skipping already saved record 44/2018/117/1 Skipping already saved record 10/2018/211/1 Skipping already saved record 12/2016/727/1 Skipping already saved record 44/2018/112/1 Skipping already saved record 10/2018/221/1 Skipping already saved record 8/2018/221/1 Skipping already saved record 8/2018/222/1 Skipping already saved record 44/2018/129/1 Skipping already saved record 12/2010/43/1 Skipping already saved record 10/2018/216/1 Skipping already saved record 8/2018/216/1 Skipping already saved record 44/2018/128/1 Skipping already saved record 47/2018/7/1 Skipping already saved record 10/2018/209/1 Skipping already saved record 12/2017/201/1 Skipping already saved record 44/2018/127/1 Skipping already saved record 8/2018/197/1 Skipping already saved record 10/2018/109/1 Skipping already saved record 8/2018/211/1 Skipping already saved record 15/2016/76/2 Skipping already saved record 15/2018/28/1 Skipping already saved record 15/2018/29/1 Skipping already saved record 15/1996/134/2 Skipping already saved record 10/2018/76/1 Skipping already saved record 10/2018/217/1 Skipping already saved record 47/2018/6/1 Skipping already saved record 12/2018/37/1 Skipping already saved record 8/2018/209/1 Skipping already saved record 12/2017/237/1 Skipping already saved record 12/2017/196/1 Skipping already saved record 8/2018/212/1 Skipping already saved record 34/2018/2/1 Skipping already saved record 8/2018/203/1 Skipping already saved record 8/2018/202/1 Skipping already saved record 10/2018/204/1 Skipping already saved record 8/2018/204/1 Skipping already saved record 8/2018/218/1 Skipping already saved record 8/2018/217/1 Skipping already saved record 12/2014/460/1 Skipping already saved record 8/2018/196/1 Skipping already saved record 10/2018/142/1 Skipping already saved record 12/2017/426/1 Skipping already saved record 10/2017/484/1 Skipping already saved record 12/2017/704/1 Skipping already saved record 9/2018/84/1 Skipping already saved record 9/2018/86/1 Skipping already saved record 9/2018/85/1 Skipping already saved record 10/2018/112/1 Skipping already saved record 12/2015/67/2 Skipping already saved record 10/2018/100/1 Skipping already saved record 8/2011/268/4 Skipping already saved record 10/2013/153/1 Skipping already saved record 9/2018/82/1 Skipping already saved record 9/2018/83/1 Skipping already saved record 8/2015/632/2 Skipping already saved record 8/2018/219/1 Skipping already saved record 8/2018/220/1 Skipping already saved record 8/2018/213/1 Skipping already saved record 8/2018/214/1 Skipping already saved record 10/2018/200/1 Skipping already saved record 8/2018/200/1 Skipping already saved record 9/2018/81/1 Skipping already saved record 12/2017/538/1 Skipping already saved record 12/2016/556/1 Skipping already saved record 44/2018/122/1 Skipping already saved record 12/2017/300/1 Skipping already saved record 10/2018/210/1 Skipping already saved record 8/2018/210/1 Skipping already saved record 12/2017/366/1 Skipping already saved record 10/2018/195/1 Skipping already saved record 8/2018/195/1 Skipping already saved record 12/2017/341/1 Skipping already saved record 10/2018/56/1 Skipping already saved record 10/2018/207/1 Skipping already saved record 8/2018/207/1 Skipping already saved record 10/2018/208/1 Skipping already saved record 8/2018/208/1 Skipping already saved record 12/2017/150/1 Skipping already saved record 12/2017/335/1 Skipping already saved record 44/2018/113/1 Skipping already saved record 12/2018/5/1 Skipping already saved record 12/2017/275/1 Skipping already saved record 10/2017/482/1 Skipping already saved record 14/2016/656/1 Skipping already saved record 9/2018/80/1 Skipping already saved record 44/2018/120/1 Skipping already saved record 44/2018/119/1 Skipping already saved record 8/2016/522/3 Skipping already saved record 9/2018/79/1 Skipping already saved record 44/2018/116/1 Skipping already saved record 10/2018/201/1 Skipping already saved record 8/2018/201/1 Skipping already saved record 12/2017/456/1 Skipping already saved record 10/2018/199/1 Skipping already saved record 8/2018/199/1 Skipping already saved record 15/2018/26/1 Skipping already saved record 12/2017/58/2 Skipping already saved record 44/2018/115/1 Skipping already saved record 12/2017/157/1 Skipping already saved record 9/2018/78/1 Skipping already saved record 44/2018/111/1

Data

Downloaded 634 times by LoveMyData MikeRalphson henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.63 MB) Use the API

rows 10 / 5334

id council_reference address description info_url comment_url date_scraped date_received
1
DA 2015/498
56 Station ST BRANXTON, NSW AUSTRALIA
Garage
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000498/001&Body=
2015-11-27
2015-10-1
2
DA 2015/499
4 Maitland ST ABERMAIN, NSW AUSTRALIA
Two Lot Strata Subdivision
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000499/001&Body=
2015-11-27
2015-10-1
3
DA 2015/190/2
4 Bennett ST MILLFIELD, NSW AUSTRALIA
Section 96 (1A) to alter Carparking and Access Requirements
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000190/002&Body=
2015-11-27
2015-10-2
4
DA 2015/500
27 Busby st CLIFTLEIGH, NSW AUSTRALIA
Single Storey Dwelling with Attached Garage
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000500/001&Body=
2015-11-27
2015-10-2
5
DA 2015/501
4 Daniel ST CESSNOCK, NSW AUSTRALIA
Dual Occupancy Dwelling
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000501/001&Body=
2015-11-27
2015-10-2
6
DA 2015/502
1748 Wine Country DR NORTH ROTHBURY, NSW AUSTRALIA
Single Storey Dwelling
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000502/001&Body=
2015-11-27
2015-10-2
7
DA 2015/503
1 Ninth ST WESTON, NSW AUSTRALIA
Dwelling Additions
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000503/001&Body=
2015-11-27
2015-10-2
8
DA 2015/504
6 Waratah ST KURRI KURRI, NSW AUSTRALIA
Garage
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000504/001&Body=
2015-11-27
2015-10-6
9
DA 2015/505
11 O'Brien ST CESSNOCK, NSW AUSTRALIA
Single Storey Dwelling with Attached Garage
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000505/001&Body=
2015-11-27
2015-10-6
10
DA 2015/506
10 Ainsworth CR NORTH ROTHBURY, NSW AUSTRALIA
Single Storey Dwelling with Attached Garage
mailto:council@cessnock.nsw.gov.au?subject=Development Application Enquiry: 008/2015/00000506/001&Body=
2015-11-27
2015-10-6

Statistics

Average successful run time: less than a minute

Total run time: about 10 hours

Total cpu time used: 5 minutes

Total disk space used: 1.73 MB

History

  • Auto ran revision 0c26b8ae and completed successfully .
    nothing changed in the database
    5 pages scraped
  • Auto ran revision 0c26b8ae and completed successfully .
    15 records added, 1 record updated in the database
    5 pages scraped
  • Auto ran revision 0c26b8ae and completed successfully .
    7 records added, 1 record updated in the database
    5 pages scraped
  • Auto ran revision 0c26b8ae and completed successfully .
    13 records added, 1 record updated in the database
    5 pages scraped
  • Auto ran revision 0c26b8ae and completed successfully .
    13 records added, 1 record updated in the database
    5 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

cessnock / scraper.php