LoveMyData / port_macquarie_hastings

Port Macquarie-Hastings Council Development Applications

Scrapes datracker.pmhc.nsw.gov.au

The official Dubbo City Council Application Tracker


Port Macquarie Hastings Council Scraper

This site is a typical .NET site involves the followings. * Cookie - Yes * Pagnation - No, hardcoded to fetch up to first 100 records * Javascript - No * Ajax - Yes * JSON - Yes

Setup MORPH_PERIOD for data recovery, available options are * thisweek (default, today - 1 week) * thismonth * lastmonth

Enjoy

Contributors LoveMyData

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.lock; using PHP ^5.5.17  - php (5.6.36)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.33) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 1 install, 0 updates, 0 removals  - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data between 15/06/2018 and 22/06/2018, changable via MORPH_PERIOD environment Saving record 10.2018.453.1 - 70 Rosewood Rd, Rosewood 2446 NSW Skipping already saved record 10.2018.452.1 Skipping already saved record 10.2018.451.1 Skipping already saved record 680.2018.5124.1 Skipping already saved record 680.2018.5121.1 Skipping already saved record 10.2018.450.1 Skipping already saved record 21.2018.76.1 Skipping already saved record 10.2018.449.1 Skipping already saved record 680.2018.5123.1 Skipping already saved record 10.2018.448.1 Skipping already saved record 10.2018.447.1 Skipping already saved record 680.2018.7203.1 Skipping already saved record 12.2018.7203.1 Skipping already saved record 15.2018.7202.1 Skipping already saved record 10.2018.446.1 Skipping already saved record 15.2018.7203.1 Skipping already saved record 10.2018.445.1 Skipping already saved record 12.2018.7192.1 Skipping already saved record 12.2017.448.1 Skipping already saved record 11.2018.193.1 Skipping already saved record 10.2018.444.1 Skipping already saved record 680.2018.5122.1 Skipping already saved record 10.2018.443.1 Skipping already saved record 17.2015.600.2 Skipping already saved record 10.2018.442.1 Skipping already saved record 710.2018.307.1 Skipping already saved record 10.2018.441.1 Skipping already saved record 10.2018.440.1 Skipping already saved record 710.2018.6108.1 Skipping already saved record 10.2018.439.1 Skipping already saved record 10.2018.438.1 Skipping already saved record 10.2018.437.1

Data

Downloaded 684 times by LoveMyData MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.59 MB) Use the API

rows 10 / 5779

id council_reference address description info_url comment_url date_scraped date_received
1
680.2016.347.1
30 North Shore Dr, North Shore 2444 NSW
Alterations and Additions to Dwelling + Dwelling & Carport
mailto:council@pmhc.nsw.gov.au
2016-09-19
2016-09-16
2
680.2015.104.1
596 Littles Loop Rd, Upper Rollands Plains 2441 NSW
Rural Workers Dwelling - Change of Use of Existing Farm Shed
mailto:council@pmhc.nsw.gov.au
2016-09-19
2016-09-19
3
10.2016.724.1
26 Woodford Rd, North Haven 2443 NSW
Ancillary Building - Carport
mailto:council@pmhc.nsw.gov.au
2016-09-19
2016-09-14
4
680.2016.157.1
6 Ventura Pl, Port Macquarie 2444 NSW
Dwelling
mailto:council@pmhc.nsw.gov.au
2016-09-19
2016-09-15
5
15.2016.7285.1
Ocean Dr, Port Macquarie 2444 NSW
Shop Fitout (Shop 10) BASIC REGO ONLY
mailto:council@pmhc.nsw.gov.au
2016-09-19
2016-09-16
6
680.2016.723.1
Glider Sp, Kew 2439 NSW
Dwelling
mailto:council@pmhc.nsw.gov.au
2016-09-19
2016-09-14
7
710.2016.347.1
30 North Shore Dr, North Shore 2444 NSW
Driveway Crossover
mailto:council@pmhc.nsw.gov.au
2016-09-19
2016-09-16
8
11.2016.347.1
30 North Shore Dr, North Shore 2444 NSW
Alterations and Additions to Dwelling, Carport & Courtyard Fence
mailto:council@pmhc.nsw.gov.au
2016-09-19
2016-09-16
9
12.2016.347.1
30 North Shore Dr, North Shore 2444 NSW
Alterations and Additions to Dwelling
mailto:council@pmhc.nsw.gov.au
2016-09-19
2016-09-16
10
10.2016.726.1
Philip Charley Dr, Port Macquarie 2444 NSW
Multi Dwelling Housing and Community Title Subdivision
mailto:council@pmhc.nsw.gov.au
2016-09-19
2016-09-15

Statistics

Average successful run time: 3 minutes

Total run time: 6 days

Total cpu time used: 20 minutes

Total disk space used: 1.95 MB

History

  • Auto ran revision 42fee236 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • Auto ran revision 42fee236 and completed successfully .
    9 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision 42fee236 and completed successfully .
    14 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision 42fee236 and completed successfully .
    8 records added, 1 record updated in the database
    1 page scraped
  • Auto ran revision 42fee236 and completed successfully .
    1 record added, 1 record updated in the database
    1 page scraped
  • ...
  • Created on morph.io

Show complete history