LoveMyData / townsville

Townsville City Council Development Applications

Scrapes eplanning.townsville.qld.gov.au

eplanning @ Townsville


City of Townsville Council scraper

  • Server - .NET - XC.Track
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Clearly defined data within a row - Yes
  • Scrape detail page - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData otherchirps henare daveslutzkin mlandauer hailspuds

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.7)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.33) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 5 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (100%)   - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)   - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (100%)   - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  - Installing sunra/php-simple-html-dom-parser (v1.5.2): Downloading (connecting...)Downloading (0%) Downloading (15%)Downloading (30%)Downloading (45%)Downloading (50%)Downloading (100%)  Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data for `thismonth`, changable via MORPH_PERIOD environment Skipping already saved record CAR18/0153 Skipping already saved record RAL18/0061 Skipping already saved record RAL18/0062 Skipping already saved record CAR18/0154 Skipping already saved record CAR18/0155 Skipping already saved record CAR18/0156 Skipping already saved record CAR18/0157 Skipping already saved record CAR18/0158 Skipping already saved record MCU18/0077 Skipping already saved record OP16/0093.02 Skipping already saved record POS18/0056 Skipping already saved record CAR18/0159 Skipping already saved record RAL18/0063 Skipping already saved record CAR18/0160 Skipping already saved record POS18/0057 Skipping already saved record CAR18/0161 Skipping already saved record MCU17/0086.01 Skipping already saved record OP17/0007.01 Skipping already saved record OPW18/0022.01 Skipping already saved record MCU18/0079 Skipping already saved record POS18/0058 Skipping already saved record RAL18/0064 Skipping already saved record OP16/0110.27 Skipping already saved record CAR18/0162 Skipping already saved record CAR18/0163 Skipping already saved record OP16/0110.28 Skipping already saved record CAR18/0164 Skipping already saved record POS18/0059 Skipping already saved record RAL18/0066 Skipping already saved record CAR18/0165 Saving record OPW18/0072 - 609 Woolcock Street MOUNT LOUISA QLD 4814 Skipping already saved record POS18/0062 Skipping already saved record POS18/0063 Saving record OPW18/0073 - 435 Dalrymple Road (Main) MOUNT LOUISA QLD 4814 Skipping already saved record CAR18/0166 Skipping already saved record MI16/0012.03 Skipping already saved record CAR18/0168 Skipping already saved record OP14/0138.03 Skipping already saved record OP14/0138.04 Skipping already saved record OP14/0139.03 Skipping already saved record POS18/0064 Saving record POS18/0065 - 33 Conway Street MOUNT LOW QLD 4818

Data

Downloaded 347 times by LoveMyData henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (269 KB) Use the API

rows 10 / 736

id council_reference address description info_url comment_url date_scraped date_received
1
CAR17/0001
5 Piccadilly Street HYDE PARK QLD 4812
Referral Agency Response - Building Act - Raising of Dwelling exceeds Height Restrictions and with the Side boundary Setback
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-04
2
CAR17/0002
6 Paringa Street CRANBROOK QLD 4814
Referral Agency Response - Building Act - Carport within Front Setback
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-05
3
CAR17/0003
48 Palm Street ROWES BAY QLD 4810
Referral Agency Response - Building Act - Extensions to Dwelling within Front and Side Setbacks
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-05
4
OP14/0059.22
26 Capella Entrance BURDELL QLD 4818
SPA Compliance Certificates - Compliance with Conditions - CCTV Stormwater Inspection Sleeves - North Shore Stages 525 and 526
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
5
OP14/0158.10
33 Main Street BURDELL QLD 4818
SPA Compliance Certificates - Compliance with Conditions - Off Maintenance CCTV Stormwater - North Shore Evacuation Centre
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
6
RC13/0114.08
28 Darling Road JENSEN QLD 4818
SPA Compliance Certificates - Compliance with Conditions - Condition 2 - The Orchard Stage 1
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
7
OP16/0105.06
16 Darter Street OONOONBA QLD 4811
SPA Compliance Certificates - Compliance with Conditions - Civil As Constructed Drawings - The Village Stage 12A
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
8
OPW17/0001
101 - 119 Sturt Street TOWNSVILLE CITY QLD 4810
Code Assessable - Intermediate Impact Advertising Devices
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-07
9
POS17/0001
31 Nelson Street SOUTH TOWNSVILLE QLD 4810
Plans of Subdivision - Survey Plan Signing SP296886 associated with RC16/0074
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-07
10
RAL17/0001
50 A Diamond Drive ALICE RIVER QLD 4817
Minor Change to Approval - Generally in Accordance - Change of Front Boundaries to Lots 137-139 - associated with RC14/0050
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-07

Statistics

Average successful run time: 1 minute

Total run time: about 6 hours

Total cpu time used: 3 minutes

Total disk space used: 310 KB

History

  • Auto ran revision 4b05d1ce and completed successfully .
    3 records added, 1 record updated in the database
    43 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    8 records added, 1 record updated in the database
    40 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    5 records added, 1 record updated in the database
    32 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    1 record added, 1 record updated in the database
    27 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    4 records added, 1 record updated in the database
    26 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

townsville / scraper.php