LoveMyData / townsville

Townsville City Council Development Applications

Scrapes eplanning.townsville.qld.gov.au

eplanning @ Townsville


City of Townsville Council scraper

  • Server - .NET - XC.Track
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Clearly defined data within a row - Yes
  • Scrape detail page - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData otherchirps henare daveslutzkin mlandauer hailspuds

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.10)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.34) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 5 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (100%)   - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)   - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (100%)   - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  - Installing sunra/php-simple-html-dom-parser (v1.5.2): Downloading (connecting...)Downloading (100%)   Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data for `thismonth`, changable via MORPH_PERIOD environment Skipping already saved record CAR18/0206 Skipping already saved record MCU17/0029.03 Skipping already saved record MI11/0059.13 Skipping already saved record POS18/0075 Skipping already saved record POS18/0076 Skipping already saved record RAL18/0079 Skipping already saved record RAL18/0080 Skipping already saved record OP16/0097.14 Skipping already saved record CAR18/0208 Skipping already saved record MCU18/0097 Skipping already saved record OP16/0117.10 Skipping already saved record OP16/0117.11 Skipping already saved record CAR18/0207 Skipping already saved record CAR18/0209 Skipping already saved record OPW18/0095 Skipping already saved record RAL18/0081 Skipping already saved record RAL18/0082 Skipping already saved record CAR18/0210 Skipping already saved record OP15/0092.14 Skipping already saved record OPW18/0096 Skipping already saved record DBW18/0016 Skipping already saved record POS18/0078 Skipping already saved record RAL18/0083 Skipping already saved record MI16/0023.02 Skipping already saved record OPW18/0097 Skipping already saved record CAR18/0213 Skipping already saved record RAL18/0073.01 Skipping already saved record RAL18/0084 Skipping already saved record MCU18/0098 Skipping already saved record POS18/0079 Skipping already saved record POS18/0080 Skipping already saved record CAR18/0214 Skipping already saved record CAR18/0215 Skipping already saved record CAR18/0216 Skipping already saved record DBW18/0017 Skipping already saved record MCU18/0099 Skipping already saved record CAR18/0219 Skipping already saved record CAR18/0220 Skipping already saved record POS18/0081 Skipping already saved record POS18/0082 Skipping already saved record MCU18/0070.01 Skipping already saved record POS18/0083 Skipping already saved record OP16/0110.35

Data

Downloaded 405 times by LoveMyData henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (320 KB) Use the API

rows 10 / 878

id council_reference address description info_url comment_url date_scraped date_received
1
CAR17/0001
5 Piccadilly Street HYDE PARK QLD 4812
Referral Agency Response - Building Act - Raising of Dwelling exceeds Height Restrictions and with the Side boundary Setback
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-04
2
CAR17/0002
6 Paringa Street CRANBROOK QLD 4814
Referral Agency Response - Building Act - Carport within Front Setback
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-05
3
CAR17/0003
48 Palm Street ROWES BAY QLD 4810
Referral Agency Response - Building Act - Extensions to Dwelling within Front and Side Setbacks
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-05
4
OP14/0059.22
26 Capella Entrance BURDELL QLD 4818
SPA Compliance Certificates - Compliance with Conditions - CCTV Stormwater Inspection Sleeves - North Shore Stages 525 and 526
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
5
OP14/0158.10
33 Main Street BURDELL QLD 4818
SPA Compliance Certificates - Compliance with Conditions - Off Maintenance CCTV Stormwater - North Shore Evacuation Centre
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
6
RC13/0114.08
28 Darling Road JENSEN QLD 4818
SPA Compliance Certificates - Compliance with Conditions - Condition 2 - The Orchard Stage 1
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
7
OP16/0105.06
16 Darter Street OONOONBA QLD 4811
SPA Compliance Certificates - Compliance with Conditions - Civil As Constructed Drawings - The Village Stage 12A
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
8
OPW17/0001
101 - 119 Sturt Street TOWNSVILLE CITY QLD 4810
Code Assessable - Intermediate Impact Advertising Devices
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-07
9
POS17/0001
31 Nelson Street SOUTH TOWNSVILLE QLD 4810
Plans of Subdivision - Survey Plan Signing SP296886 associated with RC16/0074
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-07
10
RAL17/0001
50 A Diamond Drive ALICE RIVER QLD 4817
Minor Change to Approval - Generally in Accordance - Change of Front Boundaries to Lots 137-139 - associated with RC14/0050
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-07

Statistics

Average successful run time: 1 minute

Total run time: about 8 hours

Total cpu time used: 4 minutes

Total disk space used: 361 KB

History

  • Auto ran revision 4b05d1ce and completed successfully .
    nothing changed in the database
    44 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    5 records added, 1 record updated in the database
    44 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    3 records added, 1 record updated in the database
    39 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    2 records added, 1 record updated in the database
    36 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    5 records added, 1 record updated in the database
    34 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

townsville / scraper.php