LoveMyData / townsville

Townsville City Council Development Applications

Scrapes eplanning.townsville.qld.gov.au

eplanning @ Townsville


City of Townsville Council scraper

  • Server - .NET - XC.Track
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Clearly defined data within a row - Yes
  • Scrape detail page - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors LoveMyData otherchirps henare daveslutzkin mlandauer hailspuds

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected -----> Bootstrapping... -----> Installing platform packages...  NOTICE: No runtime required in composer.json; requirements  from dependencies in composer.lock will be used for selection  - php (7.2.12)  - ext-gd (bundled with php)  - ext-mbstring (bundled with php)  - ext-pdo_sqlite (bundled with php)  - ext-sqlite3 (bundled with php)  - nginx (1.8.1)  - apache (2.4.37) -----> Installing dependencies...  Composer version 1.5.2 2017-09-11 16:59:25  Loading composer repositories with package information  Installing dependencies from lock file  Package operations: 5 installs, 0 updates, 0 removals  - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (100%)   - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)   - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (100%)   - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253  - Installing sunra/php-simple-html-dom-parser (v1.5.2): Downloading (connecting...)Downloading (100%)   Generating optimized autoload files -----> Preparing runtime environment... -----> Checking for additional extensions to install...  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting data for `thismonth`, changable via MORPH_PERIOD environment Skipping already saved record CAR18/0261 Skipping already saved record POS18/0099 Skipping already saved record RAL18/0098 Skipping already saved record RAL18/0099 Skipping already saved record OP16/0115.10 Skipping already saved record CAR18/0263 Skipping already saved record MCU18/0035.01 Skipping already saved record MCU18/0115 Skipping already saved record OPW18/0114 Skipping already saved record RAL18/0100 Skipping already saved record RAL18/0101 Skipping already saved record CAR18/0262 Skipping already saved record CAR18/0264 Skipping already saved record CAR18/0265 Skipping already saved record CAR18/0267 Skipping already saved record MC13/0172.07 Skipping already saved record CAR18/0268 Skipping already saved record CAR18/0269 Skipping already saved record RAL18/0073.02 Skipping already saved record MCU18/0116 Skipping already saved record OP16/0037.01 Skipping already saved record POS18/0100 Skipping already saved record POS18/0101 Skipping already saved record POS18/0102 Skipping already saved record POS18/0103 Skipping already saved record OP16/0093.03 Skipping already saved record POS18/0107 Skipping already saved record OP16/0115.11

Data

Downloaded 462 times by LoveMyData henare

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (360 KB) Use the API

rows 10 / 993

id council_reference address description info_url comment_url date_scraped date_received
1
CAR17/0001
5 Piccadilly Street HYDE PARK QLD 4812
Referral Agency Response - Building Act - Raising of Dwelling exceeds Height Restrictions and with the Side boundary Setback
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-04
2
CAR17/0002
6 Paringa Street CRANBROOK QLD 4814
Referral Agency Response - Building Act - Carport within Front Setback
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-05
3
CAR17/0003
48 Palm Street ROWES BAY QLD 4810
Referral Agency Response - Building Act - Extensions to Dwelling within Front and Side Setbacks
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-05
4
OP14/0059.22
26 Capella Entrance BURDELL QLD 4818
SPA Compliance Certificates - Compliance with Conditions - CCTV Stormwater Inspection Sleeves - North Shore Stages 525 and 526
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
5
OP14/0158.10
33 Main Street BURDELL QLD 4818
SPA Compliance Certificates - Compliance with Conditions - Off Maintenance CCTV Stormwater - North Shore Evacuation Centre
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
6
RC13/0114.08
28 Darling Road JENSEN QLD 4818
SPA Compliance Certificates - Compliance with Conditions - Condition 2 - The Orchard Stage 1
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
7
OP16/0105.06
16 Darter Street OONOONBA QLD 4811
SPA Compliance Certificates - Compliance with Conditions - Civil As Constructed Drawings - The Village Stage 12A
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-06
8
OPW17/0001
101 - 119 Sturt Street TOWNSVILLE CITY QLD 4810
Code Assessable - Intermediate Impact Advertising Devices
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-07
9
POS17/0001
31 Nelson Street SOUTH TOWNSVILLE QLD 4810
Plans of Subdivision - Survey Plan Signing SP296886 associated with RC16/0074
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-07
10
RAL17/0001
50 A Diamond Drive ALICE RIVER QLD 4817
Minor Change to Approval - Generally in Accordance - Change of Front Boundaries to Lots 137-139 - associated with RC14/0050
mailto:eplanning@townsville.qld.gov.au
2017-07-21
2017-07-07

Statistics

Average successful run time: 1 minute

Total run time: about 9 hours

Total cpu time used: 4 minutes

Total disk space used: 401 KB

History

  • Auto ran revision 4b05d1ce and completed successfully .
    nothing changed in the database
    29 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    nothing changed in the database
    29 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    3 records added, 1 record updated in the database
    29 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    9 records added, 1 record updated in the database
    26 pages scraped
  • Auto ran revision 4b05d1ce and completed successfully .
    1 record added, 1 record updated in the database
    17 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

townsville / scraper.php