planningalerts-scrapers / townsville

Townsville City Council Development Applications


City of Townsville Council scraper

  • Server - .NET - XC.Track
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Clearly defined data within a row - Yes
  • Scrape detail page - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors mlandauer daveslutzkin henare hailspuds otherchirps LoveMyData jamezpolley

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data for `thisweek`, changable via MORPH_PERIOD environment PHP Deprecated: Array and string offset access syntax with curly braces is deprecated in /app/vendor/electrolinux/phpquery/phpQuery/phpQuery/phpQueryObject.php on line 1040 PHP Deprecated: Array and string offset access syntax with curly braces is deprecated in /app/vendor/electrolinux/phpquery/phpQuery/phpQuery/phpQueryObject.php on line 1055 Saving record CAR24/0104 - 2 Wakeboard Circuit KELSO QLD 4815 Saving record CAR24/0105 - 15 Langley Place KIRWAN QLD 4817 Saving record CAR24/0112 - 29 Malabar Street CONDON QLD 4815

Data

Downloaded 10609 times by slav123 openaustralia dcalde mlandauer LoveMyData jesse-a-reilly DevAppProject TheZepto cjrh90 WilliamYun dandanaus henare odnagroup peteclowes MikeRalphson newmana Jedwards157 TRAVISSTR michaeltaylorgit

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.76 MB) Use the API

rows 10 / 6644

date_scraped description info_url date_received council_reference address comment_url
2011-09-11
Request to Extend the Relevant Period associated with R279.2572
2011-09-09
RC11/0015.02
82 Dunlop Street KELSO QLD 4815
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Request Approval to Allow Construction in 2 Stages associated with R279.2572
2011-09-02
RC11/0015.01
82 Dunlop Street KELSO QLD 4815
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House - Steep slopes Overlay and height Variation
2011-09-01
MC11/0071
29 Braemar Crescent CASTLE HILL QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House (Lot 1 RP 745347 Lease LZ No. 9)
2011-09-01
MI11/0049
7 - 9 Rae Crescent (Private) Cleveland Palms NOME QLD 4816
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House - Steep Lands Overlay
2011-08-30
MC11/0069
348 Stanley Street NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Side Retaining Wall
2011-09-02
OP11/0098
12 Clifton Street NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Congregational Mixed-Use Facility ancillary to existing Educational Establishment and demolition of Four (4) site buildings including a building listed on the Local Heritage Database
2011-08-30
MC11/0070
45 The Strand NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
North Shore Precinct 5 - Operational Works (Sewage Pump Station BU05 Rising Main and Gravity Sewer and Acid Sulphate Soils Test) associated with RC10/0189)
2011-08-30
OP11/0095
0 North Shore Boulevard BURDELL QLD 4818
mailto:eplanning@townsville.qld.gov.au
2011-09-11
North Shore Stage 520 - Operational Works associated with RC10/0189 (23 lots)
2011-09-05
OP11/0099
0 North Shore Boulevard BURDELL QLD 4818
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Vacuum Truck Waste Composting and Soil Conditioning Manufacturing
2011-09-09
MC11/0073
111 Shaw Road SHAW QLD 4818
mailto:eplanning@townsville.qld.gov.au

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.76 MB) Use the API

rows 10 / 3157

id name value_blob type
1
RC12/0052.04
RC12/0052.04
string
2
MC08/0299.11
MC08/0299.11
string
3
MI11/0046.03
MI11/0046.03
string
4
MI08/0077.06
MI08/0077.06
string
5
MC13/0020.01
MC13/0020.01
string
6
RC13/0046.02
RC13/0046.02
string
7
RC12/0010.10
RC12/0010.10
string
8
OP12/0113.11
OP12/0113.11
string
9
OP12/0109.09
OP12/0109.09
string
10
OP12/0104.23
OP12/0104.23
string

Statistics

Average successful run time: half a minute

Total run time: 2 days

Total cpu time used: 19 minutes

Total disk space used: 2.82 MB

History

  • Auto ran revision d9dabe9a and completed successfully .
    3 records added, 3 records removed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    3 records added, 2 records removed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    2 records added, 1 record removed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    1 record added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

townsville / scraper.php