planningalerts-scrapers / townsville

Townsville City Council Development Applications

README.md

City of Townsville Council scraper

  • Server - .NET - XC.Track
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Clearly defined data within a row - Yes
  • Scrape detail page - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Contributors mlandauer daveslutzkin henare hailspuds otherchirps LoveMyData jamezpolley ianheggie-oaf

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data for `thisweek`, changable via MORPH_PERIOD environment PHP Deprecated: Array and string offset access syntax with curly braces is deprecated in /app/vendor/electrolinux/phpquery/phpQuery/phpQuery/phpQueryObject.php on line 1040 PHP Deprecated: Array and string offset access syntax with curly braces is deprecated in /app/vendor/electrolinux/phpquery/phpQuery/phpQuery/phpQueryObject.php on line 1055 Saving record MCU25/0032 - 55 Lynam Road GUMLOW QLD 4815 Saving record RAL25/0048 - 36 Camp Street MUNDINGBURRA QLD 4812 Saving record CAR25/0363 - 4 Perrin Court ANNANDALE QLD 4814 Saving record CAR25/0365 - 19 Kelly Street MUNDINGBURRA QLD 4812

Data

Downloaded 12028 times by slav123 openaustralia dcalde mlandauer LoveMyData jesse-a-reilly DevAppProject repose-lecture TheZepto cjrh90 WilliamYun dandanaus henare odnagroup peteclowes MikeRalphson newmana Jedwards157 TRAVISSTR michaeltaylorgit

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.81 MB) Use the API

rows 10 / 6767

date_scraped description info_url date_received council_reference address comment_url
2011-09-11
Request to Extend the Relevant Period associated with R279.2572
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916289
2011-09-09
RC11/0015.02
82 Dunlop Street KELSO QLD 4815
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Request Approval to Allow Construction in 2 Stages associated with R279.2572
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916285
2011-09-02
RC11/0015.01
82 Dunlop Street KELSO QLD 4815
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House - Steep slopes Overlay and height Variation
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913997
2011-09-01
MC11/0071
29 Braemar Crescent CASTLE HILL QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House (Lot 1 RP 745347 Lease LZ No. 9)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913867
2011-09-01
MI11/0049
7 - 9 Rae Crescent (Private) Cleveland Palms NOME QLD 4816
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House - Steep Lands Overlay
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=912722
2011-08-30
MC11/0069
348 Stanley Street NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Side Retaining Wall
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=914149
2011-09-02
OP11/0098
12 Clifton Street NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Congregational Mixed-Use Facility ancillary to existing Educational Establishment and demolition of Four (4) site buildings including a building listed on the Local Heritage Database
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=912813
2011-08-30
MC11/0070
45 The Strand NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
North Shore Precinct 5 - Operational Works (Sewage Pump Station BU05 Rising Main and Gravity Sewer and Acid Sulphate Soils Test) associated with RC10/0189)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913324
2011-08-30
OP11/0095
0 North Shore Boulevard BURDELL QLD 4818
mailto:eplanning@townsville.qld.gov.au
2011-09-11
North Shore Stage 520 - Operational Works associated with RC10/0189 (23 lots)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=914997
2011-09-05
OP11/0099
0 North Shore Boulevard BURDELL QLD 4818
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Vacuum Truck Waste Composting and Soil Conditioning Manufacturing
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916532
2011-09-09
MC11/0073
111 Shaw Road SHAW QLD 4818
mailto:eplanning@townsville.qld.gov.au

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.81 MB) Use the API

rows 10 / 3157

id name value_blob type
1
RC12/0052.04
RC12/0052.04
string
2
MC08/0299.11
MC08/0299.11
string
3
MI11/0046.03
MI11/0046.03
string
4
MI08/0077.06
MI08/0077.06
string
5
MC13/0020.01
MC13/0020.01
string
6
RC13/0046.02
RC13/0046.02
string
7
RC12/0010.10
RC12/0010.10
string
8
OP12/0113.11
OP12/0113.11
string
9
OP12/0109.09
OP12/0109.09
string
10
OP12/0104.23
OP12/0104.23
string

Statistics

Average successful run time: half a minute

Total run time: 2 days

Total cpu time used: 21 minutes

Total disk space used: 2.88 MB

History

  • Auto ran revision ce752361 and completed successfully .
    4 records added, 3 records removed in the database
  • Auto ran revision ce752361 and completed successfully .
    3 records added, 1 record removed in the database
  • Auto ran revision ce752361 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision ce752361 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision ce752361 and completed successfully .
    1 record added, 1 record removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

PHP

townsville / scraper.php