planningalerts-scrapers / townsville

Townsville City Council Development Applications

README.md

City of Townsville Council scraper

  • Server - .NET - XC.Track
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Clearly defined data within a row - Yes
  • Scrape detail page - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Forked from ScraperWiki

Contributors mlandauer daveslutzkin henare hailspuds otherchirps LoveMyData jamezpolley

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data for `thisweek`, changable via MORPH_PERIOD environment Saving record CAR20/0016 - 206 Howlett Street CURRAJONG QLD 4812

Data

Downloaded 5120 times by slav123 openaustralia LoveMyData DevAppProject jesse-a-reilly TheZepto cjrh90 WilliamYun henare peteclowes newmana Jedwards157 MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.4 MB) Use the API

rows 10 / 5728

date_scraped description info_url date_received council_reference address comment_url
2011-09-11
Request to Extend the Relevant Period associated with R279.2572
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916289
2011-09-09
RC11/0015.02
82 Dunlop Street KELSO QLD 4815
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Request Approval to Allow Construction in 2 Stages associated with R279.2572
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916285
2011-09-02
RC11/0015.01
82 Dunlop Street KELSO QLD 4815
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House - Steep slopes Overlay and height Variation
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913997
2011-09-01
MC11/0071
29 Braemar Crescent CASTLE HILL QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House (Lot 1 RP 745347 Lease LZ No. 9)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913867
2011-09-01
MI11/0049
7 - 9 Rae Crescent (Private) Cleveland Palms NOME QLD 4816
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House - Steep Lands Overlay
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=912722
2011-08-30
MC11/0069
348 Stanley Street NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Side Retaining Wall
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=914149
2011-09-02
OP11/0098
12 Clifton Street NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Congregational Mixed-Use Facility ancillary to existing Educational Establishment and demolition of Four (4) site buildings including a building listed on the Local Heritage Database
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=912813
2011-08-30
MC11/0070
45 The Strand NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
North Shore Precinct 5 - Operational Works (Sewage Pump Station BU05 Rising Main and Gravity Sewer and Acid Sulphate Soils Test) associated with RC10/0189)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913324
2011-08-30
OP11/0095
0 North Shore Boulevard BURDELL QLD 4818
mailto:eplanning@townsville.qld.gov.au
2011-09-11
North Shore Stage 520 - Operational Works associated with RC10/0189 (23 lots)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=914997
2011-09-05
OP11/0099
0 North Shore Boulevard BURDELL QLD 4818
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Vacuum Truck Waste Composting and Soil Conditioning Manufacturing
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916532
2011-09-09
MC11/0073
111 Shaw Road SHAW QLD 4818
mailto:eplanning@townsville.qld.gov.au

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.4 MB) Use the API

rows 10 / 3157

id name value_blob type
1
RC12/0052.04
RC12/0052.04
string
2
MC08/0299.11
MC08/0299.11
string
3
MI11/0046.03
MI11/0046.03
string
4
MI08/0077.06
MI08/0077.06
string
5
MC13/0020.01
MC13/0020.01
string
6
RC13/0046.02
RC13/0046.02
string
7
RC12/0010.10
RC12/0010.10
string
8
OP12/0113.11
OP12/0113.11
string
9
OP12/0109.09
OP12/0109.09
string
10
OP12/0104.23
OP12/0104.23
string

Statistics

Average successful run time: half a minute

Total run time: 2 days

Total cpu time used: 10 minutes

Total disk space used: 2.45 MB

History

  • Auto ran revision d9dabe9a and completed successfully .
    1 record added in the database
  • Auto ran revision d9dabe9a and completed successfully .
    nothing changed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    nothing changed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    nothing changed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    nothing changed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

PHP

townsville / scraper.php