planningalerts-scrapers / townsville

Townsville City Council Development Applications

README.md

City of Townsville Council scraper

  • Server - .NET - XC.Track
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Clearly defined data within a row - Yes
  • Scrape detail page - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Forked from ScraperWiki

Contributors mlandauer daveslutzkin henare hailspuds otherchirps LoveMyData jamezpolley

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting data for `thisweek`, changable via MORPH_PERIOD environment Saving record POS19/0069 - 42 Blackview Avenue BLACK RIVER QLD 4818 Saving record POS19/0070 - 10 - 14 Masuda Street ANNANDALE QLD 4814 Saving record POS19/0071 - 3 Kayak Way KELSO QLD 4815 Saving record OP16/0103.09 - 46 Columbus Street BURDELL QLD 4818 Saving record OP16/0118.12 - 20 Montague Drive BURDELL QLD 4818 Saving record CAR19/0033.02 - 13 Yumba Circuit MOUNT LOUISA QLD 4814 Saving record MCU18/0035.02 - 2 - 30 Lakeside Drive IDALIA QLD 4811 Saving record OP14/0138.07 - 1 Lanford Street BUSHLAND BEACH QLD 4818 Saving record OP14/0139.07 - 1 Lanford Street BUSHLAND BEACH QLD 4818 Saving record OP14/0138.08 - 1 Lanford Street BUSHLAND BEACH QLD 4818

Data

Downloaded 4752 times by slav123 openaustralia LoveMyData DevAppProject jesse-a-reilly cjrh90 TheZepto WilliamYun peteclowes henare MikeRalphson newmana Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.36 MB) Use the API

rows 10 / 5624

date_scraped description info_url date_received council_reference address comment_url
2011-09-11
Request to Extend the Relevant Period associated with R279.2572
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916289
2011-09-09
RC11/0015.02
82 Dunlop Street KELSO QLD 4815
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Request Approval to Allow Construction in 2 Stages associated with R279.2572
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916285
2011-09-02
RC11/0015.01
82 Dunlop Street KELSO QLD 4815
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House - Steep slopes Overlay and height Variation
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913997
2011-09-01
MC11/0071
29 Braemar Crescent CASTLE HILL QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House (Lot 1 RP 745347 Lease LZ No. 9)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913867
2011-09-01
MI11/0049
7 - 9 Rae Crescent (Private) Cleveland Palms NOME QLD 4816
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House - Steep Lands Overlay
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=912722
2011-08-30
MC11/0069
348 Stanley Street NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Side Retaining Wall
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=914149
2011-09-02
OP11/0098
12 Clifton Street NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Congregational Mixed-Use Facility ancillary to existing Educational Establishment and demolition of Four (4) site buildings including a building listed on the Local Heritage Database
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=912813
2011-08-30
MC11/0070
45 The Strand NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
North Shore Precinct 5 - Operational Works (Sewage Pump Station BU05 Rising Main and Gravity Sewer and Acid Sulphate Soils Test) associated with RC10/0189)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913324
2011-08-30
OP11/0095
0 North Shore Boulevard BURDELL QLD 4818
mailto:eplanning@townsville.qld.gov.au
2011-09-11
North Shore Stage 520 - Operational Works associated with RC10/0189 (23 lots)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=914997
2011-09-05
OP11/0099
0 North Shore Boulevard BURDELL QLD 4818
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Vacuum Truck Waste Composting and Soil Conditioning Manufacturing
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916532
2011-09-09
MC11/0073
111 Shaw Road SHAW QLD 4818
mailto:eplanning@townsville.qld.gov.au

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.36 MB) Use the API

rows 10 / 3157

id name value_blob type
1
RC12/0052.04
RC12/0052.04
string
2
MC08/0299.11
MC08/0299.11
string
3
MI11/0046.03
MI11/0046.03
string
4
MI08/0077.06
MI08/0077.06
string
5
MC13/0020.01
MC13/0020.01
string
6
RC13/0046.02
RC13/0046.02
string
7
RC12/0010.10
RC12/0010.10
string
8
OP12/0113.11
OP12/0113.11
string
9
OP12/0109.09
OP12/0109.09
string
10
OP12/0104.23
OP12/0104.23
string

Statistics

Average successful run time: half a minute

Total run time: 2 days

Total cpu time used: 9 minutes

Total disk space used: 2.41 MB

History

  • Auto ran revision d9dabe9a and completed successfully .
    10 records added, 9 records removed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    9 records added, 6 records removed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    6 records added, 5 records removed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    5 records added, 3 records removed in the database
  • Auto ran revision d9dabe9a and completed successfully .
    3 records added in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

PHP

townsville / scraper.php