planningalerts-scrapers / townsville

Townsville City Council Development Applications

README.md

City of Townsville Council scraper

  • Server - .NET - XC.Track
  • Cookie tracking - No
  • Pagnation - Yes
  • Javascript - No
  • Clearly defined data within a row - Yes
  • Scrape detail page - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth

Enjoy

Forked from ScraperWiki

Contributors mlandauer daveslutzkin henare hailspuds otherchirps LoveMyData jamezpolley

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling...  -----> PHP app detected ----->  -----> Bootstrapping...  -----> Bootstrapping...  ! ERROR:  -----> Bootstrapping...  ! ERROR: Failed to download minimal PHP for bootstrapping! ! ! This is most likely a temporary internal error. If the problem  -----> Bootstrapping...  ! ERROR: Failed to download minimal PHP for bootstrapping! ! ! This is most likely a temporary internal error. If the problem  ! persists, make sure that you are not running a custom or forked ! version of the Heroku PHP buildpack which may need updating.     Removing intermediate container f7b89aac95bf

Data

Downloaded 6809 times by slav123 openaustralia LoveMyData DevAppProject dcalde jesse-a-reilly cjrh90 TheZepto WilliamYun dandanaus henare peteclowes Jedwards157 MikeRalphson newmana

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.62 MB) Use the API

rows 10 / 6262

date_scraped description info_url date_received council_reference address comment_url
2011-09-11
Request to Extend the Relevant Period associated with R279.2572
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916289
2011-09-09
RC11/0015.02
82 Dunlop Street KELSO QLD 4815
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Request Approval to Allow Construction in 2 Stages associated with R279.2572
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916285
2011-09-02
RC11/0015.01
82 Dunlop Street KELSO QLD 4815
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House - Steep slopes Overlay and height Variation
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913997
2011-09-01
MC11/0071
29 Braemar Crescent CASTLE HILL QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House (Lot 1 RP 745347 Lease LZ No. 9)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913867
2011-09-01
MI11/0049
7 - 9 Rae Crescent (Private) Cleveland Palms NOME QLD 4816
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Detached House - Steep Lands Overlay
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=912722
2011-08-30
MC11/0069
348 Stanley Street NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Side Retaining Wall
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=914149
2011-09-02
OP11/0098
12 Clifton Street NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Congregational Mixed-Use Facility ancillary to existing Educational Establishment and demolition of Four (4) site buildings including a building listed on the Local Heritage Database
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=912813
2011-08-30
MC11/0070
45 The Strand NORTH WARD QLD 4810
mailto:eplanning@townsville.qld.gov.au
2011-09-11
North Shore Precinct 5 - Operational Works (Sewage Pump Station BU05 Rising Main and Gravity Sewer and Acid Sulphate Soils Test) associated with RC10/0189)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=913324
2011-08-30
OP11/0095
0 North Shore Boulevard BURDELL QLD 4818
mailto:eplanning@townsville.qld.gov.au
2011-09-11
North Shore Stage 520 - Operational Works associated with RC10/0189 (23 lots)
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=914997
2011-09-05
OP11/0099
0 North Shore Boulevard BURDELL QLD 4818
mailto:eplanning@townsville.qld.gov.au
2011-09-11
Vacuum Truck Waste Composting and Soil Conditioning Manufacturing
http://wokim.townsville.qld.gov.au/Pages/XC.Track/SearchApplication.aspx?id=916532
2011-09-09
MC11/0073
111 Shaw Road SHAW QLD 4818
mailto:eplanning@townsville.qld.gov.au

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.62 MB) Use the API

rows 10 / 3157

id name value_blob type
1
RC12/0052.04
RC12/0052.04
string
2
MC08/0299.11
MC08/0299.11
string
3
MI11/0046.03
MI11/0046.03
string
4
MI08/0077.06
MI08/0077.06
string
5
MC13/0020.01
MC13/0020.01
string
6
RC13/0046.02
RC13/0046.02
string
7
RC12/0010.10
RC12/0010.10
string
8
OP12/0113.11
OP12/0113.11
string
9
OP12/0109.09
OP12/0109.09
string
10
OP12/0104.23
OP12/0104.23
string

Statistics

Average successful run time: half a minute

Total run time: 2 days

Total cpu time used: 14 minutes

Total disk space used: 2.66 MB

History

  • Auto ran revision d9dabe9a and failed .
    nothing changed in the database
  • Auto ran revision d9dabe9a and failed .
    nothing changed in the database
  • Auto ran revision d9dabe9a and failed .
    nothing changed in the database
  • Auto ran revision d9dabe9a and failed .
    nothing changed in the database
  • Auto ran revision d9dabe9a and failed .
    nothing changed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

PHP

townsville / scraper.php