planningalerts-scrapers / townsville
Townsville City Council Development Applications
Scrapes eplanning.townsville.qld.gov.au
eplanning @ Townsville
City of Townsville Council scraper
- Server - .NET - XC.Track
- Cookie tracking - No
- Pagnation - Yes
- Javascript - No
- Clearly defined data within a row - Yes
- Scrape detail page - Yes
Setup MORPH_PERIOD for data recovery, available options are
- thisweek (default)
- thismonth
- lastmonth
Enjoy
Forked from ScraperWiki
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> PHP app detected
[1G-----> Bootstrapping...
[1G-----> Installing platform packages...
[1G NOTICE: No runtime required in composer.json; requirements
[1G from dependencies in composer.lock will be used for selection
[1G - php (7.2.7)
[1G - ext-gd (bundled with php)
[1G - ext-mbstring (bundled with php)
[1G - ext-pdo_sqlite (bundled with php)
[1G - ext-sqlite3 (bundled with php)
[1G - nginx (1.8.1)
[1G - apache (2.4.33)
[1G-----> Installing dependencies...
[1G Composer version 1.5.2 2017-09-11 16:59:25
[1G Loading composer repositories with package information
[1G Installing dependencies from lock file
[1G Package operations: 5 installs, 0 updates, 0 removals
[1G - Installing pguardiario/phpuri (1.0): Downloading (connecting...)Downloading (0%) Downloading (100%)
[1G - Installing electrolinux/phpquery (0.9.6): Downloading (connecting...)Downloading (100%)
[1G - Installing byjg/pgbrowser (1.0.0): Downloading (connecting...)Downloading (0%) Downloading (65%)Downloading (100%)
[1G - Installing openaustralia/scraperwiki (dev-morph_defaults e996fe0): Cloning e996fe0253
[1G - Installing sunra/php-simple-html-dom-parser (v1.5.2): Downloading (connecting...)Downloading (100%)
[1G Generating optimized autoload files
[1G-----> Preparing runtime environment...
[1G-----> Checking for additional extensions to install...
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Getting data for `thisweek`, changable via MORPH_PERIOD environment
Saving record OPW18/0073 - 435 Dalrymple Road (Main) MOUNT LOUISA QLD 4814
Skipping already saved record CAR18/0166
Skipping already saved record MI16/0012.03
Skipping already saved record CAR18/0168
Skipping already saved record OP14/0138.03
Skipping already saved record OP14/0138.04
Skipping already saved record OP14/0139.03
Skipping already saved record POS18/0064
Saving record POS18/0065 - 33 Conway Street MOUNT LOW QLD 4818
Data
Downloaded
3372 times
by
To download data sign in with GitHub
rows 10 / 5385
| date_scraped | description | info_url | date_received | council_reference | address | comment_url |
|---|---|---|---|---|---|---|
|
2011-09-11
|
Request to Extend the Relevant Period associated with R279.2572
|
2011-09-09
|
RC11/0015.02
|
82 Dunlop Street KELSO QLD 4815
|
mailto:eplanning@townsville.qld.gov.au
|
|
|
2011-09-11
|
Request Approval to Allow Construction in 2 Stages associated with R279.2572
|
2011-09-02
|
RC11/0015.01
|
82 Dunlop Street KELSO QLD 4815
|
mailto:eplanning@townsville.qld.gov.au
|
|
|
2011-09-11
|
Detached House - Steep slopes Overlay and height Variation
|
2011-09-01
|
MC11/0071
|
29 Braemar Crescent CASTLE HILL QLD 4810
|
mailto:eplanning@townsville.qld.gov.au
|
|
|
2011-09-11
|
Detached House (Lot 1 RP 745347 Lease LZ No. 9)
|
2011-09-01
|
MI11/0049
|
7 - 9 Rae Crescent (Private) Cleveland Palms NOME QLD 4816
|
mailto:eplanning@townsville.qld.gov.au
|
|
|
2011-09-11
|
Detached House - Steep Lands Overlay
|
2011-08-30
|
MC11/0069
|
348 Stanley Street NORTH WARD QLD 4810
|
mailto:eplanning@townsville.qld.gov.au
|
|
|
2011-09-11
|
Side Retaining Wall
|
2011-09-02
|
OP11/0098
|
12 Clifton Street NORTH WARD QLD 4810
|
mailto:eplanning@townsville.qld.gov.au
|
|
|
2011-09-11
|
Congregational Mixed-Use Facility ancillary to existing Educational Establishment and demolition of Four (4) site buildings including a building listed on the Local Heritage Database
|
2011-08-30
|
MC11/0070
|
45 The Strand NORTH WARD QLD 4810
|
mailto:eplanning@townsville.qld.gov.au
|
|
|
2011-09-11
|
North Shore Precinct 5 - Operational Works (Sewage Pump Station BU05 Rising Main and Gravity Sewer and Acid Sulphate Soils Test) associated with RC10/0189)
|
2011-08-30
|
OP11/0095
|
0 North Shore Boulevard BURDELL QLD 4818
|
mailto:eplanning@townsville.qld.gov.au
|
|
|
2011-09-11
|
North Shore Stage 520 - Operational Works associated with RC10/0189 (23 lots)
|
2011-09-05
|
OP11/0099
|
0 North Shore Boulevard BURDELL QLD 4818
|
mailto:eplanning@townsville.qld.gov.au
|
|
|
2011-09-11
|
Vacuum Truck Waste Composting and Soil Conditioning Manufacturing
|
2011-09-09
|
MC11/0073
|
111 Shaw Road SHAW QLD 4818
|
mailto:eplanning@townsville.qld.gov.au
|
To download data sign in with GitHub
rows 10 / 3157
| id | name | value_blob | type |
|---|---|---|---|
|
1
|
RC12/0052.04
|
RC12/0052.04
|
string
|
|
2
|
MC08/0299.11
|
MC08/0299.11
|
string
|
|
3
|
MI11/0046.03
|
MI11/0046.03
|
string
|
|
4
|
MI08/0077.06
|
MI08/0077.06
|
string
|
|
5
|
MC13/0020.01
|
MC13/0020.01
|
string
|
|
6
|
RC13/0046.02
|
RC13/0046.02
|
string
|
|
7
|
RC12/0010.10
|
RC12/0010.10
|
string
|
|
8
|
OP12/0113.11
|
OP12/0113.11
|
string
|
|
9
|
OP12/0109.09
|
OP12/0109.09
|
string
|
|
10
|
OP12/0104.23
|
OP12/0104.23
|
string
|
Statistics
Average successful run time: half a minute
Total run time: 1 day
Total cpu time used: 7 minutes
Total disk space used: 2.31 MB
History
-
Auto
ran
revision
910673ac
and
completed successfully
.
2 records added in the database10 pages scraped
-
Auto
ran
revision
910673ac
and
completed successfully
.
6 records added in the database8 pages scraped
-
Auto
ran
revision
910673ac
and
completed successfully
.
1 record added in the database2 pages scraped
-
Auto
ran
revision
910673ac
and
completed successfully
.
nothing changed in the database3 pages scraped
-
Auto
ran
revision
910673ac
and
completed successfully
.
nothing changed in the database4 pages scraped
- ...
- Forked from ScraperWiki