planningalerts-scrapers / sunshine_coast
Sunshine Coast Council Development Applications
Sunshine coast council scraper
This site is a typical .NET site involves the followings.
- Cookie - No
- JSON - Yes
- Structured HTML - No (especially address is a nightmare)
Setup MORPH_PERIOD for data recovery, available options are
- thisweek (default, last 14 days)
- thismonth
- lastmonth
Enjoy
Forked from ScraperWiki
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Ruby app detected
[1G-----> Compiling Ruby
[1G-----> Using Ruby version: ruby-2.5.3
[1G-----> Installing dependencies using bundler version 1.15.2
[1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment
[1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.
[1G Fetching gem metadata from https://rubygems.org/........
[1G Fetching version metadata from https://rubygems.org/.
[1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git
[1G Using bundler 1.15.2
[1G Fetching connection_pool 2.2.2
[1G Fetching unf_ext 0.0.7.5
[1G Fetching httpclient 2.8.3
[1G Installing connection_pool 2.2.2
[1G Installing httpclient 2.8.3
[1G Installing unf_ext 0.0.7.5 with native extensions
[1G Fetching json 2.2.0
[1G Installing json 2.2.0 with native extensions
[1G Fetching mime-types-data 3.2018.0812
[1G Installing mime-types-data 3.2018.0812
[1G Fetching net-http-digest_auth 1.4.1
[1G Installing net-http-digest_auth 1.4.1
[1G Fetching mini_portile2 2.4.0
[1G Installing mini_portile2 2.4.0
[1G Fetching ntlm-http 0.1.1
[1G Installing ntlm-http 0.1.1
[1G Fetching webrobots 0.1.2
[1G Installing webrobots 0.1.2
[1G Fetching sqlite3 1.4.0
[1G Installing sqlite3 1.4.0 with native extensions
[1G Fetching net-http-persistent 3.0.0
[1G Installing net-http-persistent 3.0.0
[1G Fetching mime-types 3.2.2
[1G Installing mime-types 3.2.2
[1G Fetching nokogiri 1.10.1
[1G Installing nokogiri 1.10.1 with native extensions
[1G Fetching unf 0.1.4
[1G Installing unf 0.1.4
[1G Fetching sqlite_magic 0.0.6
[1G Installing sqlite_magic 0.0.6
[1G Fetching domain_name 0.5.20180417
[1G Installing domain_name 0.5.20180417
[1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)
[1G Fetching http-cookie 1.0.3
[1G Installing http-cookie 1.0.3
[1G Fetching mechanize 2.7.6
[1G Installing mechanize 2.7.6
[1G Bundle complete! 3 Gemfile dependencies, 20 gems now installed.
[1G Gems in the groups development and test were not installed.
[1G Bundled gems are installed into ./vendor/bundle.
[1G Bundle completed (28.75s)
[1G Cleaning up the bundler cache.
[1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.
[1G-----> Detecting rake tasks
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Getting 'Last 14 Days' data, changable via MORPH_PERIOD environment
Saving record RAL19/0061, 11-13, 15-17 Ocean St, 39-41 Duporth Ave MAROOCHYDORE
Saving record RAL19/0060, 34 Gloucester Rd BUDERIM
Saving record RAL18/0012.08, 20 Kelman St PALMVIEW
Saving record OPW19/0308, 31 Sippy Downs Drive SIPPY DOWNS
Saving record OPW19/0307, 1972 Old Gympie Road GLASS HOUSE MOUNTAINS
Saving record OPW19/0306, 35 Jenyor Street COOLUM BEACH
Saving record OPW19/0305, 84 Botanica Circuit DOONAN
Saving record MCU19/0136, 11-13, 15-17 Ocean St, 39-41 Duporth Ave MAROOCHYDORE
Saving record MCU19/0135, 26 and 28 McIlwraith Ave MOFFAT BEACH
Saving record MCU14/0046.01, 288-316 Yandina-Coolum Rd COOLUM BEACH
Saving record POS19/0131, 177 Ninderry Road Ninderry
Saving record REC16/0049.02, Preliminary Approval for Reconfiguration of a Lot
Saving record POS19/0133, 27 Oomoo Street Buddina
Saving record POS19/0132, 33 & 35 Saltair Street Kings Beach
Saving record OPW19/0313, 31 Kowree Cres MAROOCHYDORE
Saving record OPW19/0310, 4 Jessica Blvd MINYAMA
Saving record OPW19/0309, Bokarina Beach Stages EMW3B & EMW4B
Saving record OPW18/0189.02, 20 Beach Road MAROOCHYDORE
Saving record MCU19/0140, 31 Kowree Cres MAROOCHYDORE
Saving record MCU19/0138, 90 Lake Vista Dr PEREGIAN BEACH
Saving record MCU19/0137, 12 Sandalwood Lane FOREST GLEN
Saving record MCU17/2177.01, 89 Sinclairs Lane BALMORAL RIDGE
Saving record OPW19/0317, 354 Mons Rd FOREST GLEN
Saving record OPW19/0315, 106 Parker Street MAROOCHYDORE
Saving record OPW19/0314, 31 Adaluma Ave BUDDINA
Saving record OPW19/0312, 5 Patrick King Drive BURNSIDE
Saving record OPW19/0311, Stringybark Road and Central Drive SIPPY DOWNS
Saving record MCU19/0141, 354, 370 Mons Rd FOREST GLEN
Saving record MCU19/0139, 19 Lakehead Drive SIPPY DOWNS
Saving record MCU17/0132.03, Glasshouse Country Christian College 58 Roberts Rd BEERWAH
Saving record RAL19/0063, Sunshine Cove Way MAROOCHYDORE
Saving record POS19/0136, 20 Swan Street Beerwah
Saving record POS18/0184, 15 Horizon Way Woombye
Saving record OPW19/0316, 18A Quambi Pl BUDERIM
Saving record MCU19/0143, Sunshine Cove Way MAROOCHYDORE
Saving record MCU19/0011, 26 Cook Rd BLI BLI
Saving record MCU16/0069.03, Main Dr WARANA
Saving record POS19/0119, 211 Parklands Boulevard Little Mountain
Saving record REC07/0016.18, 21/66 The Avenue PEREGIAN SPRINGS
Saving record RAL19/0064, 8 Blanck St MAROOCHYDORE
Saving record OPW19/0322, 54-64 Fred Chaplin Circuit BELLS CREEK
Saving record OPW19/0321, 8 Blanck St MAROOCHYDORE
Saving record OPW19/0320, 52 Henebery Road BURNSIDE
Saving record OPW19/0319, 31A Meadow Court Doonan
Saving record OPW19/0318, 33 and 35 Broadwater Avenue MAROOCHYDORE
Saving record OPW18/0243.03, Duke Road DOONAN
Saving record MCU15/0110.03, 11 Seaview Tce BUDERIM
Saving record POS19/0130, 53 Cedar Creek Road, 25-75 Stephenson Lane and 92 Naranga Road Belli Park
Saving record OPW19/0326, Qccc Mapleton 70 Obi Obi Road MAPLETON
Saving record OPW19/0325, 30 Saltair Street KINGS BEACH
Saving record OPW19/0324, 9/67 Buna Street MAROOCHYDORE
Saving record OPW19/0323, 60 Junction Dr COOLUM BEACH
Saving record POS19/0138, Park Avenue Residences Stage 8
Saving record REC14/0052.27, 40 Mackenzie Dr MAROOCHYDORE
Saving record RAL19/0065, 13 -15 Railway St YANDINA
Saving record OPW19/0332, 56 Tepequar Dr MAROOCHYDORE
Saving record OPW19/0327, 60 Marina View Dr PELICAN WATERS
Saving record MCU19/0145, 33 Fauna Tce COOLUM BEACH
Saving record MCU19/0144, 36 and 38 Landsborough Pde Golden Beach
Saving record MCU19/0031.01, 3 Kelly Ct LANDSBOROUGH
error to parse council_reference's address: ToAdviseMCU01
Saving record RAL19/0068, FAST TRACK 16 Dulin St MAROOCHYDORE
Saving record RAL19/0067, FAST TRACK 1219 and 1221 Steve Irwin Way BEERWAH
Saving record RAL19/0066, Lot 9011 Tranquility Way PALMVIEW
Saving record RAL17/2058.02, Tranquility Way PALMVIEW
Saving record OPW19/0331, 1 Mungar St MAROOCHYDORE
Saving record OPW19/0330, 49 Crosby Hill Rd BUDERIM
Saving record OPW19/0329, Lot 9011 Tranquility Way PALMVIEW
Saving record OPW19/0328, 10 Ann St NAMBOUR
Saving record MPC19/0010, Lake Kawana Blvd BIRTINYA
Saving record MCU19/0146, 22 Wyanda Dve BOKARINA
Saving record MCU12/0214.04, 336 Tanawha Tourist Dr TANAWHA
Saving record MCU10/2126.02, 35 & 37 Bowman Rd CALOUNDRA
Saving record OPW19/0335, 14 Beattie St GOLDEN BEACH
Saving record OPW19/0334, 77 Karnu Dr VALDORA
Saving record OPW19/0333, 693 Obi Obi Rd OBI OBI
Saving record 2001/510033.01, 30/2 Grand Pde PARREARRA
Data
Downloaded
5329 times
by
To download data sign in with GitHub
rows 10 / 2871
| date_scraped | description | info_url | date_received | council_reference | address | comment_url |
|---|---|---|---|---|---|---|
|
2012-08-27
|
Indoor Recreation Sports Centre - Studdock Investments Pty Ltd & Cricket Generation Pty Ltd C/
|
2012-08-01
|
MCU12/0111
|
84 Sandalwood Lane, FOREST GLEN, QLD
|
||
|
2012-08-27
|
Extension to Relevant Period
|
2012-08-01
|
132006.1360.03
|
8 William St, NOOSAVILLE, QLD
|
||
|
2012-08-27
|
Generally in Accordance
|
2012-08-01
|
132007.1841.04
|
26 Eenie Creek Rd, NOOSAVILLE, QLD
|
||
|
2012-08-27
|
Generally in Accordance
|
2012-08-01
|
2008/56M0014.02
|
476 Nicklin Way, WURTULLA, QLD
|
||
|
2012-08-27
|
45 Primary School Crt - Conversion of Dual Occupancy to Offices - Martin Kurvink
|
2012-08-02
|
MCU12/0112
|
43-45 Primary School Ct, MAROOCHYDORE, QLD
|
||
|
2012-08-27
|
Warehouse - Uptons Salvage Trading Pty Ltd
|
2012-08-02
|
MCU12/0113
|
31 Moroney Pl, BEERWAH, QLD
|
||
|
2012-08-27
|
62 Duporth Ave MAROOCHYDORE - Generally In Accordance
|
2012-08-03
|
MCU02/0088.05
|
52 Duporth Ave, MAROOCHYDORE, QLD
|
||
|
2012-08-27
|
Extension to Relevant Period - Furno's Pty Ltd
|
2012-08-03
|
MCU07/0214.03
|
88 Burnett St, BUDERIM, QLD
|
||
|
2012-08-27
|
Development Application for Material Change of Use to establish an Sport and Recreation (Naval Cadet Unit)
|
2012-08-03
|
1998/510053.01
|
Maleny-Stanley River Rd, MALENY, QLD
|
||
|
2012-08-27
|
Infrastructure Agreement
|
2012-08-06
|
MCU10/0052.01
|
0 Parklakes Dr, BLI BLI, QLD
|
Statistics
Average successful run time: less than a minute
Total run time: 28 days
Total cpu time used: about 1 hour
Total disk space used: 1.18 MB
History
-
Auto
ran
revision
6a6ca4ed
and
completed successfully
.
76 records added, 69 records removed in the database
-
Auto
ran
revision
6a6ca4ed
and
completed successfully
.
74 records added, 74 records removed in the database
-
Auto
ran
revision
6a6ca4ed
and
completed successfully
.
82 records added, 82 records removed in the database
-
Auto
ran
revision
6a6ca4ed
and
completed successfully
.
82 records added, 67 records removed in the database
-
Auto
ran
revision
6a6ca4ed
and
completed successfully
.
67 records added, 62 records removed in the database
- ...
- Forked from ScraperWiki