planningalerts-scrapers / mornington_peninsula

Mornington Peninsula Shire - Development Applications


Mornington Peninsula Shire Council scraper

Setup MORPH_PROXY (host:port) to make proxy request for web pages

Forked from ScraperWiki

Contributors henare LoveMyData equivalentideas CloCkWeRX jamezpolley

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.4  Fetching httpclient 2.8.3  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Fetching net-http-digest_auth 1.4.1  Installing unf_ext 0.0.7.4 with native extensions  Installing httpclient 2.8.3  Installing net-http-digest_auth 1.4.1  Fetching net-http-persistent 2.9.4  Fetching mini_portile2 2.3.0  Installing net-http-persistent 2.9.4  Installing mini_portile2 2.3.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.2  Fetching sqlite3 1.3.13  Installing sqlite3 1.3.13 with native extensions  Installing webrobots 0.1.2  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20170404  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.5  Installing mechanize 2.7.5  Bundle complete! 2 Gemfile dependencies, 18 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (24.68s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Checking page 1 of 16 Skipping already saved record P18/0613 Skipping already saved record P18/0769 Skipping already saved record P18/1047 Skipping already saved record P18/0232 Skipping already saved record P18/0424 Skipping already saved record P18/026 Skipping already saved record P13/040.02 Skipping already saved record P18/10 Skipping already saved record P18/137 Checking page 2 of 16 Skipping already saved record P18/0845 Skipping already saved record P18/0847 Skipping already saved record P18/0976 Skipping already saved record P18/040 Skipping already saved record P18/1070 Skipping already saved record P18/1242 Skipping already saved record P18/138 Skipping already saved record P18/139 Skipping already saved record P18/1569 Checking page 3 of 16 Skipping already saved record P18/184 Skipping already saved record P18/054 Skipping already saved record P18/129 Skipping already saved record P18/1204 Skipping already saved record P18/1208 Skipping already saved record P18/1276 Skipping already saved record P18/1510 Skipping already saved record P94/161.02 Skipping already saved record P18/049.01 Checking page 4 of 16 Skipping already saved record P18/0489 Skipping already saved record P15/0904.01 Skipping already saved record P17/0836.01 Skipping already saved record P17/1763.01 Skipping already saved record P17/2357 Skipping already saved record P17/2486 Skipping already saved record P18/0908 Skipping already saved record P18/0963 Skipping already saved record P18/1049 Checking page 5 of 16 Skipping already saved record P18/1094 Skipping already saved record P18/181 Skipping already saved record P18/1234 Skipping already saved record P18/1251 Skipping already saved record P18/1408 Skipping already saved record P18/0953 Skipping already saved record P18/0981 Skipping already saved record P18/1039 Skipping already saved record P18/107 Checking page 6 of 16 Skipping already saved record P18/1295 Skipping already saved record P18/1363 Skipping already saved record P18/1476 Skipping already saved record P18/1574 Skipping already saved record P09/0678.03 Skipping already saved record P18/0895 Skipping already saved record P18/1232 Skipping already saved record P14/1791.02 Skipping already saved record P16/2394.01 Checking page 7 of 16 Skipping already saved record P17/2532 Skipping already saved record P18/050 Skipping already saved record P18/045 Skipping already saved record P18/0797 Skipping already saved record P18/1035 Skipping already saved record P18/1054 Skipping already saved record P18/1098 Skipping already saved record P18/0925 Skipping already saved record P18/0929 Checking page 8 of 16 Skipping already saved record P18/1050 Skipping already saved record P18/1425 Skipping already saved record P18/0820 Skipping already saved record P18/0868 Skipping already saved record P18/090 Skipping already saved record P18/0928 Skipping already saved record P18/169 Skipping already saved record P18/185 Skipping already saved record P18/1249 Checking page 9 of 16 Skipping already saved record P18/129 Skipping already saved record P18/1508 Skipping already saved record P18/1549 Skipping already saved record P18/1571 Skipping already saved record P18/1670 Something not right here: {"council_reference"=>"VCAT Reference: P131/2018", "description"=>nil, "address"=>"P18/0856, VIC", "info_url"=>"https://www.mornpen.vic.gov.au/Building-Planning/Planning/Advertised-Planning-Applications/6-Permien-Street-Dromana-Advertising-at-the-direction-of-VCAT", "comment_url"=>"mailto:planning.submission@mornpen.vic.gov.au", "date_scraped"=>"2018-09-22"} Skipping already saved record P17/1582.01 Skipping already saved record P18/073 Skipping already saved record P18/13 Checking page 10 of 16 Skipping already saved record P18/136 Skipping already saved record P18/045 Skipping already saved record P18/1069 Skipping already saved record P18/1285 Skipping already saved record P18/1453 Skipping already saved record P18/154 Skipping already saved record P18/1580 Skipping already saved record P07/101.02 Skipping already saved record P18/0268 Checking page 11 of 16 Skipping already saved record P18/091 Skipping already saved record P18/134 Skipping already saved record P18/1485 Skipping already saved record P18/1501 Skipping already saved record P18/0958 Skipping already saved record P07/281.04 Skipping already saved record P18/0681 Skipping already saved record P18/0804 Skipping already saved record P18/0943 Checking page 12 of 16 Skipping already saved record P18/1082 Skipping already saved record P18/150 Skipping already saved record P18/1586 Skipping already saved record P17/0869 Skipping already saved record P18/1060 Skipping already saved record P18/1279 Skipping already saved record P18/140 Skipping already saved record P18/1540 Skipping already saved record P18/1542 Checking page 13 of 16 Skipping already saved record P18/1570 Skipping already saved record P18/1319 Skipping already saved record P18/192 Skipping already saved record P1/056.05 Skipping already saved record P18/1309 Skipping already saved record P18/0987 Skipping already saved record P18/154 Skipping already saved record P18/1296 Skipping already saved record P18/1585 Checking page 14 of 16 Skipping already saved record P18/1656 Something not right here: {"council_reference"=>"1-21A Ocean Beach Road & 23 Constitution Hil - VCAT Ref. P158/2018", "description"=>nil, "address"=>"P1588/2018, VIC", "info_url"=>"https://www.mornpen.vic.gov.au/Building-Planning/Planning/Advertised-Planning-Applications/1-21A-Ocean-Beach-Road-23-Constitution-Hill-Road-Sorrento-Advertising-at-the-Direction-of-VCAT", "comment_url"=>"mailto:planning.submission@mornpen.vic.gov.au", "date_scraped"=>"2018-09-22"} Skipping already saved record P18/0576 Skipping already saved record P18/08 Skipping already saved record P18/104 Skipping already saved record P18/107 Skipping already saved record P18/1029 Skipping already saved record P18/135 Skipping already saved record P14/1786.01 Checking page 15 of 16 Skipping already saved record P18/1013 Skipping already saved record P18/159 Skipping already saved record P18/1519 Skipping already saved record P18/1523 Skipping already saved record P18/1565 Skipping already saved record P18/1583 Skipping already saved record P18/162 Skipping already saved record P17/0614.02 Skipping already saved record P18/126 Checking page 16 of 16 Skipping already saved record P18/1314 Skipping already saved record P18/1604 Skipping already saved record P18/1619 Skipping already saved record P12/1567.06 Something not right here: {"council_reference"=>"VCAT Reference P1523/2018", "description"=>nil, "address"=>"P18/0934 , VIC", "info_url"=>"https://www.mornpen.vic.gov.au/Building-Planning/Planning/Advertised-Planning-Applications/22-24-Kangerong-Avenue-Dromana-Advertising-at-the-direction-of-VCAT", "comment_url"=>"mailto:planning.submission@mornpen.vic.gov.au", "date_scraped"=>"2018-09-22"}

Data

Downloaded 3441 times by slav123 openaustralia LoveMyData jesse-a-reilly TheZepto MikeRalphson GitHubMLee TornMarketing

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.05 MB) Use the API

rows 10 / 5726

date_scraped description info_url council_reference address comment_url
2011-05-22
Plans and supporting documents for the use and development of a micro-brewery, restaurant, function centre, primary produce sales, plant nursery, care takers house, general liquor license, advertising signage, vegetation trimming and associated works.
P10/2746
Barragunda, 275 Cape Schanck Road, Cape Schanck
2011-05-22
Plans and supporting documents
P09/2687
71, 7375 & 7779 Barkly Street & 16 Pearson Street Mornington
2011-05-22
P10/0273
85 Mount Eliza Way, Mount Eliza
2012-07-19
Develop a dwelling on the land and vary the restriction in Covenant PS604026Q to replace the words:
P12/0829
6 Glen Shian Crescent MOUNT ELIZA
2012-07-31
Vary the restriction that applies to the land contained in covenants B447099 (Lot 6 on Plan of Subdivision 054663) and B271259 (Lot 5 on Plan of Subdivision 054663) by replacing the words:
P12/0775
79 Inglis Street MORNINGTON
2012-08-08
Develop a single storey dwelling, develop outbuildings and associated works and vary the building envelope of lot 4 contained in restrictive covenant created by instrument of transfer PS545900W contained in Certificate of Title Volume 11193 Folio 991 generally in accordance with the submitted plans
P12/0865
126 Old Cape Schanck Road ROSEBUD
2012-08-08
Remove the restriction contained in covenant V458728l from the land
P12/0380
5 Manor House Drive MORNINGTON
2012-08-21
Demolition of the existing Hostel and Historical Glenbank Building; re-development of the site comprising a 2-storey (plus basement) Residential Aged Care Centre, comprising:
P11/1898
107 Barkly Street MORNINGTON
2012-09-04
The use and development of an 18 hole golf course, irrigation storage tanks, pump shed, and vegetation removal generally in accordance with the submitted plans.
P12/1086
209 Sandy Road FINGAL
2012-10-17
Vary the restrictive covenant created in instrument of transfer f857961 dated 17 September 1975 and applying to volume 09138 folio 677 (Lot 1, title plan 178722b ), by removing paragraph (c), which states:
P12/1446
26 Wonderland Terrace MOUNT MARTHA

Statistics

Average successful run time: 4 minutes

Total run time: 9 days

Total cpu time used: about 2 hours

Total disk space used: 3.08 MB

History

  • Auto ran revision fe956b17 and completed successfully .
    nothing changed in the database
  • Auto ran revision fe956b17 and completed successfully .
    13 records added in the database
    173 pages scraped
  • Auto ran revision fe956b17 and completed successfully .
    nothing changed in the database
  • Auto ran revision fe956b17 and completed successfully .
    3 records added in the database
    164 pages scraped
  • Auto ran revision fe956b17 and completed successfully .
    5 records added in the database
    159 pages scraped
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

mornington_peninsula / scraper.rb