LoveMyData / mornington_peninsula

Mornington Peninsula Shire - Development Applications

Scrapes www.mornpen.vic.gov.au

Home - Mornington Peninsula


Mornington Peninsula Shire Council scraper

Setup MORPH_PROXY (host:port) to make proxy request for web pages

Contributors LoveMyData henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching unf_ext 0.0.7.4  Fetching httpclient 2.8.3  Fetching mime-types-data 3.2016.0521  Installing mime-types-data 3.2016.0521  Installing httpclient 2.8.3  Installing unf_ext 0.0.7.4 with native extensions  Fetching net-http-digest_auth 1.4.1  Installing net-http-digest_auth 1.4.1  Fetching net-http-persistent 2.9.4  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Installing net-http-persistent 2.9.4  Fetching webrobots 0.1.2  Fetching sqlite3 1.3.13  Installing webrobots 0.1.2  Installing sqlite3 1.3.13 with native extensions  Fetching mime-types 3.1  Installing mime-types 3.1  Fetching nokogiri 1.8.1  Installing nokogiri 1.8.1 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20170404  Installing domain_name 0.5.20170404  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.5  Installing mechanize 2.7.5  Bundle complete! 2 Gemfile dependencies, 18 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (25.74s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Checking page 1 of 45 Skipping already saved record P16/0567 Skipping already saved record P16/05 Skipping already saved record P16/082 Skipping already saved record P15/2128 Skipping already saved record P15/2360 Skipping already saved record P16/0892 Skipping already saved record P12/0547.03 Skipping already saved record P15/2026 Skipping already saved record P15/282 Checking page 2 of 45 Skipping already saved record P15/2324 Skipping already saved record P16/0910 Skipping already saved record P16/0435 Skipping already saved record P16/0520 Skipping already saved record P16/0817 Skipping already saved record P16/081 Skipping already saved record P16/0929 Skipping already saved record P16/0492 Skipping already saved record P16/0820 Checking page 3 of 45 Skipping already saved record P16/0860 Skipping already saved record P16/0461 Skipping already saved record P16/0812 Skipping already saved record P07/163.04 Skipping already saved record P16/0672 Skipping already saved record P14/2017.02 Skipping already saved record P16/0683 Skipping already saved record P14/0623.01 Skipping already saved record P15/0520.01 Checking page 4 of 45 Skipping already saved record P15/2181 Skipping already saved record P16/0324 Skipping already saved record P16/0503 Skipping already saved record P16/0708 Skipping already saved record P16/0734 Skipping already saved record P16/092 Skipping already saved record P16/0273 Skipping already saved record P16/0291 Skipping already saved record P16/0292 Checking page 5 of 45 Skipping already saved record P16/0568 Skipping already saved record P16/083 Skipping already saved record P16/0849 Skipping already saved record P16/0984 Skipping already saved record P16/041 Skipping already saved record P12/124.01 Skipping already saved record P15/212 Skipping already saved record P16/0487 Skipping already saved record P16/0580 Checking page 6 of 45 Skipping already saved record P16/0736 Skipping already saved record P16/0796 Skipping already saved record P16/0841 Skipping already saved record P16/0814 Skipping already saved record P16/079 Skipping already saved record P16/0405 Skipping already saved record P16/0549 Skipping already saved record P16/0750 Skipping already saved record P16/0790 Checking page 7 of 45 Skipping already saved record P16/0868 Skipping already saved record P16/0875 Skipping already saved record P16/0935 Skipping already saved record P16/0689 Skipping already saved record P16/0679 Skipping already saved record P16/0696 Skipping already saved record P16/0721 Skipping already saved record P16/089 Skipping already saved record P15/1951 Checking page 8 of 45 Skipping already saved record P16/0548 Skipping already saved record P16/0650 Skipping already saved record P16/0784 Skipping already saved record P16/0850 Skipping already saved record P16/0930 Skipping already saved record P16/0895 Skipping already saved record P16/190 Skipping already saved record P16/1012 Skipping already saved record P16/0479 Checking page 9 of 45 Skipping already saved record P16/0179 Skipping already saved record P16/0271 Skipping already saved record P16/0617 Skipping already saved record P16/0737 Skipping already saved record P16/0838 Skipping already saved record P16/0964 Skipping already saved record P16/093 Skipping already saved record P16/0470 Skipping already saved record P16/0604 Checking page 10 of 45 Skipping already saved record P16/060 Skipping already saved record P16/069 Skipping already saved record P16/1031 Skipping already saved record P16/050 Skipping already saved record P14/1310.02 Skipping already saved record P15/157 Skipping already saved record P16/0434 Skipping already saved record P16/0985 Skipping already saved record P16/010 Checking page 11 of 45 Skipping already saved record P16/0386 Skipping already saved record P16/0690 Skipping already saved record P16/0730 Skipping already saved record P16/0827 Skipping already saved record P16/0934 Skipping already saved record P16/0571 Skipping already saved record P16/031 Skipping already saved record P16/0476 Skipping already saved record P12/2156.02 Checking page 12 of 45 Skipping already saved record P16/0364 Skipping already saved record P16/0561 Skipping already saved record P16/0848 Skipping already saved record P16/0946 Skipping already saved record P10/0879.01 Skipping already saved record P08/293.03 Skipping already saved record P16/0456 Skipping already saved record P16/134 Skipping already saved record P16/128 Checking page 13 of 45 Skipping already saved record P16/1241 Skipping already saved record P16/1313 Skipping already saved record P16/1394 Skipping already saved record P16/1397 Skipping already saved record P16/0829 Skipping already saved record P16/152 Skipping already saved record P16/061 Skipping already saved record P16/104 Skipping already saved record P16/1289 Checking page 14 of 45 Skipping already saved record P16/1527 Skipping already saved record P16/079 Skipping already saved record P10/097.03 Skipping already saved record P16/0570 Skipping already saved record P16/0806 Skipping already saved record P16/109 Skipping already saved record P16/141 Skipping already saved record P16/184 Skipping already saved record P16/1460 Checking page 15 of 45 Skipping already saved record P16/1523 Skipping already saved record P16/1581 Skipping already saved record P16/0529 Skipping already saved record P16/0412 Skipping already saved record P16/0464 Skipping already saved record P16/0915 Skipping already saved record P16/1323 Skipping already saved record P16/1438 Skipping already saved record P16/1512 Checking page 16 of 45 Skipping already saved record P16/193 Skipping already saved record P16/1215 Skipping already saved record P16/1246 Skipping already saved record P16/1309 Skipping already saved record P16/1416 Skipping already saved record P16/1485 Skipping already saved record P16/1576 Skipping already saved record P16/043 Skipping already saved record P16/0836 Checking page 17 of 45 Skipping already saved record P16/1328 Skipping already saved record P16/1573 Skipping already saved record P86/0103.01 Skipping already saved record P16/1016 Skipping already saved record P16/1091 Skipping already saved record P16/1653 Skipping already saved record P16/0247 Skipping already saved record P16/0709 Skipping already saved record P16/0923 Checking page 18 of 45 Skipping already saved record P16/1231 Skipping already saved record P16/1097 Skipping already saved record P16/162 Skipping already saved record P12/2154.02 Skipping already saved record P1/237.03 Skipping already saved record P16/0602 Skipping already saved record P16/0865 Skipping already saved record P16/1525 Skipping already saved record P16/1054 Checking page 19 of 45 Skipping already saved record P04/260.01 Skipping already saved record P16/153 Skipping already saved record P16/1521 Skipping already saved record P16/1291 Skipping already saved record P16/0832 Skipping already saved record P16/089 Skipping already saved record P13/1458.02 Skipping already saved record P15/0697.01 Skipping already saved record P16/018 Checking page 20 of 45 Skipping already saved record P16/172 Skipping already saved record P16/1468 Skipping already saved record P16/152 Skipping already saved record P14/0484.04 Skipping already saved record P16/1234 Skipping already saved record P16/1427 Skipping already saved record P16/1583 Skipping already saved record P16/1373 Skipping already saved record P16/0565 Checking page 21 of 45 Skipping already saved record P16/1518 Skipping already saved record P16/0798 Skipping already saved record P16/1540 Skipping already saved record P16/1452 Skipping already saved record P16/1207 Skipping already saved record P16/1257 Skipping already saved record P16/1702 Skipping already saved record P16/0969 Skipping already saved record P16/090 Checking page 22 of 45 Skipping already saved record P16/182 Skipping already saved record P16/1616 Skipping already saved record P16/1605 Skipping already saved record P03/1345.06 Skipping already saved record P14/0625.01 Skipping already saved record P16/0816 Skipping already saved record P16/1303 Skipping already saved record P16/0109 Skipping already saved record P16/1391 Checking page 23 of 45 Skipping already saved record P16/126 Skipping already saved record P16/0953 & VCAT Reference P604/2017 Skipping already saved record P16/1458 Skipping already saved record P16/187 Skipping already saved record P16/087 Skipping already saved record P15/1930.01 Skipping already saved record P16/1534 Skipping already saved record P16/1071 Skipping already saved record P14/064.01 Checking page 24 of 45 Skipping already saved record P16/1652 Skipping already saved record P16/1963 Skipping already saved record P16/1526 Skipping already saved record P16/1642 Skipping already saved record P16/161 Skipping already saved record P16/168 Skipping already saved record P16/1538 Skipping already saved record P12/1681.02 Skipping already saved record P16/1015 Checking page 25 of 45 Skipping already saved record P16/1678 Skipping already saved record P16/1973 Skipping already saved record P16/2054 Skipping already saved record P16/1408 Skipping already saved record P16/1486 Skipping already saved record P15/172.01 Skipping already saved record P14/056.02 Skipping already saved record P1/1840.20 Skipping already saved record P16/208 Checking page 26 of 45 Skipping already saved record P16/2534 Skipping already saved record P17/060 Skipping already saved record P14/1363.03 Skipping already saved record P16/26 Skipping already saved record P17/019 Skipping already saved record P16/2353 Something not right here: {"council_reference"=>"P16/1081 - 162 Woleys Road Bitern - VCAT Advertising", "description"=>nil, "address"=>"P16/1081 - 162 Woolleys Road Bittern - VCAT Advertising , VIC", "info_url"=>"https://www.mornpen.vic.gov.au/Building-Planning/Planning/Advertised-Planning-Applications/P161081-162-Woolleys-Road-Bittern-VCAT-Advertising", "comment_url"=>"mailto:planning.submission@mornpen.vic.gov.au", "date_scraped"=>"2018-01-21"} Skipping already saved record P16/2438 Skipping already saved record P17/0327 Checking page 27 of 45 Skipping already saved record P17/0378 Skipping already saved record P17/0403 Skipping already saved record P15/1865.02 Skipping already saved record P16/1506 Skipping already saved record P17/0191 Skipping already saved record P17/0241 Skipping already saved record P17/0410 Skipping already saved record P17/0519 Skipping already saved record P16/2494 Checking page 28 of 45 Skipping already saved record P17/0480 Skipping already saved record P13/1234.02 Skipping already saved record P17/0247 Skipping already saved record P17/0590 Skipping already saved record P17/0572 Skipping already saved record P17/0739 Skipping already saved record P17/0417 Skipping already saved record P17/0383 Skipping already saved record P16/2392 Checking page 29 of 45 Skipping already saved record P17/057 Skipping already saved record P17/089 Skipping already saved record P17/0438 Skipping already saved record P17/0853 Skipping already saved record P17/0925 Skipping already saved record P17/0219 Skipping already saved record P17/1096 Skipping already saved record P17/0425 Skipping already saved record P17/091 Checking page 30 of 45 Skipping already saved record P17/071 Skipping already saved record P17/070 Skipping already saved record P17/1060 Skipping already saved record P17/0806 Skipping already saved record P17/045 Skipping already saved record P17/0946 Skipping already saved record P17/121 Skipping already saved record P16/249 Skipping already saved record P17/0362 Checking page 31 of 45 Skipping already saved record P05/108.03 Skipping already saved record P17/092 Skipping already saved record P17/1385 Skipping already saved record P17/0504 Skipping already saved record P17/0639. Skipping already saved record P14/1498.02 Skipping already saved record P17/1085 Skipping already saved record P17/0416 Skipping already saved record P17/1087 Checking page 32 of 45 Skipping already saved record P17/195 Skipping already saved record P17/1352 Skipping already saved record P17/0873 Skipping already saved record P17/0678 Skipping already saved record P17/0196.01 Skipping already saved record P17/14 Skipping already saved record P17/1578 Skipping already saved record P17/1624 Skipping already saved record P17/0834 Checking page 33 of 45 Skipping already saved record P17/185 Skipping already saved record P17/1491 Skipping already saved record P17/1496 Skipping already saved record P17/1543 Skipping already saved record P17/1738 Skipping already saved record P17/0825 Skipping already saved record P17/0930 Skipping already saved record P17/1827 Skipping already saved record P09/1061.02 Checking page 34 of 45 Skipping already saved record P17/0151.01 Skipping already saved record P17/1248 Skipping already saved record P17/1914 Skipping already saved record P17/160 Skipping already saved record P17/1089 Skipping already saved record P17/1374 Skipping already saved record P17/1705 Skipping already saved record P17/1234 Skipping already saved record P17/12 Checking page 35 of 45 Skipping already saved record P14/085.03 Skipping already saved record P17/2034 Skipping already saved record P17/2070 Something not right here: {"council_reference"=>"P16/159", "description"=>nil, "address"=>"5 Ascalon Place Sorrento - VCAT Advertising, VIC", "info_url"=>"https://www.mornpen.vic.gov.au/Building-Planning/Planning/Advertised-Planning-Applications/P161599-5-Ascalon-Place-Sorrento-VCAT-Advertising", "comment_url"=>"mailto:planning.submission@mornpen.vic.gov.au", "date_scraped"=>"2018-01-21"} Something not right here: {"council_reference"=>"P17/0898", "description"=>nil, "address"=>"54-64 Mount Eliza Way MOUNT ELIZA , VIC", "info_url"=>"https://www.mornpen.vic.gov.au/Building-Planning/Planning/Advertised-Planning-Applications/P170898-54-64-Mount-Eliza-Way-MOUNT-ELIZA", "comment_url"=>"mailto:planning.submission@mornpen.vic.gov.au", "date_scraped"=>"2018-01-21"} Skipping already saved record P15/0647.01 Skipping already saved record P17/0535.02 Skipping already saved record P17/1215 Skipping already saved record P13/0961.02 Checking page 36 of 45 Skipping already saved record P14/0520.07 Skipping already saved record P17/0185 Skipping already saved record P15/0467.01 Skipping already saved record P16/2091.01 Skipping already saved record P17/0434 Skipping already saved record P17/0604 Skipping already saved record P17/0919 Skipping already saved record P17/0972 Skipping already saved record P17/1458 Checking page 37 of 45 Skipping already saved record P17/15 Skipping already saved record P17/132 Skipping already saved record P17/123 Skipping already saved record P17/163 Skipping already saved record P17/165 Skipping already saved record P17/1786 Skipping already saved record P17/1871 Skipping already saved record P17/1962 Skipping already saved record P17/197 Checking page 38 of 45 Skipping already saved record P17/20 Skipping already saved record P17/2025 Skipping already saved record P17/210 Skipping already saved record P17/212 Skipping already saved record P17/2136 Skipping already saved record P17/2157 Skipping already saved record P17/219 Skipping already saved record P17/248 Skipping already saved record P17/278 Checking page 39 of 45 Skipping already saved record P17/294 Skipping already saved record P17/2417 Skipping already saved record P17/191 Skipping already saved record P17/1346 Skipping already saved record P1/0316.04 Skipping already saved record P14/206.01 Skipping already saved record P16/1528.01 Skipping already saved record P16/1728.03 Skipping already saved record P17/1508 Checking page 40 of 45 Skipping already saved record P17/1517 Skipping already saved record P17/1679 Skipping already saved record P17/1712 Skipping already saved record P17/1854 Skipping already saved record P17/1861 Skipping already saved record P17/1873 Skipping already saved record P17/1909 Skipping already saved record P17/1981 Skipping already saved record P17/1986 Checking page 41 of 45 Skipping already saved record P17/2026 Skipping already saved record P17/2042 Skipping already saved record P17/2123 Skipping already saved record P17/2184 Skipping already saved record P17/213 Skipping already saved record P17/21 Skipping already saved record P17/249 Skipping already saved record P17/284 Skipping already saved record P17/231 Checking page 42 of 45 Skipping already saved record P17/2363 Skipping already saved record P17/2371 Skipping already saved record P17/243 Skipping already saved record P17/232 Skipping already saved record P17/247 Skipping already saved record P17/2561 Skipping already saved record P17/247 Skipping already saved record P15/2360.02 Skipping already saved record P17/1413 Checking page 43 of 45 Skipping already saved record P17/1715 Skipping already saved record P17/218 Skipping already saved record P17/2397 Skipping already saved record P17/2410 Skipping already saved record P17/1893 Skipping already saved record P10/0919.01 Skipping already saved record P12/1290.03 Skipping already saved record P17/1598 Skipping already saved record P17/159 Checking page 44 of 45 Skipping already saved record P17/191 Skipping already saved record P17/2028 Skipping already saved record P17/2085 Skipping already saved record P17/2171 Skipping already saved record P17/1050 Skipping already saved record P17/241 Skipping already saved record P17/279 Skipping already saved record P17/2303 Skipping already saved record P17/234 Checking page 45 of 45 Skipping already saved record P17/2390 Skipping already saved record P17/2394

Data

Downloaded 400 times by LoveMyData

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.17 MB) Use the API

rows 10 / 2073

council_reference description address info_url comment_url date_scraped
P14/0484.04
Development of a dwelling and associated works in accordance with the endorsed plans
41 Hull Road Mount Martha, VIC
mailto:planning.submission@mornpen.vic.gov.au
2016-09-27
P16/1234
Develop a single storey dwelling and associated works generally in accordance with the submitted plans
35 Leonard Street Tootgarook, VIC
mailto:planning.submission@mornpen.vic.gov.au
2016-09-27
P16/1427
Develop a single dwelling and associated works generally in accordance with the submitted plans
17 Macks Place Safety Beach, VIC
mailto:planning.submission@mornpen.vic.gov.au
2016-09-27
P16/1583
Develop dwelling additions (second storey) and alterations, remove vegetation and associated works generally in accordance with the submitted plans
9 Woodland Avenue Mount Eliza, VIC
mailto:planning.submission@mornpen.vic.gov.au
2016-09-27
P16/1373
Alterations and additions to the existing dwelling, vegetation removal and associated works generally in accordance with the submitted plans
13 Tourello Road Mout Eliza, VIC
mailto:planning.submission@mornpen.vic.gov.au
2016-09-27
P16/0565
Development of a dwelling and associated works generally in accordance with the submitted plans
3 Rendlesham Avenue Mount Eliza, VIC
mailto:planning.submission@mornpen.vic.gov.au
2016-09-27
P16/1518
Development of two carports and associated works generally in accordance with the submitted plans
28 Seaview Road Tyabb, VIC
mailto:planning.submission@mornpen.vic.gov.au
2016-09-27
P16/1520
Development of outbuilding and associated works generally in accordance with the submitted plans
104 Grandview Terrace Mount Martha, VIC
mailto:planning.submission@mornpen.vic.gov.au
2016-09-27
P16/0832
Change of use to animal keeping (dog day care) and associated works generally in accordance with the submitted plans
35 Mckirdys Road Tyabb, VIC
mailto:planning.submission@mornpen.vic.gov.au
2016-09-27
P16/1291
Develop a carport and associated works generally in accordance with the submitted plans
1/68 James Street Hastings, VIC
mailto:planning.submission@mornpen.vic.gov.au
2016-09-27

Statistics

Average successful run time: 7 minutes

Total run time: 1 day

Total cpu time used: about 1 hour

Total disk space used: 1.2 MB

History

  • Auto ran revision b9173281 and completed successfully .
    nothing changed in the database
    489 pages scraped
  • Auto ran revision b9173281 and completed successfully .
    nothing changed in the database
    489 pages scraped
  • Auto ran revision b9173281 and completed successfully .
    51 records added in the database
    489 pages scraped
  • Auto ran revision b9173281 and failed .
    nothing changed in the database
  • Auto ran revision b9173281 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

mornington_peninsula / scraper.rb