planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria

Contributors CloCkWeRX henare mlandauer archoo

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/........... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching mime-types-data 3.2021.0225 [1G Fetching multi_xml 0.6.0 [1G Using bundler 1.15.2 [1G Fetching httpclient 2.8.3 [1G Installing multi_xml 0.6.0 [1G Installing mime-types-data 3.2021.0225 [1G Installing httpclient 2.8.3 [1G Fetching sqlite3 1.4.2 [1G Fetching mime-types 3.3.1 [1G Installing sqlite3 1.4.2 with native extensions [1G Installing mime-types 3.3.1 [1G Fetching httparty 0.18.1 [1G Installing httparty 0.18.1 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Bundle complete! 2 Gemfile dependencies, 9 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Post-install message from httparty: [1G When you HTTParty, you must party hard! [1G Bundle completed (4.47s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Getting applications for Alpine Shire Council - Bright Office... Saving S228236H... Saving S227400A... Saving S227825B... Saving S227705A... Getting applications for Ararat Rural City Council... Getting applications for Ballarat City Council... Saving S228193P... Saving S227843V... Saving S227770A... Saving S227716M... Saving S227553S... Getting applications for Banyule City Council... Saving S228623S... Saving S228452T... Saving S228062A... Saving S228048J... Saving S227948P... Saving S227898P... Saving S227618M... Saving S227568M... Saving S227681V... Saving S227604M... Saving S227572H... Getting applications for Bass Coast Shire Council... Saving S228621B... Saving S228171M... Saving S227929A... Saving S212225B... Getting applications for Baw Baw Shire Council... Saving S228644A... Saving S228416C... Saving S226525P... Saving S227318P... Saving S228134B... Saving S227919E... Saving S227916T... Saving S227720H... Saving S227851A... Saving S227555H... Getting applications for Bayside City Council... Saving S228447C... Saving S228276E... Saving S228287T... Saving S227542C... Saving S228035E... Saving S227813S... Saving S227962C... Saving S227957M... Saving S227848A... Saving S227696S... Saving S227631E... Saving S227632B... Getting applications for Benalla Rural City Council... Saving S228225T... Saving S228217S... Getting applications for Boroondara City Council... Saving S228423J... Saving S228359V... Saving S228156C... Saving S228022B... Saving S227804T... Saving S227686A... Saving S227663B... Saving S227636H... Getting applications for Borough of Queenscliffe... Getting applications for Brimbank City Council... Saving S228736M... Saving S228832V... Saving S228591M... Saving S228432H... Saving S228308J... Saving S225982M... Saving S228224A... Saving S228142C... Saving S227704C... Saving S228012H... Saving S228008M... Saving S228042M... Saving S227856B... Saving S228006V... Saving S227835T... Saving S227798A... Saving S227792B... Saving S227322J... Saving S227606C... Saving S227484B... Saving S227439M... Getting applications for Buloke Shire Council... Saving S228267H... Saving S227865A... Getting applications for Cardinia Shire Council... Saving S228716B... Saving S227233H... Saving S228304C... Saving S228265S... Saving S227915A... Saving S227914C... Saving S228049E... Saving S227651S... Saving S226534M... Saving S227699C... Saving S227601B... Saving S227594J... Saving S223787E... Getting applications for Casey City Council... Saving S228728J... Saving S228571B... Saving S228526M... Saving S224809E... Saving S228207A... Saving S228078P... Saving S227425M... Saving S227899J... Saving S227942S... Saving S227783C... Saving S227756J... Saving S227759V... Saving S227715S... Saving S227595E... Saving S226653T... Saving S225214P... Saving S225216E... Getting applications for Central Goldfields Shire Council... Saving S228082J... Saving S228050P... Getting applications for City of Greater Dandenong... Saving S228746E... Saving S228298H... Saving S228177J... Saving S228007S... Saving S227850C... Saving S227685C... Saving S227822P... Saving S227388S... Getting applications for City of Greater Geelong... Saving S227956S... Saving S228402C... Saving S228529A... Saving S228250V... Saving S228495C... Saving S228329S... Saving S228372P... Saving S228371T... Saving S228323T... Saving S228291P... Saving S201006C... Saving S228226P... Saving S228163J... Saving S228153S... Saving S228106M... Saving S228074H... Saving S228073M... Saving S228067B... Saving S227959C... Saving S228056M... Saving S228054V... Saving S227971B... Saving S227709E... Saving S227707P... Saving S227706T... Saving S227852T... Saving S227556C... Saving S227758B... Saving S227679S... Saving S227723T... Saving S227552V... Saving S227548B... Saving S227546J... Saving S227544T... Saving S227540M... Saving S227539C... Getting applications for City of Wodonga... Saving S228567E... Saving S228722M... Saving S227996P... Saving S227579B... Saving S227784A... Saving S227787J... Getting applications for Colac Otway Shire... Saving S228859B... Saving S228271C... Saving S228229B... Saving S228070B... Saving S224604V... Saving S227967E... Getting applications for Corangamite Shire Council... Saving S228834M... Saving S227564E... Getting applications for Darebin City Council... Saving S228544H... Saving S228460V... Saving S228325J... Saving S228241A... Saving S228220S... Saving S228203S... Saving S228030C... Saving S228010S... Saving S227966J... Saving S226410C... Saving S227527T... Getting applications for East Gippsland Shire Council... Saving S228388E... Saving S228391E... Saving S228443V... Saving S228442B... Saving S228392B... Saving S228206C... Saving S228387J... Saving S228385T... Saving S223433J... Saving S228052E... Saving S228051J... Saving S227871J... Getting applications for Frankston City Council... Saving S227944H... Saving S227946A... Saving S225958E... Saving S225935H... Saving S227333A... Saving S227736A... Getting applications for Gannawarra Shire Council... Getting applications for Glen Eira City Council... Saving S228863V... Saving S228796V... Saving S228476M... Saving S227997J... Saving S227876M... Saving S227554M... Saving S228403A... Saving S225681T... Saving S228194J... Saving S228390J... Saving S228383C... Saving S228376V... Saving S227838E... Saving S227328H... Saving S228105S... Saving S227816C... Saving S227779H... Saving S227781M... Saving S227621M... Saving S227550E... Saving S227523M... Saving S227517B... Getting applications for Glenelg Shire Council... Saving S228227J... Saving S227854J... Saving S227730B... Getting applications for Golden Plains Shire Council... Saving S228475S... Saving S228534P... Saving S228354T... Saving S227340E... Saving S227895C... Saving S227861S... Saving S227855E... Saving S227776V... Saving S227698H... Getting applications for Greater Bendigo City Council... Saving S228713P... Saving S228627A... Saving S228609C... Saving S228604B... Saving S228350M... Saving S228332S... Saving S228085V... Saving S228174A... Saving S228122S... Saving S227936E... Saving S227912M... Saving S227879A... Saving S227739J... Saving S227735C... Saving S227682S... Saving S227615B... Getting applications for Greater Shepparton City Council... Saving S228100P... Saving S227986V... Getting applications for Hepburn Shire Council... Saving S228247V... Saving S227649M... Getting applications for Hindmarsh Shire Council... Getting applications for Hobsons Bay City Council... Saving S228731J... Saving S228596P... Saving S227949J... Saving S228466T... Saving S228066E... Saving S227934P... Saving S227932A... Saving S227737T... Saving S227098M... Saving S227745V... Saving S227600E... Saving S227599M... Saving S227559P... Getting applications for Horsham Rural City Council... Saving S227493A... Getting applications for Hume City Council... Saving S228871A... Saving S227220C... Saving S228700J... Saving S228660C... Saving S228658A... Saving S228638M... Saving S228549J... Saving S228396H... Saving S227928C... Saving S228315S... Saving S228303H... Saving S228004E... Saving S227846H... Saving S227264H... Saving S227727B... Saving S221075H... Saving S221077A... Saving S227518V... Getting applications for Indigo Shire Council... Saving S228532A... Saving S227924V... Saving S227837J... Getting applications for Kingston City Council... Saving S228897H... Saving S228464C... Saving S228257P... Saving S228126A... Saving S228099V... Saving S228016P... Saving S227796H... Saving S227672A... Saving S227683M... Saving S227350A... Getting applications for Knox City Council... Saving S228503P... Saving S227293S... Saving S228031A... Saving S227993C... Saving S227878C... Saving S227840J... Saving S227752C... Getting applications for Latrobe City Council... Saving S228551P... Saving S217493M... Saving S227563J... Getting applications for Loddon Shire Council... Getting applications for Macedon Ranges Shire Council... Saving S228851M... Saving S228725A... Saving S228624M... Saving S228619V... Saving S228467P... Saving S227799T... Saving S227638A... Saving S227521V... Getting applications for Manningham City Council... Saving S228747B... Saving S228185M... Saving S228487B... Saving S228498P... Saving S228493M... Saving S228413S... Saving S212985V... Saving S228389B... Saving S228279S... Saving S228231E... Saving S228201B... Saving S228144T... Saving S228075C... Saving S228061C... Saving S227983J... Saving S227955V... Saving S227891V... Saving S227881C... Saving S227806J... Saving S227718C... Saving S227611T... Saving S227541H... Getting applications for Mansfield Shire Council... Saving S228235M... Saving S222379B... Getting applications for Maribyrnong City Council... Saving S224747V... Saving S228539S... Saving S228328V... Saving S228212P... Saving S228155H... Saving S228111C... Saving S228084B... Saving S228040V... Saving S228039M... Saving S227907V... Getting applications for Maroondah City Council... Saving S228618B... Saving S228706H... Saving S228348H... Saving S228272A... Saving S228076A... Saving S228094T... Saving S228088H... Saving S227882A... Saving S227992H... Saving S227973S... Saving S227920P... Saving S227877H... Saving S227888V... Saving S227842B... Saving S227748H... Getting applications for Melbourne City Council... Saving S227528P... Getting applications for Melton City Council... Saving S226136P... Saving S228575H... Saving S228508S... Saving S228472E... Saving S228437J... Saving S228374E... Saving S225261T... Saving S225266V... Saving S227807E... Saving S226879J... Getting applications for Merri-Bek City Council... Saving S228753M... Saving S228744P... Saving S228729E... Saving S228617E... Saving S228620E... Saving S228523B... Saving S228520P... Saving S228425B... Saving S228256T... Saving S228001T... Saving S227901A... Saving S227880H... Saving S227811B... Saving S227793V... Saving S222384S... Saving S227694B... Saving S227391S... Getting applications for Mildura Rural City Council... Saving S228521J... Saving S228461S... Saving S228146J... Saving S227308V... Getting applications for Minister for Planning - Others... Getting applications for Minister for Planning - Social Housing... Getting applications for Mitchell Shire Council... Saving S228344B... Saving S228127T... Saving S227609P... Saving S227902T... Getting applications for Moira Shire Council... Saving S224993M... Saving S228314V... Saving S228411B... Saving S227420J... Saving S227801H... Getting applications for Monash City Council... Saving S228740H... Saving S228688C... Saving S228481C... Saving S228345V... Saving S228290T... Saving S228246B... Saving S228059A... Saving S227031J... Saving S227969V... Saving S227866T... Saving S227617S... Saving S227645E... Saving S227393H... Getting applications for Moonee Valley City Council... Saving S228799H... Saving S228490B... Saving S228405P... Saving S228252M... Saving S227911S... Saving S228077T... Saving S227995T... Saving S227526A... Saving S227763S... Saving S227744B... Saving S226817J... Saving S227561T... Getting applications for Moorabool Shire Council... Saving S227988M... Getting applications for Mornington Peninsula Shire Council... Saving S228651E... Saving S228507V... Saving S228462M... Saving S224899T... Saving S228318C... Saving S228301S... Saving S227646B... Saving S228200E... Saving S228151B... Saving S227557A... Saving S227930H... Saving S227925S... Saving S227886E... Saving S227862M... Saving S227788E... Saving S227477T... Saving S227684H... Saving S227637C... Saving S227641A... Saving S227570S... Saving S227395A... Saving S227535V... Getting applications for Mount Alexander Shire Council... Saving S227656T... Saving S227883T... Getting applications for Moyne Shire Council... Saving S228469E... Saving S227821T... Saving S227519S... Getting applications for Murrindindi Shire Council... Saving S227885J... Getting applications for Nillumbik Shire Council... Saving S228316M... Saving S227742J... Getting applications for Northern Grampians Shire Council... Saving S228659T... Saving S227985B... Getting applications for Port Phillip City Council... Saving S228633J... Saving S228441E... Saving S228346S... Saving S228213J... Saving S227896A... Saving S227304P... Getting applications for Pyrenees Shire Council... Saving S227814M... Getting applications for Rural City of Wangaratta... Saving S227195S... Getting applications for Shire of Campaspe... Getting applications for South Gippsland Shire Council... Saving S228244J... Saving S228196B... Saving S223331C... Saving S227853P... Saving S227927H... Saving S227887B... Saving S227875S... Saving S227873B... Saving S227761B... Saving S227629B... Saving S227602V... Saving S226924H... Getting applications for Southern Grampians Shire Council... Saving S228021E... Saving S227534B... Saving S227148M... Getting applications for Stonnington City Council... Saving S228339J... Saving S228553E... Saving S228739A... Saving S228240C... Saving S228072S... Saving S228065J... Saving S228046T... Saving S227722A... Saving S227596B... Saving S227092P... Saving S227605H... Getting applications for Strathbogie Shire Council... Saving S227537M... Getting applications for Surf Coast Shire Council... Saving S228499J... Saving S228505E... Saving S227708J... Saving S227619H... Getting applications for Swan Hill Rural City Council... Getting applications for Towong Shire Council... Saving S227991M... Getting applications for Warrnambool City Council... Saving S228420A... Saving S228363S... Saving S227868J... Getting applications for Wellington Shire Council... Saving S228742A... Saving S228595T... Saving S228573S... Saving S228501A... Saving S228453P... Saving S228451A... Saving S228258J... Saving S228209P... Saving S227773J... Saving S227336J... Saving S227700V... Saving S227713B... Saving S227531P... Saving S227481P... Getting applications for West Wimmera Shire Council... Getting applications for Whitehorse City Council... Saving S228712T... Saving S228676T... Saving S228654S... Saving S228594A... Saving S228327B... Saving S228436P... Saving S228184S... Saving S228335C... Saving S228321C... Saving S228181E... Saving S228107H... Saving S227817A... Saving S228027C... Saving S227951P... Saving S227933T... Saving S227869E... Saving S227648S... Saving S227444C... Saving S227658J... Getting applications for Whittlesea City Council... Saving S228721S... Saving S228711A... Saving S227670H... Saving S228261J... Saving S223319E... Saving S227884P... Saving S227890B... Saving S227381A... Saving S227717H... Saving S227525C... Saving S227524H... Saving S226517M... Getting applications for Wyndham City Council... Saving S228867C... Saving S228406J... Saving S174019T... Saving S223026P... Saving S228140M... Saving S197805J... Saving S228149V... Saving S228063T... Saving S227935J... Saving S227913H... Saving S227703H... Saving S227702M... Saving S227827S... Saving S227802C... Saving S227764M... Saving S227538H... Saving S227533E... Getting applications for Yarra City Council... Saving S228720V... Saving S228087M... Saving S227952J... Saving S227931C... Saving S227711J... Saving S227701S... Getting applications for Yarra Ranges Shire Council... Saving S228136S... Saving S228024S... Saving S227892S... Saving S227977A... Saving S227945C... Saving S227918J... Getting applications for Yarriambiack Shire Council... Saving S226221J... Saving S227159B...

Data

Downloaded 73331 times by slav123 openaustralia LoveMyData dcalde mlandauer DevAppProject jesse-a-reilly GitHubMLee TheZepto srsmonty AriesXIX parsaie TornMarketing cankei NicMeg planningalerts-scrapers odnagroup ponynoble Elliehancock Jedwards157 AndreM101 93399339

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (50.1 MB) Use the API

rows 10 / 129797

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S026214J&cacheApplicationListContext=true
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
2 lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S024425C&cacheApplicationListContext=true
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S025191P&cacheApplicationListContext=true
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S010773J&cacheApplicationListContext=true
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S018317C&cacheApplicationListContext=true
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S013074J&cacheApplicationListContext=true
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S016718J&cacheApplicationListContext=true
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023304S&cacheApplicationListContext=true
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S021086C&cacheApplicationListContext=true
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
Two lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023932B&cacheApplicationListContext=true
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml

Statistics

Average successful run time: 15 minutes

Total run time: about 1 month

Total cpu time used: about 8 hours

Total disk space used: 50.1 MB

History

  • Auto ran revision b640683c and completed successfully .
    582 records added, 546 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    590 records added, 536 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    579 records added, 552 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    582 records added, 529 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    530 records added, 530 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

spear / scraper.rb