planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria

Contributors CloCkWeRX henare mlandauer archoo

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/........... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching mime-types-data 3.2021.0225 [1G Fetching multi_xml 0.6.0 [1G Fetching httpclient 2.8.3 [1G Installing multi_xml 0.6.0 [1G Installing mime-types-data 3.2021.0225 [1G Installing httpclient 2.8.3 [1G Fetching sqlite3 1.4.2 [1G Installing sqlite3 1.4.2 with native extensions [1G Fetching mime-types 3.3.1 [1G Installing mime-types 3.3.1 [1G Fetching httparty 0.18.1 [1G Installing httparty 0.18.1 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Bundle complete! 2 Gemfile dependencies, 9 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Post-install message from httparty: [1G When you HTTParty, you must party hard! [1G Bundle completed (5.02s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Getting applications for Alpine Resorts - Mt Buller... Saving S233614M... Getting applications for Alpine Shire Council - Bright Office... Saving S233512E... Saving S233517H... Saving S233376P... Saving S233328P... Getting applications for Ararat Rural City Council... Saving S232964M... Getting applications for Ballarat City Council... Saving S229091V... Saving S233780A... Saving S232700P... Saving S233492J... Saving S233448S... Saving S233326A... Saving S233215T... Saving S232863B... Saving S232600A... Saving S232771M... Getting applications for Banyule City Council... Saving S233924C... Saving S233873H... Saving S233662M... Saving S233744H... Saving S233454C... Saving S233501S... Saving S232826P... Saving S233119J... Saving S233081H... Saving S232544M... Saving S232648J... Getting applications for Bass Coast Shire Council... Saving S234139J... Saving S234035M... Saving S233703P... Saving S233242M... Saving S225769M... Saving S232848S... Saving S232815B... Getting applications for Baw Baw Shire Council... Saving S234100V... Saving S234082S... Saving S233783J... Saving S233713H... Saving S233572P... Saving S233346J... Saving S233058V... Saving S233057B... Saving S233061V... Saving S232776P... Saving S232775T... Saving S232190H... Saving S232639M... Getting applications for Bayside City Council... Saving S233841M... Saving S233803E... Saving S233679A... Saving S232833V... Saving S232932S... Saving S233245A... Saving S232570J... Saving S233069J... Getting applications for Benalla Rural City Council... Saving S233333E... Saving S233174S... Getting applications for Boroondara City Council... Saving S233793C... Saving S233772V... Saving S233616C... Saving S233380J... Saving S233232T... Saving S232556V... Saving S233088B... Saving S233028S... Saving S232185S... Saving S232644C... Saving S232783V... Getting applications for Borough of Queenscliffe... Saving S233431E... Getting applications for Brimbank City Council... Saving S234162V... Saving S234001B... Saving S233915E... Saving S233608B... Saving S233466M... Saving S231314M... Saving S233458J... Saving S233418M... Saving S233252E... Saving S233136J... Saving S232386T... Saving S231310E... Getting applications for Buloke Shire Council... Saving S233974T... Saving S233604T... Saving S233394J... Saving S231315H... Saving S231312V... Getting applications for Cardinia Shire Council... Saving S233995B... Saving S232828E... Saving S233682A... Saving S233409P... Saving S233408T... Saving S233399M... Saving S233447V... Saving S233446B... Saving S233445E... Saving S233444J... Saving S233424A... Saving S233422H... Saving S232950M... Saving S233420S... Saving S233391A... Saving S232312J... Saving S232602P... Saving S232749V... Getting applications for Casey City Council... Saving S232741H... Saving S233729A... Saving S232551T... Saving S233842H... Saving S233592B... Saving S233764T... Saving S233633C... Saving S233386H... Saving S233628M... Saving S233570A... Saving S233531V... Saving S233495V... Saving S233400E... Saving S233390C... Saving S233351B... Saving S225211C... Saving S233139V... Saving S233120T... Saving S232690M... Saving S232689C... Saving S232685V... Saving S232668V... Saving S232908J... Saving S233022T... Saving S232948H... Saving S232852M... Saving S232135B... Saving S232130A... Saving S232127A... Saving S209576T... Getting applications for Central Goldfields Shire Council... Saving S234282A... Saving S234281C... Saving S234270P... Saving S234212V... Getting applications for City of Greater Dandenong... Saving S226295T... Saving S233883B... Saving S233264P... Getting applications for City of Greater Geelong... Saving S233977E... Saving S234072A... Saving S233902B... Saving S233894P... Saving S233852B... Saving S233847J... Saving S233838M... Saving S233844A... Saving S233779P... Saving S233811H... Saving S233710V... Saving S233697T... Saving S233694H... Saving S233561B... Saving S233491P... Saving S228079J... Saving S233459E... Saving S233002H... Saving S233301J... Saving S232923T... Saving S232922A... Saving S213951A... Saving S233184J... Saving S233153J... Saving S233087E... Saving S232977S... Saving S231948T... Saving S231950A... Saving S231952P... Getting applications for City of Wodonga... Saving S234107P... Saving S233798E... Saving S233705E... Saving S233111V... Getting applications for Colac Otway Shire... Saving S233911A... Saving S233762C... Saving S233563S... Saving S233559V... Saving S233241S... Saving S233045S... Getting applications for Corangamite Shire Council... Saving S234174E... Saving S233398S... Saving S232888P... Saving S232960E... Saving S232480M... Getting applications for Darebin City Council... Saving S234044J... Saving S233946E... Saving S233858A... Saving S233733T... Saving S233664C... Saving S233613S... Saving S233547M... Saving S233201T... Saving S233148T... Saving S232989B... Saving S233040P... Saving S232994S... Saving S232890T... Getting applications for East Gippsland Shire Council... Saving S233862T... Saving S233702T... Saving S233620A... Saving S232744T... Saving S233017C... Saving S232739C... Saving S233014S... Saving S232879S... Saving S232875J... Saving S231194B... Getting applications for Frankston City Council... Saving S234057P... Saving S234033V... Saving S233484H... Saving S233354M... Saving S233210S... Saving S231783H... Saving S233060B... Saving S233063M... Saving S233071P... Saving S232930B... Saving S232856T... Getting applications for Gannawarra Shire Council... Saving S232998A... Getting applications for Glen Eira City Council... Saving S230798P... Saving S234177S... Saving S234180S... Saving S234088P... Saving S233740B... Saving S233966S... Saving S233925A... Saving S233257H... Saving S233567A... Saving S233441A... Saving S233837S... Saving S231488M... Saving S233456T... Saving S233522A... Saving S233231A... Saving S233187V... Saving S233076S... Saving S232883M... Saving S232792T... Saving S232770S... Saving S232774A... Getting applications for Glenelg Shire Council... Saving S233942A... Saving S233200A... Saving S233073E... Saving S232984A... Getting applications for Golden Plains Shire Council... Saving S233905M... Saving S233630S... Saving S233189M... Saving S232943E... Saving S233046M... Saving S232393B... Getting applications for Greater Bendigo City Council... Saving S233761H... Saving S233863P... Saving S233827A... Saving S233813A... Saving S233717P... Saving S233538P... Saving S233523T... Saving S233465S... Saving S233438A... Saving S233188S... Saving S233051C... Saving S233049A... Saving S232992B... Saving S232777J... Saving S232323A... Getting applications for Greater Shepparton City Council... Saving S234235T... Saving S234005H... Saving S233999H... Saving S233719E... Saving S229340H... Saving S229719B... Saving S233413J... Saving S231825E... Saving S233133A... Saving S232756C... Getting applications for Hepburn Shire Council... Saving S233077M... Saving S233124B... Saving S233125V... Saving S233074B... Saving S232338T... Saving S232757A... Getting applications for Hindmarsh Shire Council... Saving S233411T... Saving S231848C... Saving S232050T... Getting applications for Hobsons Bay City Council... Saving S233994E... Saving S233913P... Saving S233922M... Saving S233775H... Saving S233741V... Saving S233640J... Saving S233556J... Saving S233373C... Saving S233167J... Saving S233062S... Saving S232909E... Saving S221202B... Saving S221200J... Saving S221196E... Saving S221193T... Saving S232580C... Getting applications for Horsham Rural City Council... Saving S228705M... Saving S233092V... Saving S233306M... Saving S233285V... Getting applications for Hume City Council... Saving S234091P... Saving S233917V... Saving S233802J... Saving S233754B... Saving S233263T... Saving S217761P... Saving S232806C... Saving S233048C... Saving S233024J... Saving S232283S... Saving S232939J... Saving S232854C... Getting applications for Indigo Shire Council... Getting applications for Kingston City Council... Saving S233867V... Saving S233889A... Saving S233687B... Saving S233785B... Saving S233686E... Saving S233461J... Saving S233726M... Saving S233004A... Saving S233325C... Saving S233437C... Saving S231111T... Saving S233320B... Saving S233143S... Saving S233027V... Saving S232995M... Saving S232812P... Saving S232116J... Saving S232750E... Getting applications for Knox City Council... Saving S233815P... Saving S232568E... Saving S233771B... Saving S233641E... Saving S233404M... Saving S233327T... Saving S233322S... Saving S232560S... Saving S233117T... Saving S233094M... Saving S232951H... Saving S232904C... Saving S232881V... Getting applications for Latrobe City Council... Saving S234129S... Saving S233758H... Saving S233529S... Saving S233426P... Saving S233407A... Saving S232853H... Saving S232850V... Getting applications for Loddon Shire Council... Saving S232384C... Saving S229651T... Getting applications for Macedon Ranges Shire Council... Saving S234029B... Saving S234027J... Saving S233807M... Saving S233121P... Saving S232751B... Getting applications for Manningham City Council... Saving S234201H... Saving S234131V... Saving S234105A... Saving S233984M... Saving S233963E... Saving S233788M... Saving S233756S... Saving S233560E... Saving S233496S... Saving S209085M... Saving S233332J... Saving S233358T... Saving S233078H... Saving S233319S... Saving S233205B... Saving S233050H... Saving S233011E... Saving S232900V... Saving S232873T... Saving S232174C... Getting applications for Mansfield Shire Council... Saving S233108V... Saving S232877B... Getting applications for Maribyrnong City Council... Saving S232965H... Saving S233091B... Saving S233084T... Getting applications for Maroondah City Council... Saving S234047V... Saving S233759C... Saving S233568T... Saving S233402V... Saving S232346V... Getting applications for Melbourne City Council... Saving S233514V... Saving S233207S... Saving S232071B... Getting applications for Melton City Council... Saving S234056T... Saving S233998M... Saving S233982V... Saving S233907C... Saving S233898V... Saving S233794A... Saving S233684P... Saving S233666T... Saving S233587J... Saving S233226H... Saving S233387C... Saving S233353S... Saving S223543T... Saving S233129C... Getting applications for Merri-Bek City Council... Saving S232996H... Saving S233949S... Saving S233769V... Saving S233753E... Saving S233711S... Saving S231907B... Saving S232125H... Saving S224506V... Saving S233653P... Saving S233369H... Saving S233352V... Saving S233269S... Saving S233144M... Saving S221064T... Saving S232962V... Saving S232958B... Saving S232679J... Saving S232797V... Saving S232740M... Getting applications for Mildura Rural City Council... Saving S233442T... Saving S233365B... Saving S233363J... Saving S233271V... Saving S231276V... Getting applications for Minister for Planning - Others... Getting applications for Minister for Planning - Social Housing... Getting applications for Mitchell Shire Council... Saving S233903V... Saving S233704J... Saving S233396B... Saving S233385M... Saving S233359P... Saving S233118P... Saving S233329J... Saving S233236B... Saving S233224S... Saving S232988E... Saving S232536J... Saving S232629T... Getting applications for Moira Shire Council... Saving S233878J... Saving S233494B... Saving S232464H... Saving S232187H... Saving S233165T... Saving S232598J... Saving S232919A... Getting applications for Monash City Council... Saving S233573J... Saving S233796P... Saving S234021M... Saving S233850J... Saving S233923H... Saving S232910P... Saving S233908A... Saving S233895J... Saving S233890H... Saving S233872M... Saving S233646H... Saving S233388A... Saving S233410A... Saving S233278P... Saving S233216P... Saving S233066A... Saving S232772H... Getting applications for Moonee Valley City Council... Saving S234152C... Saving S234006C... Saving S233728C... Saving S233597C... Saving S233590J... Saving S233580S... Saving S233537T... Saving S232928V... Saving S233324H... Saving S232303M... Saving S233155B... Saving S233151T... Saving S232714P... Saving S202972E... Saving S232796B... Getting applications for Moorabool Shire Council... Saving S233699J... Saving S232670B... Saving S232874P... Getting applications for Mornington Peninsula Shire Council... Saving S234144B... Saving S234000E... Saving S233724V... Saving S233601H... Saving S233658S... Saving S233654J... Saving S233452M... Saving S229793A... Saving S233357A... Saving S233266E... Saving S233314P... Saving S192598T... Saving S233156V... Saving S233191S... Saving S233105J... Saving S232374J... Saving S231217H... Getting applications for Mount Alexander Shire Council... Saving S233250P... Saving S232917H... Saving S233198J... Saving S226321B... Getting applications for Moyne Shire Council... Saving S234026P... Saving S232982H... Getting applications for Murrindindi Shire Council... Saving S234048S... Saving S232849M... Getting applications for Nillumbik Shire Council... Saving S233938C... Saving S231985E... Saving S231364C... Getting applications for Northern Grampians Shire Council... Saving S233596H... Getting applications for Port Phillip City Council... Saving S234175B... Saving S234055A... Saving S234052M... Saving S233832P... Saving S233273M... Saving S233220J... Saving S232855A... Saving S232625M... Getting applications for Pyrenees Shire Council... Saving S233429B... Saving S233168E... Getting applications for Rural City of Wangaratta... Saving S233542J... Saving S233135P... Saving S233023P... Getting applications for Shire of Campaspe... Saving S233393P... Getting applications for South Gippsland Shire Council... Saving S234097M... Saving S234092J... Saving S233776C... Saving S232507B... Saving S233240V... Saving S232151E... Saving S232985T... Saving S232159T... Getting applications for Southern Grampians Shire Council... Saving S232656M... Saving S232662A... Saving S232752V... Saving S232659A... Getting applications for Stonnington City Council... Saving S233546S... Saving S234289S... Saving S234183C... Saving S234043P... Saving S234041A... Saving S233668J... Saving S233930P... Saving S233836V... Saving S233475J... Saving S233093S... Getting applications for Strathbogie Shire Council... Saving S233737B... Saving S233555P... Saving S233336S... Saving S233414E... Saving S233194C... Saving S232887T... Getting applications for Surf Coast Shire Council... Saving S232192A... Saving S230562E... Saving S232942J... Getting applications for Swan Hill Rural City Council... Getting applications for Towong Shire Council... Getting applications for Warrnambool City Council... Saving S232907P... Saving S232963S... Getting applications for Wellington Shire Council... Saving S234153A... Saving S234017S... Saving S233975P... Saving S233910C... Saving S233789H... Saving S233714C... Saving S233773S... Saving S233763A... Saving S233691V... Saving S233384S... Saving S233482S... Saving S233267B... Saving S233013V... Saving S233059S... Saving S232868C... Saving S233021A... Saving S232847V... Getting applications for West Wimmera Shire Council... Saving S233280T... Saving S232203V... Getting applications for Whitehorse City Council... Saving S233948V... Saving S233851E... Saving S232864V... Saving S228786C... Saving S142610T... Saving S233246T... Saving S233481V... Saving S233419H... Saving S233116A... Saving S233101C... Saving S233086J... Saving S233070T... Saving S233064H... Saving S232821M... Saving S232966C... Saving S232886A... Saving S232876E... Saving S232652E... Getting applications for Whittlesea City Council... Saving S233864J... Saving S233830A... Saving S233856H... Saving S233845T... Saving S233533M... Saving S233548H... Saving S233204E... Saving S233190V... Saving S232945V... Saving S232929S... Saving S232918C... Saving S232702E... Saving S232658C... Getting applications for Wyndham City Council... Saving S234063B... Saving S233545V... Saving S233690B... Saving S233558B... Saving S233367S... Saving S233292C... Saving S233256M... Saving S233253B... Saving S233214A... Saving S233218E... Saving S233145H... Saving S232885C... Saving S232976V... Saving S232952C... Saving S232946S... Saving S232082P... Saving S232769H... Saving S232758T... Getting applications for Yarra City Council... Saving S233962J... Saving S230823B... Saving S233712M... Saving S233619P... Saving S233275C... Saving S232609H... Saving S232859E... Getting applications for Yarra Ranges Shire Council... Saving S234111J... Saving S233337M... Saving S233223V... Saving S224191T... Getting applications for Yarriambiack Shire Council...

Data

Downloaded 76223 times by slav123 openaustralia LoveMyData dcalde mlandauer DevAppProject jesse-a-reilly GitHubMLee TheZepto srsmonty AriesXIX parsaie TornMarketing cankei NicMeg 93399339 planningalerts-scrapers odnagroup ponynoble Elliehancock Jedwards157 AndreM101

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (50.8 MB) Use the API

rows 10 / 132466

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S026214J&cacheApplicationListContext=true
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
2 lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S024425C&cacheApplicationListContext=true
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S025191P&cacheApplicationListContext=true
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S010773J&cacheApplicationListContext=true
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S018317C&cacheApplicationListContext=true
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S013074J&cacheApplicationListContext=true
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S016718J&cacheApplicationListContext=true
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023304S&cacheApplicationListContext=true
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S021086C&cacheApplicationListContext=true
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
Two lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023932B&cacheApplicationListContext=true
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml

Statistics

Average successful run time: 15 minutes

Total run time: about 1 month

Total cpu time used: about 9 hours

Total disk space used: 50.9 MB

History

  • Auto ran revision b640683c and completed successfully .
    642 records added, 593 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    642 records added, 608 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    666 records added, 629 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    679 records added, 636 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    680 records added, 634 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

spear / scraper.rb