planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria


Contributors CloCkWeRX henare mlandauer archoo

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/........... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Fetching mime-types-data 3.2021.0225 [1G Fetching multi_xml 0.6.0 [1G Using bundler 1.15.2 [1G Fetching httpclient 2.8.3 [1G Installing multi_xml 0.6.0 [1G Installing mime-types-data 3.2021.0225 [1G Fetching sqlite3 1.4.2 [1G Installing httpclient 2.8.3 [1G Fetching mime-types 3.3.1 [1G Installing mime-types 3.3.1 [1G Fetching httparty 0.18.1 [1G Installing sqlite3 1.4.2 with native extensions [1G Installing httparty 0.18.1 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Bundle complete! 2 Gemfile dependencies, 9 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Post-install message from httparty: [1G When you HTTParty, you must party hard! [1G Bundle completed (4.78s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Getting applications for Alpine Shire Council - Bright Office... Saving S233512E... Saving S233517H... Saving S233376P... Saving S233328P... Getting applications for Ararat Rural City Council... Saving S232964M... Getting applications for Ballarat City Council... Saving S232863B... Saving S232600A... Saving S232771M... Saving S226861C... Saving S231541M... Getting applications for Banyule City Council... Saving S233873H... Saving S233662M... Saving S233454C... Saving S233501S... Saving S232826P... Saving S233119J... Saving S233081H... Saving S232544M... Saving S232648J... Saving S232584J... Saving S232427V... Saving S232391J... Saving S232418A... Getting applications for Bass Coast Shire Council... Saving S233703P... Saving S233242M... Saving S225769M... Saving S232848S... Saving S232815B... Saving S232457B... Saving S232637V... Saving S232573V... Saving S232532C... Saving S232470T... Getting applications for Baw Baw Shire Council... Saving S233783J... Saving S233572P... Saving S233346J... Saving S233058V... Saving S233057B... Saving S233061V... Saving S232776P... Saving S232775T... Saving S232190H... Saving S232639M... Saving S232558M... Saving S232291T... Saving S232385A... Getting applications for Bayside City Council... Saving S232833V... Saving S232932S... Saving S233245A... Saving S232570J... Saving S233069J... Saving S232474B... Saving S232433H... Saving S232405T... Saving S232380V... Saving S232332V... Saving S232007V... Getting applications for Benalla Rural City Council... Saving S233333E... Saving S233174S... Getting applications for Boroondara City Council... Saving S233616C... Saving S233380J... Saving S233232T... Saving S232556V... Saving S233088B... Saving S233028S... Saving S232185S... Saving S232644C... Saving S232783V... Saving S232548T... Saving S232425E... Getting applications for Borough of Queenscliffe... Saving S233431E... Saving S232553J... Getting applications for Brimbank City Council... Saving S233608B... Saving S233466M... Saving S231314M... Saving S233458J... Saving S233418M... Saving S233252E... Saving S233136J... Saving S232386T... Saving S231310E... Saving S228748V... Saving S232610S... Saving S232571E... Saving S232552P... Saving S231529P... Saving S232424J... Getting applications for Buloke Shire Council... Saving S233394J... Saving S231315H... Saving S231312V... Getting applications for Cardinia Shire Council... Saving S233682A... Saving S233409P... Saving S233408T... Saving S233399M... Saving S233447V... Saving S233446B... Saving S233445E... Saving S233444J... Saving S233424A... Saving S233422H... Saving S232950M... Saving S233420S... Saving S233391A... Saving S232312J... Saving S232602P... Saving S232749V... Saving S232635E... Saving S232279V... Saving S232399A... Saving S232449A... Getting applications for Casey City Council... Saving S233842H... Saving S233764T... Saving S233633C... Saving S233386H... Saving S233628M... Saving S233570A... Saving S233531V... Saving S233495V... Saving S233400E... Saving S233390C... Saving S233351B... Saving S225211C... Saving S233139V... Saving S233120T... Saving S232690M... Saving S232689C... Saving S232685V... Saving S232668V... Saving S232908J... Saving S233022T... Saving S232948H... Saving S232852M... Saving S232135B... Saving S232130A... Saving S232127A... Saving S209576T... Saving S232707H... Saving S225219S... Saving S232502A... Saving S232421A... Saving S232376B... Getting applications for Central Goldfields Shire Council... Getting applications for City of Greater Dandenong... Saving S233264P... Saving S232410J... Getting applications for City of Greater Geelong... Saving S233847J... Saving S233838M... Saving S233844A... Saving S233779P... Saving S233710V... Saving S233697T... Saving S233694H... Saving S233561B... Saving S233491P... Saving S228079J... Saving S233459E... Saving S233301J... Saving S232923T... Saving S232922A... Saving S213951A... Saving S233184J... Saving S233153J... Saving S233087E... Saving S232977S... Saving S231948T... Saving S231950A... Saving S231952P... Saving S228480H... Saving S232506E... Saving S232371A... Getting applications for City of Wodonga... Saving S233798E... Saving S233111V... Saving S232638S... Getting applications for Colac Otway Shire... Saving S233762C... Saving S233563S... Saving S233559V... Saving S233241S... Saving S233045S... Saving S231993H... Saving S232606V... Saving S232496C... Getting applications for Corangamite Shire Council... Saving S233398S... Saving S232888P... Saving S232960E... Saving S232480M... Getting applications for Darebin City Council... Saving S233664C... Saving S233613S... Saving S233547M... Saving S233201T... Saving S233148T... Saving S232989B... Saving S233040P... Saving S232994S... Saving S232890T... Saving S232677T... Saving S232634J... Saving S232599E... Saving S232561M... Saving S232476S... Saving S232406P... Saving S223322E... Getting applications for East Gippsland Shire Council... Saving S233017C... Saving S232739C... Saving S233014S... Saving S232879S... Saving S232875J... Saving S231194B... Saving S232691H... Saving S232607S... Saving S232574S... Saving S232576H... Getting applications for Frankston City Council... Saving S233484H... Saving S233354M... Saving S233210S... Saving S231783H... Saving S233063M... Saving S233071P... Saving S232930B... Saving S232856T... Saving S232649E... Saving S232645A... Saving S232581A... Saving S232416H... Saving S232473E... Getting applications for Gannawarra Shire Council... Saving S232998A... Saving S232021J... Getting applications for Glen Eira City Council... Saving S233925A... Saving S233257H... Saving S233567A... Saving S233441A... Saving S233837S... Saving S231488M... Saving S233456T... Saving S233522A... Saving S233231A... Saving S233187V... Saving S233076S... Saving S232883M... Saving S232792T... Saving S232770S... Saving S232774A... Saving S207985C... Saving S207983M... Saving S232575M... Saving S232565T... Saving S232511V... Saving S232451C... Saving S231816H... Saving S232402H... Getting applications for Glenelg Shire Council... Saving S233200A... Saving S233073E... Saving S232984A... Saving S232493S... Saving S232452A... Getting applications for Golden Plains Shire Council... Saving S233189M... Saving S232943E... Saving S233046M... Saving S232393B... Saving S232655S... Saving S232438J... Saving S232495H... Getting applications for Greater Bendigo City Council... Saving S233538P... Saving S233523T... Saving S233465S... Saving S233438A... Saving S233188S... Saving S233051C... Saving S233049A... Saving S232992B... Saving S232777J... Saving S232323A... Saving S232731P... Saving S232666E... Saving S232619B... Saving S232618E... Saving S232579T... Saving S232550A... Saving S232215E... Saving S232379M... Saving S231940E... Getting applications for Greater Shepparton City Council... Saving S233719E... Saving S229340H... Saving S229719B... Saving S233413J... Saving S231825E... Saving S233133A... Saving S232756C... Saving S232563C... Saving S232545H... Getting applications for Hepburn Shire Council... Saving S233077M... Saving S233124B... Saving S233125V... Saving S233074B... Saving S232338T... Saving S232757A... Getting applications for Hindmarsh Shire Council... Getting applications for Hobsons Bay City Council... Saving S233922M... Saving S233775H... Saving S233741V... Saving S233556J... Saving S233373C... Saving S233167J... Saving S233062S... Saving S232909E... Saving S221202B... Saving S221200J... Saving S221196E... Saving S221193T... Saving S232580C... Saving S232301V... Saving S232013H... Saving S232042S... Saving S232149B... Getting applications for Horsham Rural City Council... Saving S233306M... Saving S233285V... Getting applications for Hume City Council... Saving S233917V... Saving S233802J... Saving S233754B... Saving S233263T... Saving S217761P... Saving S232806C... Saving S233048C... Saving S233024J... Saving S232283S... Saving S232939J... Saving S232854C... Saving S232654V... Saving S232627C... Saving S232597P... Saving S232471P... Getting applications for Indigo Shire Council... Getting applications for Kingston City Council... Saving S233687B... Saving S233785B... Saving S233686E... Saving S233461J... Saving S233726M... Saving S233004A... Saving S233325C... Saving S233437C... Saving S231111T... Saving S233320B... Saving S233114H... Saving S233143S... Saving S233027V... Saving S232995M... Saving S232812P... Saving S232116J... Saving S232750E... Saving S231984J... Saving S232528H... Saving S232587V... Saving S232064T... Saving S232566P... Saving S232537E... Saving S232479C... Getting applications for Knox City Council... Saving S233815P... Saving S232568E... Saving S233771B... Saving S233641E... Saving S233404M... Saving S233327T... Saving S233322S... Saving S232560S... Saving S233117T... Saving S233094M... Saving S232951H... Saving S232904C... Saving S232881V... Saving S231250M... Saving S232555B... Saving S229766E... Saving S232412B... Saving S232409B... Getting applications for Latrobe City Council... Saving S233758H... Saving S233529S... Saving S233426P... Saving S233407A... Saving S232853H... Saving S232850V... Saving S232368A... Getting applications for Loddon Shire Council... Saving S232384C... Saving S229651T... Getting applications for Macedon Ranges Shire Council... Saving S233807M... Saving S233121P... Saving S232751B... Getting applications for Manningham City Council... Saving S233788M... Saving S233756S... Saving S233560E... Saving S233496S... Saving S209085M... Saving S233332J... Saving S233358T... Saving S233078H... Saving S233319S... Saving S233205B... Saving S233050H... Saving S233011E... Saving S232900V... Saving S232873T... Saving S232174C... Saving S232718V... Saving S232535P... Saving S232531H... Saving S232529C... Saving S232413V... Getting applications for Mansfield Shire Council... Saving S233108V... Saving S232877B... Saving S232450H... Saving S232459S... Getting applications for Maribyrnong City Council... Saving S232965H... Saving S233091B... Saving S233084T... Saving S232616P... Getting applications for Maroondah City Council... Saving S233759C... Saving S233568T... Saving S233402V... Saving S232346V... Saving S230168P... Saving S232546C... Saving S232381S... Getting applications for Melbourne City Council... Saving S233207S... Saving S232071B... Saving S232695P... Saving S232692C... Saving S232313E... Getting applications for Melton City Council... Saving S233684P... Saving S233666T... Saving S233587J... Saving S233226H... Saving S233387C... Saving S233353S... Saving S223543T... Saving S233129C... Saving S232641S... Saving S232620J... Saving S232447H... Saving S232444V... Getting applications for Merri-Bek City Council... Saving S233769V... Saving S233753E... Saving S233711S... Saving S231907B... Saving S232125H... Saving S224506V... Saving S233653P... Saving S233369H... Saving S233352V... Saving S233269S... Saving S233144M... Saving S221064T... Saving S232962V... Saving S232958B... Saving S232679J... Saving S232797V... Saving S232740M... Saving S228528C... Saving S232614A... Saving S232596T... Saving S232554E... Saving S232508V... Getting applications for Mildura Rural City Council... Saving S233442T... Saving S233365B... Saving S233363J... Saving S233271V... Saving S231276V... Saving S232582T... Getting applications for Minister for Planning - Others... Getting applications for Minister for Planning - Social Housing... Getting applications for Mitchell Shire Council... Saving S233396B... Saving S233385M... Saving S233359P... Saving S233118P... Saving S233329J... Saving S233236B... Saving S233224S... Saving S232988E... Saving S232536J... Saving S232629T... Saving S232742C... Saving S232154S... Getting applications for Moira Shire Council... Saving S233878J... Saving S233494B... Saving S232464H... Saving S232187H... Saving S233165T... Saving S232598J... Saving S232919A... Saving S232730T... Getting applications for Monash City Council... Saving S233872M... Saving S233646H... Saving S233388A... Saving S233410A... Saving S233278P... Saving S233216P... Saving S233066A... Saving S232772H... Saving S232665J... Saving S232530M... Saving S232516A... Saving S232417C... Saving S232375E... Saving S232369T... Getting applications for Moonee Valley City Council... Saving S233580S... Saving S233537T... Saving S232928V... Saving S233324H... Saving S232303M... Saving S233155B... Saving S233151T... Saving S232714P... Saving S202972E... Saving S232796B... Saving S232719S... Saving S232699V... Saving S232559H... Saving S232292P... Saving S232383H... Saving S232310T... Saving S232202B... Saving S232206H... Getting applications for Moorabool Shire Council... Saving S232670B... Saving S232874P... Saving S232382M... Getting applications for Mornington Peninsula Shire Council... Saving S233601H... Saving S233452M... Saving S229793A... Saving S233357A... Saving S233266E... Saving S233314P... Saving S192598T... Saving S233156V... Saving S233191S... Saving S233105J... Saving S232374J... Saving S231217H... Saving S232667B... Saving S232633P... Saving S232590V... Saving S232482C... Saving S232422T... Getting applications for Mount Alexander Shire Council... Saving S233250P... Saving S232917H... Saving S233198J... Saving S226321B... Saving S232708C... Saving S232694T... Saving S231884T... Saving S232577C... Saving S232557S... Saving S232498T... Saving S232497A... Saving S232494M... Saving S232280E... Saving S223291V... Getting applications for Moyne Shire Council... Saving S232982H... Getting applications for Murrindindi Shire Council... Saving S232849M... Getting applications for Nillumbik Shire Council... Saving S231985E... Saving S231364C... Getting applications for Northern Grampians Shire Council... Saving S233596H... Saving S232520T... Getting applications for Port Phillip City Council... Saving S233273M... Saving S232112C... Saving S233220J... Saving S232855A... Saving S232625M... Saving S232408E... Saving S232407J... Saving S232378S... Getting applications for Pyrenees Shire Council... Saving S233429B... Saving S233168E... Saving S232624S... Saving S232623V... Saving S232622B... Getting applications for Rural City of Wangaratta... Saving S233542J... Saving S233135P... Saving S233023P... Getting applications for Shire of Campaspe... Saving S232228J... Getting applications for South Gippsland Shire Council... Saving S233776C... Saving S232507B... Saving S233240V... Saving S232151E... Saving S232985T... Saving S232159T... Saving S232466A... Saving S232170V... Getting applications for Southern Grampians Shire Council... Saving S232656M... Saving S232662A... Saving S232752V... Saving S232659A... Getting applications for Stonnington City Council... Saving S233930P... Saving S233836V... Saving S233475J... Saving S233093S... Saving S232613C... Saving S232347S... Saving S232490E... Getting applications for Strathbogie Shire Council... Saving S233336S... Saving S233414E... Saving S233194C... Saving S232887T... Getting applications for Surf Coast Shire Council... Saving S232192A... Saving S230562E... Saving S232942J... Saving S232704V... Saving S232057M... Getting applications for Swan Hill Rural City Council... Saving S232462S... Getting applications for Towong Shire Council... Getting applications for Warrnambool City Council... Saving S232907P... Saving S232963S... Saving S232632T... Getting applications for Wellington Shire Council... Saving S233789H... Saving S233714C... Saving S233773S... Saving S233763A... Saving S233691V... Saving S233384S... Saving S233482S... Saving S233267B... Saving S233013V... Saving S233059S... Saving S232868C... Saving S233021A... Saving S232847V... Saving S232394V... Saving S232696J... Saving S232398C... Getting applications for West Wimmera Shire Council... Saving S233280T... Saving S232203V... Getting applications for Whitehorse City Council... Saving S228786C... Saving S142610T... Saving S233246T... Saving S233481V... Saving S233419H... Saving S233116A... Saving S233101C... Saving S233086J... Saving S233070T... Saving S233064H... Saving S232821M... Saving S232966C... Saving S232886A... Saving S232876E... Saving S232652E... Saving S232678P... Saving S232503T... Saving S231129B... Getting applications for Whittlesea City Council... Saving S233533M... Saving S233548H... Saving S233204E... Saving S233190V... Saving S232945V... Saving S232929S... Saving S232918C... Saving S232702E... Saving S232658C... Saving S232664P... Saving S230906S... Saving S232547A... Saving S232468P... Saving S232414S... Getting applications for Wyndham City Council... Saving S233545V... Saving S233690B... Saving S233367S... Saving S233292C... Saving S233256M... Saving S233253B... Saving S233214A... Saving S233218E... Saving S233145H... Saving S232885C... Saving S232976V... Saving S232952C... Saving S232946S... Saving S232769H... Saving S232758T... Saving S232396M... Getting applications for Yarra City Council... Saving S230823B... Saving S233712M... Saving S233619P... Saving S233275C... Saving S232609H... Saving S232859E... Saving S232663T... Saving S232612H... Getting applications for Yarra Ranges Shire Council... Saving S233337M... Saving S233223V... Saving S224191T... Saving S232715J... Getting applications for Yarriambiack Shire Council...

Data

Downloaded 76110 times by slav123 openaustralia LoveMyData dcalde mlandauer DevAppProject jesse-a-reilly GitHubMLee TheZepto srsmonty AriesXIX parsaie TornMarketing cankei NicMeg 93399339 planningalerts-scrapers odnagroup ponynoble Elliehancock Jedwards157 AndreM101

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (50.8 MB) Use the API

rows 10 / 132303

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
2012-09-17
2 lot resubdivision
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
2012-09-17
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
2012-09-17
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
2012-09-17
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
2012-09-17
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
2012-09-17
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
2012-09-17
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
2012-09-17
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
2012-09-17
Two lot resubdivision
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741

Statistics

Average successful run time: 15 minutes

Total run time: about 1 month

Total cpu time used: about 9 hours

Total disk space used: 50.8 MB

History

  • Auto ran revision b640683c and completed successfully .
    680 records added, 634 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    634 records added, 634 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    638 records added, 638 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    662 records added, 629 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    690 records added, 640 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

spear / scraper.rb