planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria

Contributors CloCkWeRX henare mlandauer archoo

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-2.5.1 [1G-----> Installing dependencies using bundler version 1.15.2 [1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G Fetching gem metadata from https://rubygems.org/........... [1G Fetching version metadata from https://rubygems.org/. [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 1.15.2 [1G Fetching mime-types-data 3.2021.0225 [1G Fetching multi_xml 0.6.0 [1G Fetching httpclient 2.8.3 [1G Installing multi_xml 0.6.0 [1G Installing mime-types-data 3.2021.0225 [1G Installing httpclient 2.8.3 [1G Fetching sqlite3 1.4.2 [1G Fetching mime-types 3.3.1 [1G Installing mime-types 3.3.1 [1G Installing sqlite3 1.4.2 with native extensions [1G Fetching httparty 0.18.1 [1G Installing httparty 0.18.1 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Bundle complete! 2 Gemfile dependencies, 9 gems now installed. [1G Gems in the groups development and test were not installed. [1G Bundled gems are installed into ./vendor/bundle. [1G Post-install message from httparty: [1G When you HTTParty, you must party hard! [1G Bundle completed (7.45s) [1G Cleaning up the bundler cache. [1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. [1G-----> Detecting rake tasks [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Getting applications for Alpine Shire Council - Bright Office... Saving S209232S... Getting applications for Ararat Rural City Council... Saving S201027J... Saving S209573H... Saving S199123V... Saving S208532B... Getting applications for Ballarat City Council... Saving S210033T... Saving S209933A... Saving S209871P... Saving S209535B... Saving S209534E... Saving S209378C... Saving S206121V... Saving S209233M... Saving S209210P... Saving S209189J... Getting applications for Banyule City Council... Saving S210556V... Saving S210527M... Saving S210402H... Saving S210222M... Saving S209972B... Saving S209955B... Saving S209877M... Saving S209876S... Saving S208880A... Saving S209863M... Saving S209436E... Saving S205241J... Saving S205851A... Saving S209340J... Saving S208539T... Getting applications for Bass Coast Shire Council... Saving S210358E... Saving S210184V... Saving S210153V... Saving S210143C... Saving S209987V... Saving S209836T... Saving S209404J... Saving S209558A... Saving S209705C... Saving S209702S... Saving S209433T... Saving S208891M... Saving S209324E... Saving S209451P... Saving S208345A... Saving S209368J... Saving S207845P... Saving S209279H... Saving S209076P... Getting applications for Baw Baw Shire Council... Saving S210462S... Saving S209286P... Saving S210051P... Saving S210179E... Saving S210125H... Saving S210002T... Saving S208735T... Getting applications for Bayside City Council... Saving S210364S... Saving S210168S... Saving S209928H... Saving S210145T... Saving S210034P... Saving S210026M... Saving S209812B... Saving S209699H... Saving S209617V... Saving S209462C... Saving S207793A... Saving S209390B... Saving S209363H... Saving S209293V... Saving S209208J... Saving S209161J... Saving S189647H... Getting applications for Benalla Rural City Council... Getting applications for Boroondara City Council... Saving S210012M... Saving S210013H... Saving S210015A... Saving S209965T... Saving S209168C... Saving S209785A... Saving S209768A... Saving S209571S... Saving S209594P... Saving S209557C... Saving S209459C... Saving S209435J... Saving S208334J... Getting applications for Borough of Queenscliffe... Getting applications for Brimbank City Council... Saving S210590V... Saving S210522J... Saving S210429M... Saving S210294E... Saving S210102J... Saving S209980C... Saving S209964A... Saving S209874B... Saving S209835A... Saving S209792E... Saving S209655C... Saving S209551E... Saving S209612T... Saving S209529P... Saving S209452J... Saving S209298A... Saving S209356B... Saving S209353P... Saving S208977P... Saving S208400P... Saving S209184H... Saving S209100E... Saving S209042C... Getting applications for Buloke Shire Council... Saving S209013T... Getting applications for Cardinia Shire Council... Saving S210356P... Saving S210376B... Saving S210061H... Saving S208611J... Saving S201977T... Saving S209012A... Saving S209011C... Saving S208982E... Saving S209607C... Saving S209442S... Saving S209401A... Saving S209135M... Saving S197135C... Getting applications for Casey City Council... Saving S210599E... Saving S210597P... Saving S210165E... Saving S210349H... Saving S210348M... Saving S209453E... Saving S210214J... Saving S210082P... Saving S210074M... Saving S209819T... Saving S209285T... Saving S209947A... Saving S209942V... Saving S209939V... Saving S208910M... Saving S209895H... Saving S209682V... Saving S209609T... Saving S209472V... Saving S208641P... Saving S204336V... Saving S209323J... Saving S209261B... Saving S206573S... Saving S209195V... Saving S209185C... Saving S209127J... Getting applications for Central Goldfields Shire Council... Getting applications for City of Greater Dandenong... Saving S210301V... Saving S210142H... Saving S210069V... Saving S209982T... Saving S209907B... Saving S209737A... Saving S209639A... Saving S209532P... Getting applications for City of Greater Geelong... Saving S210644C... Saving S210630C... Saving S210578A... Saving S208515B... Saving S210501C... Saving S210300B... Saving S210199S... Saving S209391V... Saving S210088M... Saving S210046A... Saving S210041V... Saving S209989M... Saving S209889V... Saving S209831S... Saving S209802H... Saving S209621S... Saving S209597B... Saving S209574C... Saving S209563P... Saving S209555M... Saving S209454B... Saving S209449J... Saving S209420P... Saving S209354J... Saving S209212E... Saving S209199C... Saving S209194B... Saving S209107A... Saving S209147V... Saving S209139T... Getting applications for City of Wodonga... Saving S210068B... Getting applications for Colac Otway Shire... Saving S210514H... Saving S210509S... Saving S210481H... Saving S210422T... Saving S210421A... Saving S209990V... Saving S209988S... Saving S209767C... Saving S209757J... Saving S209693J... Saving S207384M... Saving S209578J... Saving S209514T... Saving S209325B... Saving S209319P... Getting applications for Corangamite Shire Council... Saving S210430V... Saving S210428S... Saving S210202B... Saving S209983P... Saving S209681B... Saving S209250M... Saving S209269P... Saving S209121M... Getting applications for Darebin City Council... Saving S210524B... Saving S209961M... Saving S210138M... Saving S209875V... Saving S209765M... Saving S209739P... Saving S209678B... Saving S209437B... Saving S209204C... Getting applications for East Gippsland Shire Council... Saving S210020P... Saving S209886J... Saving S209885P... Saving S209608A... Saving S209397T... Saving S209549B... Saving S209541M... Saving S209438V... Saving S209225J... Saving S209222A... Saving S209197M... Getting applications for Frankston City Council... Saving S210314B... Saving S210112C... Saving S210110M... Saving S209575A... Saving S209562T... Saving S209441V... Saving S209358S... Saving S209216M... Getting applications for Gannawarra Shire Council... Saving S209684M... Saving S209320A... Getting applications for Glen Eira City Council... Saving S210586B... Saving S210512S... Saving S209904P... Saving S210353C... Saving S210342P... Saving S210297S... Saving S209801M... Saving S210197B... Saving S210159T... Saving S210024V... Saving S209958M... Saving S208997B... Saving S209416T... Saving S209758E... Saving S209701V... Saving S209516J... Saving S209446A... Saving S209424V... Saving S209266C... Saving S209202M... Saving S209236A... Saving S190620S... Getting applications for Glenelg Shire Council... Getting applications for Golden Plains Shire Council... Saving S210588S... Saving S210476S... Saving S210346V... Saving S210053E... Saving S209502J... Getting applications for Greater Bendigo City Council... Saving S210190H... Saving S210338T... Saving S210273A... Saving S210261P... Saving S210163P... Saving S210029A... Saving S210022E... Saving S209977C... Saving S209929C... Saving S209865C... Saving S209829M... Saving S209805T... Saving S209783H... Saving S209068M... Saving S209667M... Saving S209490S... Saving S209347C... Saving S209304T... Saving S209274E... Saving S209247M... Getting applications for Greater Shepparton City Council... Saving S210386T... Saving S210274T... Saving S209917T... Saving S209905J... Saving S206800B... Saving S209685H... Saving S208526P... Getting applications for Hepburn Shire Council... Saving S210224C... Saving S209837P... Saving S209203H... Saving S204049C... Saving S209159E... Saving S209137C... Getting applications for Hindmarsh Shire Council... Getting applications for Hobsons Bay City Council... Saving S210374J... Saving S210205M... Saving S210080A... Saving S208480J... Saving S209902A... Saving S209800S... Saving S204917B... Saving S209669C... Saving S209589A... Saving S209565E... Saving S209539H... Saving S209542H... Saving S209530A... Saving S209313S... Saving S209526C... Saving S209473S... Saving S208463J... Saving S209157P... Saving S209150V... Saving S209151S... Getting applications for Horsham Rural City Council... Saving S209659J... Saving S209244B... Saving S193819E... Saving S207683P... Saving S207300J... Saving S208437M... Saving S208406M... Saving S205945C... Getting applications for Hume City Council... Saving S210448C... Saving S210169M... Saving S210354A... Saving S210328B... Saving S210175A... Saving S210129P... Saving S210155M... Saving S210127A... Saving S208978J... Saving S209944M... Saving S209943S... Saving S210001A... Saving S209945H... Saving S209978A... Saving S207156S... Saving S209781S... Saving S208845C... Saving S209445C... Saving S209376M... Saving S208882P... Saving S209342B... Saving S209296H... Saving S209275B... Saving S208979E... Saving S207659H... Saving S208947J... Saving S209155A... Saving S209118M... Getting applications for Indigo Shire Council... Saving S209336P... Saving S209331M... Getting applications for Kingston City Council... Saving S189162M... Saving S210615T... Saving S210103E... Saving S188312P... Saving S210073S... Saving S209937E... Saving S209913M... Saving S208500E... Saving S209311B... Saving S209294S... Saving S209126P... Getting applications for Knox City Council... Saving S210605B... Saving S210321H... Saving S210311P... Saving S210077A... Saving S209959H... Saving S209891B... Saving S209878H... Saving S209515P... Saving S209414C... Saving S209060A... Getting applications for Latrobe City Council... Saving S210453T... Saving S210177P... Saving S210156H... Saving S209716S... Saving S209714B... Saving S209998J... Saving S209513A... Getting applications for Loddon Shire Council... Saving S209779M... Saving S209119H... Getting applications for Macedon Ranges Shire Council... Saving S210213P... Saving S210090S... Saving S207302B... Saving S209348A... Saving S209334A... Saving S209074A... Getting applications for Manningham City Council... Saving S210025S... Saving S210003P... Saving S209892V... Saving S209954E... Saving S209382A... Saving S209696V... Saving S209663E... Saving S209605M... Saving S209595J... Saving S209405E... Saving S209218C... Getting applications for Mansfield Shire Council... Saving S210010V... Saving S209132B... Getting applications for Maribyrnong City Council... Saving S210284M... Saving S209974S... Saving S209652S... Saving S209630P... Saving S209601E... Saving S209552B... Saving S209503E... Saving S208775S... Saving S209379A... Saving S209183M... Getting applications for Maroondah City Council... Saving S210341T... Saving S210285H... Saving S210011S... Saving S209952P... Saving S209887E... Saving S209572M... Saving S209522V... Saving S209465P... Saving S207350B... Getting applications for Melbourne City Council... Saving S210484T... Saving S209861V... Saving S209860B... Saving S209859S... Saving S209099M... Getting applications for Melton City Council... Saving S210216B... Saving S210066J... Saving S208468M... Saving S209726J... Saving S208655P... Saving S209140C... Getting applications for Merri-Bek City Council... Saving S210562H... Saving S210560S... Saving S210309J... Saving S209962H... Saving S209862S... Saving S209894M... Saving S209820C... Saving S209814S... Saving S209795S... Saving S209690A... Saving S209634V... Saving S209546P... Saving S209289B... Saving S209423B... Saving S208044E... Saving S209314M... Saving S209284A... Saving S209277S... Saving S207166J... Saving S179174J... Saving S207990T... Getting applications for Mildura Rural City Council... Getting applications for Minister for Planning - Others... Getting applications for Minister for Planning - Social Housing... Getting applications for Mitchell Shire Council... Saving S209661P... Saving S209070S... Getting applications for Moira Shire Council... Saving S210079P... Saving S207364B... Saving S209596E... Saving S209178V... Getting applications for Monash City Council... Saving S210416H... Saving S210395S... Saving S210384C... Saving S210357J... Saving S210351M... Saving S209510M... Saving S210048P... Saving S197079S... Saving S209994C... Saving S209778S... Saving S209561A... Saving S203860T... Saving S209078E... Saving S209188P... Saving S209318T... Saving S209136H... Getting applications for Moonee Valley City Council... Saving S210277E... Saving S210326J... Saving S209362M... Saving S209857B... Saving S209602B... Saving S209498E... Saving S209560C... Saving S209520E... Saving S209500T... Saving S209486V... Saving S209361S... Saving S209403P... Saving S209337J... Saving S209258B... Saving S209186A... Saving S208834P... Getting applications for Moorabool Shire Council... Saving S209355E... Saving S209201S... Saving S209190T... Getting applications for Mornington Peninsula Shire Council... Saving S210528H... Saving S210417C... Saving S210473E... Saving S210385A... Saving S210140S... Saving S210265V... Saving S210123S... Saving S210121B... Saving S209934T... Saving S209927M... Saving S209830V... Saving S209593T... Saving S209697S... Saving S209611A... Saving S209604S... Saving S208444T... Saving S209367P... Saving S208513J... Getting applications for Mount Alexander Shire Council... Saving S210255C... Saving S210157C... Saving S209756P... Saving S209386E... Saving S208722P... Saving S209283C... Saving S209230B... Saving S208937S... Saving S209114E... Getting applications for Moyne Shire Council... Saving S209811E... Saving S209567V... Saving S209430H... Saving S209109P... Saving S209175J... Getting applications for Murrindindi Shire Council... Getting applications for Nillumbik Shire Council... Saving S210456E... Saving S210378S... Saving S210303M... Saving S210225A... Saving S209979T... Saving S209956V... Saving S209278M... Getting applications for Northern Grampians Shire Council... Saving S209903T... Saving S209644P... Getting applications for Port Phillip City Council... Saving S210060M... Saving S209152M... Saving S209782M... Saving S209856E... Saving S209554S... Saving S209198H... Getting applications for Pyrenees Shire Council... Saving S209709J... Getting applications for Rural City of Wangaratta... Saving S210229E... Saving S209976H... Saving S209478T... Saving S209133V... Getting applications for Shire of Campaspe... Saving S210180P... Saving S209873E... Saving S209120S... Getting applications for South Gippsland Shire Council... Saving S210040B... Saving S210296V... Saving S210215E... Saving S209418J... Saving S209675P... Saving S209259V... Getting applications for Southern Grampians Shire Council... Getting applications for Stonnington City Council... Saving S210584J... Saving S209999E... Getting applications for Strathbogie Shire Council... Saving S209345M... Getting applications for Surf Coast Shire Council... Saving S210433H... Saving S210432M... Saving S210230P... Saving S210115P... Saving S210035J... Saving S209786T... Saving S209635S... Saving S209317A... Getting applications for Swan Hill Rural City Council... Saving S209111T... Saving S209102V... Getting applications for Towong Shire Council... Saving S210208A... Saving S209540S... Getting applications for Warrnambool City Council... Saving S210418A... Saving S210014C... Saving S209793B... Saving S209846M... Saving S209843B... Saving S209770C... Saving S209764S... Saving S209658P... Saving S209647B... Saving S209335T... Getting applications for Wellington Shire Council... Saving S210659A... Saving S210359B... Saving S209145E... Saving S210340A... Saving S210183B... Saving S210005E... Saving S209953J... Saving S209806P... Saving S207220E... Saving S209389S... Saving S209003B... Saving S208714M... Getting applications for West Wimmera Shire Council... Saving S208732H... Saving S209467E... Saving S209402T... Getting applications for Whitehorse City Council... Saving S210496C... Saving S210310T... Saving S210312J... Saving S210240H... Saving S209963C... Saving S210254H... Saving S210096P... Saving S210095T... Saving S210081T... Saving S209906E... Saving S209899P... Saving S209815M... Saving S209769T... Saving S209766H... Saving S209742P... Saving S204757S... Saving S209262V... Saving S209306J... Saving S209219A... Getting applications for Whittlesea City Council... Saving S210204S... Saving S210203V... Saving S210200J... Saving S209824J... Saving S210380V... Saving S210379M... Saving S210337A... Saving S210220V... Saving S210134E... Saving S210039S... Saving S209633B... Saving S209827V... Saving S209610C... Saving S209447T... Saving S209409M... Saving S209164V... Saving S209162E... Saving S203448H... Saving S209271T... Getting applications for Wyndham City Council... Saving S210544M... Saving S208523C... Saving S210055V... Saving S209840P... Saving S209794V... Saving S209509C... Saving S209501P... Saving S208713S... Saving S208712V... Saving S209130J... Getting applications for Yarra City Council... Saving S210223H... Saving S210212T... Saving S209997P... Saving S209925V... Saving S209912S... Getting applications for Yarra Ranges Shire Council... Saving S210596T... Saving S209888B... Saving S209700B... Saving S208726V... Saving S209282H... Saving S209444H... Saving S209144J... Getting applications for Yarriambiack Shire Council...

Data

Downloaded 62115 times by slav123 openaustralia LoveMyData dcalde DevAppProject mlandauer jesse-a-reilly GitHubMLee TheZepto srsmonty TornMarketing cankei NicMeg Jedwards157 AndreM101 93399339 planningalerts-scrapers

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (47.3 MB) Use the API

rows 10 / 120053

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S026214J&cacheApplicationListContext=true
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
2 lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S024425C&cacheApplicationListContext=true
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S025191P&cacheApplicationListContext=true
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S010773J&cacheApplicationListContext=true
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S018317C&cacheApplicationListContext=true
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S013074J&cacheApplicationListContext=true
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S016718J&cacheApplicationListContext=true
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023304S&cacheApplicationListContext=true
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S021086C&cacheApplicationListContext=true
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
Two lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023932B&cacheApplicationListContext=true
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml

Statistics

Average successful run time: 15 minutes

Total run time: about 1 month

Total cpu time used: about 8 hours

Total disk space used: 47.4 MB

History

  • Auto ran revision b640683c and completed successfully .
    662 records added, 610 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    657 records added, 604 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    643 records added, 621 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    623 records added, 623 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    624 records added, 624 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

spear / scraper.rb