planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria

Contributors CloCkWeRX henare mlandauer archoo

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting applications for Alpine Resorts - Mt Buller... Getting applications for Alpine Shire Council - Bright Office... Saving S253873E... Saving S253600J... Saving S252183A... Saving S253003B... Getting applications for Ararat Rural City Council... Saving S254238C... Saving S253811E... Saving S253683S... Saving S253041H... Getting applications for Ballarat City Council... Saving S253891B... Saving S253890E... Saving S253761E... Saving S253670M... Saving S253628J... Saving S252568C... Saving S253552B... Saving S252364P... Saving S251995V... Saving S253098S... Saving S253086H... Saving S253066V... Getting applications for Banyule City Council... Saving S254230P... Saving S254101P... Saving S253876S... Saving S253540S... Saving S253449J... Saving S253185C... Saving S253288E... Saving S253271T... Saving S253238P... Saving S253112P... Saving S252912C... Saving S252523C... Saving S252517S... Saving S252943C... Getting applications for Bass Coast Shire Council... Saving S254472J... Saving S254675C... Saving S254054B... Saving S253581J... Saving S253477A... Saving S253301H... Saving S253267A... Saving S253071M... Getting applications for Baw Baw Shire Council... Saving S241849J... Saving S249228S... Saving S253963C... Saving S253897A... Saving S253519V... Saving S253284A... Saving S253192J... Saving S253182S... Saving S253146B... Saving S252721T... Saving S253080J... Getting applications for Bayside City Council... Saving S253742P... Saving S248297J... Saving S253668H... Saving S252984V... Saving S253384P... Saving S253306J... Saving S253305P... Getting applications for Benalla Rural City Council... Saving S254517T... Getting applications for Boroondara City Council... Saving S254641S... Saving S254343J... Saving S254168S... Saving S253849A... Saving S253823P... Saving S253648V... Saving S253218C... Saving S250455E... Getting applications for Borough of Queenscliffe... Getting applications for Brimbank City Council... Saving S254770S... Saving S254345B... Saving S253733S... Saving S254182E... Saving S250334H... Saving S253603V... Saving S250038S... Saving S253966P... Saving S252951E... Saving S253249C... Saving S253174P... Getting applications for Buloke Shire Council... Getting applications for Cardinia Shire Council... Saving S254094A... Saving S254667B... Saving S254658C... Saving S254615T... Saving S254465C... Saving S254463M... Saving S254460B... Saving S254358E... Saving S254125H... Saving S253964A... Saving S253957S... Saving S253896C... Saving S252969M... Saving S252060J... Saving S252981J... Saving S253158J... Getting applications for Casey City Council... Saving S254781E... Saving S254777J... Saving S254650P... Saving S252540C... Saving S254112C... Saving S253985E... Saving S254494M... Saving S254455J... Saving S254354A... Saving S254292P... Saving S253970J... Saving S253962H... Saving S253953J... Saving S253278M... Saving S253722C... Saving S253512C... Saving S253666S... Saving S253059P... Saving S253426M... Saving S253391V... Saving S253363H... Saving S252134C... Saving S253320A... Saving S253125T... Saving S253122H... Saving S251257C... Saving S252530J... Getting applications for Central Goldfields Shire Council... Getting applications for City of Greater Dandenong... Saving S254701J... Saving S254451C... Saving S254129P... Saving S253931H... Saving S253347C... Saving S253862S... Saving S253768A... Saving S233470H... Saving S240291C... Saving S253293V... Saving S253236A... Getting applications for City of Greater Geelong... Saving S254768M... Saving S253720M... Saving S254363V... Saving S254716E... Saving S254713T... Saving S254645A... Saving S254584J... Saving S254115P... Saving S254528H... Saving S254524B... Saving S254496C... Saving S254489V... Saving S254448C... Saving S254444V... Saving S254419T... Saving S254062C... Saving S254342P... Saving S254132P... Saving S253594P... Saving S253701V... Saving S253996T... Saving S253992M... Saving S253935P... Saving S253930M... Saving S253736C... Saving S253809B... Saving S253804A... Saving S253762B... Saving S253746V... Saving S253708P... Saving S253715V... Saving S253689P... Saving S253371J... Saving S253609T... Saving S253335T... Saving S253208J... Saving S249344M... Saving S249343S... Getting applications for City of Wodonga... Saving S252560P... Saving S253769T... Saving S252784P... Saving S253772T... Saving S253210P... Getting applications for Colac Otway Shire... Saving S254473E... Saving S254493S... Saving S253782M... Saving S253801M... Saving S252741E... Getting applications for Corangamite Shire Council... Saving S254400S... Saving S254005E... Saving S253653M... Saving S253172A... Getting applications for Darebin City Council... Saving S254686S... Saving S254704V... Saving S254570J... Saving S239445M... Saving S254581A... Saving S253303A... Saving S254366H... Saving S254224C... Saving S254287A... Saving S254248V... Saving S254108H... Saving S254194P... Saving S254141M... Saving S254126C... Saving S254120E... Saving S254117E... Saving S251977B... Saving S253732V... Saving S253569M... Saving S253562T... Saving S253503E... Saving S253402T... Saving S253157P... Saving S253088A... Saving S253057A... Getting applications for East Gippsland Shire Council... Saving S254676A... Saving S254751B... Saving S254484T... Saving S254648J... Saving S254652E... Saving S254680T... Saving S254630C... Saving S252949B... Saving S254328B... Saving S254459S... Saving S254320M... Saving S254315V... Saving S254316S... Saving S248239S... Saving S252432J... Saving S253792E... Saving S253820C... Saving S253791J... Saving S253318T... Saving S253321T... Getting applications for Frankston City Council... Saving S252854B... Saving S254170V... Saving S254535P... Saving S254402H... Saving S254189A... Saving S254178J... Saving S253893S... Saving S253879C... Saving S253875V... Saving S253704H... Saving S253576T... Saving S253223T... Saving S253414C... Saving S253279H... Saving S252765A... Getting applications for Gannawarra Shire Council... Getting applications for Glen Eira City Council... Saving S252115M... Saving S254631A... Saving S254482C... Saving S254424J... Saving S254319C... Saving S254067E... Saving S253945H... Saving S253939V... Saving S253913M... Saving S253624C... Saving S253393M... Saving S253287J... Saving S253260E... Saving S253211J... Getting applications for Glenelg Shire Council... Saving S254719S... Saving S254009M... Saving S253831S... Getting applications for Golden Plains Shire Council... Saving S254616P... Saving S253799A... Saving S251006J... Getting applications for Greater Bendigo City Council... Saving S253424V... Saving S254710H... Saving S254498T... Saving S254331B... Saving S254042S... Saving S254001A... Saving S253948T... Saving S253943S... Saving S253938B... Saving S253824J... Saving S253728B... Saving S253681B... Saving S253355E... Saving S246818C... Getting applications for Greater Shepparton City Council... Saving S254608M... Saving S254398C... Saving S254234V... Saving S253998J... Saving S253991S... Saving S253789E... Saving S253706A... Saving S253495T... Saving S252717A... Saving S253423B... Getting applications for Hepburn Shire Council... Saving S254179E... Saving S254383H... Saving S253803C... Saving S253620V... Saving S253342B... Saving S253103S... Getting applications for Hindmarsh Shire Council... Saving S254235S... Saving S253246S... Saving S253682V... Saving S253374V... Saving S252986M... Getting applications for Hobsons Bay City Council... Saving S254748B... Saving S253780V... Saving S253783H... Saving S254691H... Saving S254592M... Saving S254013H... Saving S254412B... Saving S254413V... Saving S254260T... Saving S254250B... Saving S253604S... Saving S254135B... Saving S253550J... Saving S253819T... Saving S253805T... Saving S253752H... Saving S253713E... Saving S252983B... Saving S251177A... Saving S253561A... Saving S248552H... Saving S253511H... Saving S253504B... Saving S253463A... Saving S251486T... Getting applications for Horsham Rural City Council... Saving S253757J... Saving S253175J... Getting applications for Hume City Council... Saving S254776P... Saving S254723M... Saving S254715J... Saving S254733E... Saving S254682J... Saving S254298M... Saving S254610S... Saving S253698M... Saving S254497A... Saving S254417C... Saving S254403C... Saving S254394V... Saving S254309J... Saving S254279V... Saving S254208A... Saving S253832M... Saving S253216M... Saving S253225J... Saving S250184S... Saving S253928H... Saving S253915C... Saving S253846M... Saving S251742M... Saving S253784C... Saving S253616B... Saving S253570V... Saving S253376M... Saving S253141A... Saving S253277S... Saving S253187T... Saving S253176E... Saving S253151S... Saving S253145E... Getting applications for Indigo Shire Council... Saving S253222A... Getting applications for Kingston City Council... Saving S254638S... Saving S253606H... Saving S254505J... Saving S254464H... Saving S254380V... Saving S245098H... Saving S254228J... Saving S254359B... Saving S254257T... Saving S254174C... Saving S254137S... Saving S254006B... Saving S253239J... Saving S253984J... Saving S253796M... Saving S253760J... Saving S253712J... Saving S253621S... Saving S253076P... Saving S253339B... Saving S253247M... Saving S252995J... Getting applications for Knox City Council... Saving S254374J... Saving S254321H... Saving S254239A... Saving S254197B... Saving S254092H... Saving S253750S... Saving S253508H... Saving S253473S... Saving S253137C... Saving S253415A... Saving S253377H... Saving S253252C... Saving S253213B... Saving S252917E... Saving S253085M... Getting applications for Latrobe City Council... Saving S254388J... Saving S253895H... Saving S253865C... Saving S253739P... Saving S253652S... Saving S253523S... Saving S253370P... Saving S253489H... Saving S253102V... Getting applications for Loddon Shire Council... Getting applications for Macedon Ranges Shire Council... Saving S254626H... Saving S253870T... Saving S254350S... Saving S254267M... Saving S254166B... Saving S253850H... Saving S253806P... Saving S253798C... Saving S253694E... Saving S253714B... Saving S253778S... Saving S253726J... Saving S253577P... Getting applications for Manningham City Council... Saving S253886J... Saving S254475V... Saving S254450H... Saving S254410J... Saving S254096P... Saving S254213P... Saving S253884T... Saving S253888B... Saving S254220V... Saving S254146P... Saving S254140S... Saving S253923E... Saving S253918P... Saving S253794V... Saving S253496P... Saving S253588C... Saving S253063J... Saving S253346H... Saving S253324E... Saving S253266C... Saving S253232S... Saving S253186A... Getting applications for Mansfield Shire Council... Saving S253299T... Saving S253147V... Getting applications for Maribyrnong City Council... Saving S254458V... Saving S254470T... Saving S254601T... Saving S254254H... Saving S254165E... Saving S253571S... Saving S253051B... Getting applications for Maroondah City Council... Saving S254507B... Saving S254382M... Saving S253771A... Saving S254278B... Saving S254086V... Saving S254044H... Saving S254002T... Saving S253009A... Saving S252968S... Saving S253469V... Saving S253466J... Saving S253650B... Saving S250748V... Saving S253467E... Getting applications for Melbourne City Council... Saving S254090S... Saving S254131T... Saving S254095T... Saving S254031C... Saving S253623H... Saving S253290J... Saving S253229S... Saving S252064S... Saving S253049V... Getting applications for Melton City Council... Saving S254628A... Saving S254778E... Saving S254732J... Saving S254690M... Saving S253667M... Saving S254526S... Saving S254501C... Saving S254474B... Saving S254411E... Saving S250125C... Saving S251967H... Saving S254209T... Saving S253607C... Saving S254139H... Saving S253817C... Saving S253295M... Saving S253993H... Saving S253956V... Saving S253834C... Saving S253755T... Saving S253574C... Saving S252107J... Saving S252648H... Saving S253332H... Saving S253327S... Saving S253257E... Saving S253255P... Saving S253254T... Saving S253250M... Saving S196650C... Saving S253053S... Getting applications for Merri-Bek City Council... Saving S254746J... Saving S254244P... Saving S250710C... Saving S254258P... Saving S254255C... Saving S254218S... Saving S253716S... Saving S253955B... Saving S254193T... Saving S254128T... Saving S253693J... Saving S253867T... Saving S253814S... Saving S253487S... Saving S253563P... Saving S253542H... Saving S253510M... Saving S253497J... Saving S253462C... Saving S253421J... Saving S253412M... Saving S253343V... Saving S253333C... Saving S253212E... Saving S253115B... Getting applications for Mildura Rural City Council... Saving S253813V... Saving S253637H... Saving S253677E... Saving S253580P... Saving S253263S... Getting applications for Minister for Planning - Others... Getting applications for Minister for Planning - Social Housing... Getting applications for Mitchell Shire Council... Saving S254606V... Saving S254598J... Saving S252331A... Saving S253883A... Saving S253843B... Saving S244372H... Saving S253578J... Saving S252176S... Saving S253276V... Saving S253228V... Saving S253171C... Getting applications for Moira Shire Council... Saving S254599E... Saving S254593H... Saving S253995A... Saving S251852V... Saving S253807J... Saving S253596E... Saving S253490S... Saving S253341E... Saving S253178V... Saving S253139T... Getting applications for Monash City Council... Saving S254695P... Saving S253273J... Saving S254408E... Saving S254585E... Saving S254544M... Saving S254452A... Saving S254023B... Saving S254262J... Saving S254283S... Saving S254175A... Saving S254134E... Saving S253396A... Saving S253961M... Saving S253922J... Saving S253833H... Saving S253687A... Saving S253179S... Saving S253317A... Saving S253537S... Saving S253505V... Saving S249118H... Saving S253444H... Saving S253413H... Saving S253372E... Saving S253101B... Getting applications for Moonee Valley City Council... Saving S254294E... Saving S254802V... Saving S254635E... Saving S254561M... Saving S254036E... Saving S254047T... Saving S253730E... Saving S253881H... Saving S254040B... Saving S254043M... Saving S253717M... Saving S240592V... Saving S253816H... Saving S252358C... Saving S253737A... Saving S253525H... Saving S253055H... Saving S252444T... Saving S253300M... Saving S251320V... Saving S252934E... Getting applications for Moorabool Shire Council... Saving S253793B... Saving S253568S... Getting applications for Mornington Peninsula Shire Council... Saving S253482P... Saving S254521P... Saving S254109C... Saving S254147J... Saving S254123S... Saving S254102J... Saving S253909S... Saving S239482A... Saving S253705C... Saving S253690A... Saving S253661P... Saving S253590H... Saving S253488M... Saving S253316C... Saving S253338E... Saving S252739B... Saving S253224P... Saving S253135M... Getting applications for Mount Alexander Shire Council... Saving S254012M... Saving S254236M... Saving S254210C... Saving S254017P... Saving S253399J... Saving S253452J... Saving S253408S... Saving S252310S... Getting applications for Moyne Shire Council... Saving S252271E... Saving S253842E... Saving S253078E... Getting applications for Murrindindi Shire Council... Saving S254191C... Saving S253605M... Saving S252813H... Getting applications for Nillumbik Shire Council... Saving S253911V... Saving S253177B... Getting applications for Northern Grampians Shire Council... Saving S254261P... Saving S250189T... Getting applications for Port Phillip City Council... Saving S254247B... Saving S254200J... Saving S253894M... Saving S252112B... Saving S253073C... Getting applications for Pyrenees Shire Council... Getting applications for Rural City of Wangaratta... Saving S254148E... Saving S254061H... Getting applications for Shire of Campaspe... Saving S254371A... Saving S253740A... Getting applications for South Gippsland Shire Council... Saving S254867H... Saving S254780J... Saving S254565T... Saving S254416H... Saving S254288T... Saving S254226T... Saving S254110M... Saving S252909C... Saving S253248H... Saving S249643P... Getting applications for Southern Grampians Shire Council... Saving S254227P... Saving S253781S... Saving S253154C... Getting applications for Stonnington City Council... Saving S254711C... Saving S254679J... Saving S254668V... Saving S254629T... Saving S254516A... Saving S254479C... Saving S254277E... Saving S254202B... Saving S254180P... Saving S253584V... Saving S253795S... Saving S253056C... Getting applications for Strathbogie Shire Council... Saving S254589M... Getting applications for Surf Coast Shire Council... Saving S253658P... Saving S254169M... Saving S253853T... Saving S253379A... Saving S253599S... Saving S253077J... Getting applications for Swan Hill Rural City Council... Saving S254372T... Saving S254196E... Saving S253533J... scraper.rb:53:in `block in applications_page': undefined method `[]' for nil:NilClass (NoMethodError) from scraper.rb:39:in `each' from scraper.rb:39:in `applications_page' from scraper.rb:77:in `block in all_applications' from scraper.rb:76:in `loop' from scraper.rb:76:in `all_applications' from scraper.rb:106:in `block in <main>' from scraper.rb:102:in `each' from scraper.rb:102:in `<main>'

Data

Downloaded 84387 times by slav123 openaustralia dcalde LoveMyData mlandauer DevAppProject jesse-a-reilly repose-lecture GitHubMLee TheZepto srsmonty AriesXIX parsaie cankei NicMeg TornMarketing AndreM101 93399339 planningalerts-scrapers odnagroup ponynoble Elliehancock Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (53.5 MB) Use the API

rows 10 / 142380

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S026214J&cacheApplicationListContext=true
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
2 lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S024425C&cacheApplicationListContext=true
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S025191P&cacheApplicationListContext=true
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S010773J&cacheApplicationListContext=true
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S018317C&cacheApplicationListContext=true
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S013074J&cacheApplicationListContext=true
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S016718J&cacheApplicationListContext=true
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023304S&cacheApplicationListContext=true
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S021086C&cacheApplicationListContext=true
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
Two lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023932B&cacheApplicationListContext=true
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml

Statistics

Average successful run time: 15 minutes

Total run time: about 1 month

Total cpu time used: about 9 hours

Total disk space used: 53.6 MB

History

  • Auto ran revision b640683c and failed .
    685 records added, 641 records removed in the database
  • Auto ran revision b640683c and failed .
    734 records added, 658 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    728 records added, 687 records removed in the database
  • Auto ran revision b640683c and failed .
    730 records added, 679 records removed in the database
  • Auto ran revision b640683c and failed .
    614 records added, 580 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

spear / scraper.rb