planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria

Forked from ScraperWiki

Contributors CloCkWeRX henare mlandauer archoo dependabot[bot]

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.5.1 -----> Installing dependencies using bundler version 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/...........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching mime-types-data 3.2021.0225  Fetching multi_xml 0.6.0  Fetching httpclient 2.8.3  Installing multi_xml 0.6.0  Installing mime-types-data 3.2021.0225  Installing httpclient 2.8.3  Fetching sqlite3 1.4.2  Installing sqlite3 1.4.2 with native extensions  Fetching mime-types 3.3.1  Installing mime-types 3.3.1  Fetching httparty 0.18.1  Installing httparty 0.18.1  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 2 Gemfile dependencies, 9 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from httparty:  When you HTTParty, you must party hard!  Bundle completed (7.06s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting applications for Alpine Shire Council - Bright Office... Saving S196263T... Saving S196251J... Saving S195968T... Saving S195945V... Getting applications for Ararat Rural City Council... Saving S195476S... Getting applications for Ballarat City Council... Saving S196649T... Saving S196241S... Saving S196091B... Saving S195959V... Saving S193456C... Getting applications for Banyule City Council... Saving S196759C... Saving S196448S... Saving S195820S... Saving S195839T... Saving S195812P... Saving S195620J... Saving S195675C... Saving S194823P... Saving S195433H... Saving S195220V... Getting applications for Bass Coast Shire Council... Saving S196868S... Saving S196613S... Saving S196378E... Saving S196270B... Saving S189994J... Saving S196178A... Saving S195883M... Saving S195815B... Saving S195728P... Saving S195614A... Saving S195603J... Saving S194602B... Saving S195486J... Saving S195462S... Getting applications for Baw Baw Shire Council... Saving S196205B... Saving S196204E... Saving S196203J... Saving S196070T... Saving S196067T... Saving S196066A... Saving S196062S... Saving S196059S... Saving S195518P... Saving S195658C... Getting applications for Bayside City Council... Saving S196797J... Saving S196540T... Saving S196274H... Saving S196394J... Saving S196231A... Saving S196132C... Saving S195967A... Saving S195726A... Saving S195940T... Saving S195923T... Saving S195880B... Saving S195796B... Saving S195710H... Saving S195594C... Saving S195400S... Saving S195453T... Saving S195428S... Getting applications for Benalla Rural City Council... Saving S196473T... Saving S196269S... Saving S195142H... Saving S195473E... Getting applications for Boroondara City Council... Saving S196320B... Saving S196172B... Saving S196111V... Saving S191816S... Saving S195808T... Saving S195799M... Saving S195385A... Getting applications for Borough of Queenscliffe... Getting applications for Brimbank City Council... Saving S196917V... Saving S196402V... Saving S196708S... Saving S196635T... Saving S196634A... Saving S196437C... Saving S196333E... Saving S196309A... Saving S196112S... Saving S195972P... Saving S195858J... Saving S195678P... Saving S195219M... Saving S195519J... Getting applications for Buloke Shire Council... Saving S193592J... Saving S196143S... Saving S195649E... Getting applications for Cardinia Shire Council... Saving S196569P... Saving S196230C... Saving S196197P... Saving S196166P... Saving S195784S... Saving S194966P... Saving S195517T... Saving S195515C... Saving S194972B... Saving S195588S... Saving S195383H... Getting applications for Casey City Council... Saving S196771B... Saving S196616C... Saving S195203V... Saving S196653P... Saving S196640J... Saving S196561B... Saving S196444J... Saving S196427J... Saving S195691H... Saving S196310H... Saving S196299V... Saving S189384V... Saving S196250P... Saving S196236B... Saving S196098T... Saving S172236A... Saving S196097A... Saving S195619B... Saving S196052A... Saving S195997C... Saving S195928V... Saving S195927B... Saving S195920H... Saving S195916M... Saving S195933M... Saving S195956J... Saving S195963S... Saving S195965H... Saving S195974E... Saving S195707H... Saving S195872A... Saving S195850V... Saving S195833V... Saving S195690M... Saving S195612H... Saving S195500H... Saving S195521P... Saving S195491B... Saving S195490E... Saving S195487E... Saving S195485P... Saving S195483A... Saving S195482C... Saving S195480M... Saving S195493S... Saving S195468P... Saving S195441J... Saving S195422T... Saving S195409B... Saving S195392E... Saving S195288T... Getting applications for Central Goldfields Shire Council... Saving S196621T... Saving S196240V... Saving S196169B... Saving S194755T... Saving S195019E... Getting applications for City of Greater Dandenong... Saving S196336S... Saving S196303B... Saving S196195A... Saving S196025E... Saving S195394V... Saving S195522J... Saving S195705S... Saving S195531H... Saving S195530M... Saving S195526S... Saving S195386T... Getting applications for City of Greater Geelong... Saving S196907C... Saving S196752J... Saving S196701A... Saving S196363J... Saving S196534H... Saving S196438A... Saving S195905A... Saving S196379B... Saving S196332J... Saving S196323M... Saving S196282J... Saving S196279J... Saving S196248J... Saving S196245A... Saving S196160S... Saving S196170J... Saving S196003C... Saving S195987J... Saving S195970A... Saving S195955P... Saving S195847V... Saving S195935C... Saving S195856T... Saving S195629T... Saving S195599E... Saving S195546C... Saving S195505J... Getting applications for City of Wodonga... Saving S188049P... Saving S195852M... Saving S195624S... Saving S195140S... Getting applications for Colac Otway Shire... Saving S196358T... Saving S196455A... Saving S196369H... Saving S196367S... Saving S196092V... Getting applications for Corangamite Shire Council... Saving S195699V... Saving S195737M... Getting applications for Darebin City Council... Saving S196549C... Saving S196413J... Saving S196431E... Saving S196376P... Saving S196373C... Saving S196276A... Saving S196202P... Saving S196090E... Saving S195954T... Saving S195942J... Saving S195836H... Saving S195591S... Saving S195124M... Getting applications for East Gippsland Shire Council... Saving S196082C... Saving S196096C... Saving S195991E... Saving S195943E... Saving S195938P... Saving S195814E... Saving S195800E... Saving S195580C... Saving S195578A... Saving S195576H... Saving S195575M... Saving S195471P... Getting applications for Frankston City Council... Saving S196562V... Saving S193047S... Saving S196120T... Saving S196181A... Saving S183550J... Saving S195475V... Getting applications for Gannawarra Shire Council... Saving S196947B... Saving S195446M... Saving S195445S... Saving S186623A... Getting applications for Glen Eira City Council... Saving S196856H... Saving S196747T... Saving S196691V... Saving S196669E... Saving S177907T... Saving S196479S... Saving S196380J... Saving S196497M... Saving S196391A... Saving S196396B... Saving S196340M... Saving S196126S... Saving S196277T... Saving S196123E... Saving S196076S... Saving S196175M... Saving S196141B... Saving S195892J... Saving S175790E... Saving S195547A... Saving S195520T... Saving S195416H... Getting applications for Glenelg Shire Council... Saving S196116A... Saving S196115C... Saving S194000P... Saving S195824A... Saving S195655S... Saving S195651J... Saving S195572B... Getting applications for Golden Plains Shire Council... Saving S196625B... Saving S196528V... Saving S177938T... Saving S196086J... Saving S196085P... Saving S195841A... Saving S195826P... Saving S195474B... Saving S195466A... Getting applications for Greater Bendigo City Council... Saving S196792H... Saving S196774M... Saving S196704J... Saving S196661S... Saving S194969B... Saving S196406C... Saving S196356C... Saving S196313T... Saving S196285V... Saving S196258C... Saving S196253B... Saving S195553J... Saving S195980S... Saving S194076P... Saving S196005T... Saving S182820P... Saving S196027V... Saving S196000S... Saving S195990J... Saving S195925J... Saving S195861J... Saving S195855A... Saving S195702E... Saving S195607S... Saving S195539V... Saving S194745B... Saving S195443B... Getting applications for Greater Shepparton City Council... Saving S192803B... Saving S196644S... Saving S196567A... Saving S196505A... Saving S196458J... Saving S194269P... Saving S196329J... Saving S193289M... Saving S196317B... Saving S196225M... Saving S195866M... Saving S195849M... Saving S195375E... Saving S194619M... Getting applications for Hepburn Shire Council... Saving S196417S... Saving S196089V... Saving S196095H... Saving S195821M... Saving S195290A... Saving S195793P... Saving S191536E... Saving S195295B... Saving S195502A... Saving S195420C... Getting applications for Hindmarsh Shire Council... Getting applications for Hobsons Bay City Council... Saving S196897B... Saving S196568T... Saving S196046M... Saving S196228A... Saving S196093S... Saving S195501C... Getting applications for Horsham Rural City Council... Saving S196074B... Getting applications for Hume City Council... Saving S196576V... Saving S196482S... Saving S196401B... Saving S196327T... Saving S196029M... Saving S196218E... Saving S196213C... Saving S192469T... Saving S195909E... Saving S195906T... Saving S194139T... Saving S194165S... Saving S195509S... Saving S195511V... Saving S195467T... Saving S194410V... Getting applications for Indigo Shire Council... Saving S196048C... Saving S195391J... Saving S195456E... Getting applications for Kingston City Council... Saving S196604T... Saving S196738V... Saving S196606J... Saving S195313E... Saving S196033H... Saving S194325B... Saving S193845C... Saving S195860P... Saving S194061T... Saving S195665J... Saving S195637V... Saving S195481H... Saving S195381S... Getting applications for Knox City Council... Saving S194136H... Saving S196404M... Saving S196331P... Saving S196190V... Saving S196165T... Saving S196139V... Saving S196043B... Saving S195971T... Saving S195924P... Saving S195885C... Saving S195387P... Saving S195421A... Saving S195398C... Getting applications for Latrobe City Council... Saving S196486A... Saving S196362P... Saving S196281P... Saving S195459S... Saving S195460B... Saving S196064H... Saving S195763J... Saving S195950M... Saving S195653B... Saving S195455J... Getting applications for Loddon Shire Council... Saving S196885S... Saving S196840S... Saving S196399M... Getting applications for Macedon Ranges Shire Council... Saving S196809C... Saving S195756C... Saving S196766J... Saving S194233M... Saving S196603A... Saving S196481V... Saving S196012B... Saving S195894B... Saving S195823C... Saving S195674H... Getting applications for Manningham City Council... Saving S194882C... Saving S196409P... Saving S196345P... Saving S196124B... Saving S196138B... Saving S195985T... Saving S195926E... Saving S195835M... Saving S195813J... Saving S195725C... Saving S195656M... Saving S194775E... Saving S193665H... Getting applications for Mansfield Shire Council... Saving S196926T... Saving S196689S... Saving S196508J... Saving S196385M... Saving S196134T... Saving S196198J... Saving S196152P... Saving S195679J... Saving S195415M... Getting applications for Maribyrnong City Council... Saving S196536A... Saving S196418M... Saving S195786H... Saving S195657H... Saving S195497A... Saving S195399A... Getting applications for Maroondah City Council... Saving S196737B... Saving S196707V... Saving S196532S... Saving S196462E... Saving S196080M... Saving S196034C... Saving S195992B... Saving S195868C... Saving S195830J... Saving S195792T... Saving S195622B... Saving S195432M... Getting applications for Melbourne City Council... Saving S193864T... Saving S193825S... Saving S193911H... Saving S193903E... Saving S196557E... Saving S194661P... Saving S195734B... Saving S195767S... Saving S195947M... Saving S195586B... Getting applications for Melton City Council... Saving S196676M... Saving S196579H... Saving S196450V... Saving S196381E... Saving S196361T... Saving S196144M... Saving S195408E... Saving S195889J... Saving S195298M... Saving S195973J... Saving S192037J... Saving S195020P... Saving S193061E... Saving S187147B... Saving S192696T... Saving S194246S... Saving S195465C... Saving S195458V... Saving S195448C... Saving S195405T... Saving S189834J... Saving S189827C... Saving S189821E... Saving S194997P... Saving S194996T... Getting applications for Mildura Rural City Council... Saving S194766H... Saving S195615T... Getting applications for Minister for Planning - Others... Getting applications for Minister for Planning - Social Housing... Getting applications for Mitchell Shire Council... Saving S196287M... Saving S195005E... Saving S195537E... Saving S195543S... Saving S195514H... Saving S195496C... Getting applications for Moira Shire Council... Saving S196659M... Saving S196871S... Saving S196749J... Saving S196690B... Saving S196108V... Saving S195825T... Saving S195573V... Saving S195557S... Saving S195550A... Saving S195397H... Getting applications for Monash City Council... Saving S196564M... Saving S196594S... Saving S196578M... Saving S196463B... Saving S196432B... Saving S196411T... Saving S196371M... Saving S196353S... Saving S196137E... Saving S196110B... Saving S195919A... Saving S195873T... Saving S195811T... Saving S195724H... Saving S194102V... Saving S195454P... Saving S195437P... Getting applications for Moonee Valley City Council... Saving S196735J... Saving S196646H... Saving S196639B... Saving S196620A... Saving S196506T... Saving S196352V... Saving S196280T... Saving S196187V... Saving S195982H... Saving S195951H... Saving S195886A... Saving S195776P... Saving S195684B... Saving S195565T... Getting applications for Moorabool Shire Council... Saving S195837C... Getting applications for Moreland City Council... Saving S196810M... Saving S196768B... Saving S196740B... Saving S196641E... Saving S196638E... Saving S196636P... Saving S196600M... Saving S196491P... Saving S196471C... Saving S196318V... Saving S196184J... Saving S196219B... Saving S196217J... Saving S196179T... Saving S196130M... Saving S196122J... Saving S196104P... Saving S196038J... Saving S195999T... Saving S195795E... Saving S195816V... Saving S195742C... Saving S195723M... Saving S195608M... Saving S195532C... Saving S195566P... Saving S195560S... Saving S195429M... Saving S195442E... Saving S195411E... Getting applications for Mornington Peninsula Shire Council... Saving S196911A... Saving S196896E... Saving S196350E... Saving S196531V... Saving S196504C... Saving S196416V... Saving S196359P... Saving S196302E... Saving S196325C... Saving S195939J... Saving S196201T... Saving S196200A... Saving S196136J... Saving S196109S... Saving S194702S... Saving S195709A... Saving S195693A... Saving S195648J... Saving S195642M... Saving S195016T... Saving S195368A... Getting applications for Mount Alexander Shire Council... Saving S195202B... Saving S196288H... Saving S195944B... Getting applications for Moyne Shire Council... Saving S196370S... Saving S195712A... Saving S195647P... Saving S195499P... Saving S195393B... Getting applications for Murrindindi Shire Council... Saving S196055J... Saving S195700P... Saving S195362B... Getting applications for Nillumbik Shire Council... Saving S196853V... Saving S195765B... Saving S195512S... Getting applications for Northern Grampians Shire Council... Saving S194403P... Getting applications for Port Phillip City Council... Saving S195527M... Saving S196337M... Saving S195870H... Saving S195689C... Saving S195417C... Saving S195377V... Getting applications for Pyrenees Shire Council... Saving S195548T... Getting applications for Rural City of Wangaratta... Saving S196233P... Saving S196222B... Saving S196149P... Saving S196161M... Saving S195634J... Saving S194290J... Saving S195602P... Saving S195105V... Saving S195384C... Getting applications for Shire of Campaspe... Saving S196808H... Saving S194744E... Saving S196443P... Saving S195817S... Saving S194607C... Getting applications for South Gippsland Shire Council... Saving S192760H... Saving S195633P... Saving S195643H... Getting applications for Southern Grampians Shire Council... Getting applications for SPEAR Test Council... SubmittedDate is empty for S096692H. So, skipping. Getting applications for Stonnington City Council... Saving S196934V... Saving S196930P... Saving S196924C... Saving S196923H... Saving S196876T... Saving S195757A... Saving S195418A... Getting applications for Strathbogie Shire Council... Saving S195874P... Saving S195797V... Saving S194866A... Getting applications for Surf Coast Shire Council... Saving S196612V... Saving S196439T... Saving S196349V... Saving S196334B... Saving S196129C... Saving S194292B... Getting applications for Swan Hill Rural City Council... Saving S195838A... Getting applications for Towong Shire Council... Getting applications for Warrnambool City Council... Saving S196692S... Saving S195983C... Saving S196234J... Saving S195946S... Saving S195805H... Saving S195791A... Saving S195785M... Saving S195610S... Saving S195516A... Getting applications for Wellington Shire Council... Saving S189989T... Saving S185464V... Saving S196652T... Saving S196671J... Saving S196582H... Saving S196541P... Saving S196591E... Saving S196619P... Saving S196581M... Saving S196586P... Saving S196584A... Saving S196515S... Saving S196294T... Saving S196265J... Saving S196185E... Saving S196125V... Saving S196041J... Saving S195257T... Saving S195984A... Saving S195932S... Saving S195472J... Saving S195713T... Saving S195570J... Saving S195365M... Saving S195444V... Getting applications for West Wimmera Shire Council... Getting applications for Whitehorse City Council... Saving S196433V... Saving S195094A... Saving S196127M... Saving S196047H... Saving S196045S... Saving S195979H... Saving S195903H... Saving S195810A... Saving S195729J... Saving S195706M... Saving S195562H... Saving S195378S... Getting applications for Whittlesea City Council... Saving S196583C... Saving S196580S... Saving S196770E... Saving S196706B... Saving S196651A... Saving S195844J... Saving S195842T... Saving S196407A... Saving S196266E... Saving S194466J... Saving S194199C... Saving S194194B... Saving S195877B... Saving S195698B... Saving S195676A... Saving S195535P... Saving S195470T... Saving S195379M... Saving S195356P... Saving S120232H... Saving S195389E... Getting applications for Wyndham City Council... Saving S196397V... Saving S196087E... Saving S196049A... Saving S194620V... Saving S195966C... Saving S195893E... Saving S195761T... Saving S195755H... Saving S195552P... Saving S195484T... Saving S195449A... Saving S195380V... Getting applications for Yarra City Council... Saving S196492J... Saving S196503H... Saving S196114H... Getting applications for Yarra Ranges Shire Council... Saving S196782P... Saving S196296J... Saving S196273M... Saving S196232T... Saving S196011E... Saving S195604E... Saving S195922A... Saving S191650J... Getting applications for Yarriambiack Shire Council... Saving S195851S... Saving S192927J...

Data

Downloaded 54166 times by slav123 openaustralia LoveMyData DevAppProject dcalde jesse-a-reilly GitHubMLee TheZepto srsmonty TornMarketing cankei NicMeg Jedwards157 AndreM101

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (45.3 MB) Use the API

rows 10 / 112707

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S026214J&cacheApplicationListContext=true
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
2 lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S024425C&cacheApplicationListContext=true
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S025191P&cacheApplicationListContext=true
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S010773J&cacheApplicationListContext=true
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S018317C&cacheApplicationListContext=true
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S013074J&cacheApplicationListContext=true
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S016718J&cacheApplicationListContext=true
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023304S&cacheApplicationListContext=true
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S021086C&cacheApplicationListContext=true
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
Two lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023932B&cacheApplicationListContext=true
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml

Statistics

Average successful run time: 15 minutes

Total run time: 29 days

Total cpu time used: about 7 hours

Total disk space used: 45.3 MB

History

  • Auto ran revision b640683c and completed successfully .
    728 records added, 670 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    712 records added, 678 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    679 records added, 652 records removed in the database
  • Auto ran revision b640683c and failed .
    44 records added, 40 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    694 records added, 685 records removed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

spear / scraper.rb