planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria


Forked from ScraperWiki

Contributors CloCkWeRX henare mlandauer archoo dependabot[bot]

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.5.1 -----> Installing dependencies using bundler version 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/...........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching mime-types-data 3.2021.0225  Fetching multi_xml 0.6.0  Fetching httpclient 2.8.3  Installing multi_xml 0.6.0  Installing mime-types-data 3.2021.0225  Installing httpclient 2.8.3  Fetching sqlite3 1.4.2  Fetching mime-types 3.3.1  Installing mime-types 3.3.1  Installing sqlite3 1.4.2 with native extensions  Fetching httparty 0.18.1  Installing httparty 0.18.1  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Bundle complete! 2 Gemfile dependencies, 9 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from httparty:  When you HTTParty, you must party hard!  Bundle completed (8.46s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting applications for Alpine Shire Council - Bright Office... Getting applications for Ararat Rural City Council... Saving S188003T... Saving S187904T... Getting applications for Ballarat City Council... Saving S187952T... Getting applications for Banyule City Council... Saving S188433M... Saving S187921T... Saving S187908B... Saving S187893V... Getting applications for Bass Coast Shire Council... Saving S188326P... Saving S188257A... Saving S188255H... Saving S187867A... Saving S188040E... Saving S188033A... Saving S188023E... Saving S187797M... Saving S187790T... Saving S187718M... Getting applications for Baw Baw Shire Council... Saving S188267S... Getting applications for Bayside City Council... Saving S187255T... Saving S187833M... Saving S187059T... Getting applications for Benalla Rural City Council... Saving S187837T... Saving S187836A... Getting applications for Boroondara City Council... Saving S188188H... Saving S188166E... Saving S187944S... Saving S187941E... Getting applications for Borough of Queenscliffe... Saving S188106V... Getting applications for Brimbank City Council... Saving S188209A... Saving S188176A... Saving S187923J... Saving S187912V... Saving S187889B... Getting applications for Buloke Shire Council... Getting applications for Cardinia Shire Council... Saving S188182J... Saving S174236B... Getting applications for Casey City Council... Saving S188288A... Saving S188275T... Saving S188237M... Saving S188116P... Saving S188149E... Saving S188156M... Saving S188129T... Saving S187996A... Saving S187968J... Saving S187494C... Saving S187688A... Saving S187683V... Saving S187909V... Saving S187880S... Saving S187879H... Saving S187857E... Saving S187828V... Saving S187760P... Getting applications for Central Goldfields Shire Council... Saving S188112H... Saving S187985J... Saving S187877S... Getting applications for City of Greater Dandenong... Saving S188115T... Saving S187834H... Saving S187813B... Getting applications for City of Greater Geelong... Saving S188266V... Saving S188211C... Saving S188196J... Saving S188174H... Saving S188185V... Saving S188168V... Saving S188170B... Saving S188102P... Saving S187922P... Saving S186985V... Saving S187903A... Saving S164345C... Saving S187947C... Saving S186706P... Saving S187914M... Getting applications for City of Wodonga... Saving S188350V... Getting applications for Colac Otway Shire... Saving S187905P... Getting applications for Corangamite Shire Council... Saving S187907E... Saving S187822A... Getting applications for Darebin City Council... Getting applications for East Gippsland Shire Council... Getting applications for Frankston City Council... Saving S188213T... Saving S186682M... Saving S188058M... Saving S187496T... Saving S187756T... Getting applications for Gannawarra Shire Council... Getting applications for Glen Eira City Council... Saving S185934V... Saving S188230T... Saving S188351S... Saving S188263J... Saving S188246J... Saving S188228P... Saving S188121E... Saving S188047A... Saving S187715B... Saving S187843E... Saving S187826E... Saving S187794B... Saving S187781V... Saving S187770H... Saving S187372J... Getting applications for Glenelg Shire Council... Getting applications for Golden Plains Shire Council... Saving S188325T... Saving S188094C... Getting applications for Greater Bendigo City Council... Saving S188426E... Saving S188232J... Saving S188208C... Saving S188198B... Saving S185880P... Saving S188076H... Saving S187852C... Saving S187787T... Getting applications for Greater Shepparton City Council... Saving S188418C... Getting applications for Hepburn Shire Council... Saving S188260A... Saving S187764V... Getting applications for Hindmarsh Shire Council... Getting applications for Hobsons Bay City Council... Saving S188314E... Saving S188201J... Saving S187394M... Saving S187989S... Saving S187806T... Getting applications for Horsham Rural City Council... Saving S188217B... Saving S188099E... Getting applications for Hume City Council... Saving S188231P... Saving S188271M... Saving S188118E... Saving S188117J... Saving S188073V... Saving S187957V... Saving S187937J... Saving S187767H... Getting applications for Indigo Shire Council... Saving S187928M... Saving S187774P... Getting applications for Kingston City Council... Saving S188310A... Saving S188270S... Saving S188292T... Saving S188264E... Saving S187765S... Saving S188056V... Saving S188159A... Saving S187105M... Saving S188109H... Saving S187700E... Saving S188087V... Saving S187829S... Getting applications for Knox City Council... Saving S188186S... Saving S188184B... Saving S188178P... Saving S188161C... Saving S188008V... Getting applications for Latrobe City Council... Saving S188105B... Getting applications for Loddon Shire Council... Getting applications for Macedon Ranges Shire Council... Saving S188132T... Saving S188173M... Saving S187786A... Saving S187785C... Getting applications for Manningham City Council... Saving S188183E... Saving S188140V... Saving S187871T... Saving S187811J... Getting applications for Mansfield Shire Council... Saving S188221V... Saving S188061M... Saving S187722H... Getting applications for Maribyrnong City Council... Saving S188273C... Saving S187920A... Saving S187910E... Saving S186655T... Getting applications for Maroondah City Council... Saving S188422A... Saving S188349M... Saving S188240M... Saving S188233E... Saving S187689T... Saving S188123V... Getting applications for Melbourne City Council... Saving S188043S... Saving S188042V... Saving S188041B... Saving S188039V... Saving S188038B... Saving S188036J... Saving S188035P... Saving S188034T... Saving S188024B... Saving S188020T... Saving S188019J... Saving S188018P... Saving S188016A... Saving S188015C... Saving S188014H... Saving S187992S... Saving S188181P... Saving S187991V... Saving S187953P... Saving S187943V... Getting applications for Melton City Council... Saving S187878M... Saving S187945M... Saving S183946C... Getting applications for Mildura Rural City Council... Getting applications for Minister for Planning - Others... Getting applications for Minister for Planning - Social Housing... Getting applications for Mitchell Shire Council... Saving S187976M... Saving S187940J... Saving S186122A... Getting applications for Moira Shire Council... Saving S188400V... Saving S187915H... Saving S187896H... Saving S187844B... Getting applications for Monash City Council... Saving S188220B... Saving S184222M... Saving S188180T... Saving S188111M... Saving S187918T... Saving S163463B... Saving S187993M... Saving S187972E... Saving S187819A... Saving S186284P... Getting applications for Moonee Valley City Council... Saving S188393E... Saving S188167B... Saving S188126H... Saving S188021P... Getting applications for Moorabool Shire Council... Getting applications for Moreland City Council... Saving S188307A... Saving S188127C... Saving S187984P... Saving S187956B... Getting applications for Mornington Peninsula Shire Council... Saving S188218V... Saving S147431M... Saving S186664S... Saving S187181B... Saving S187846S... Saving S187840T... Saving S187827B... Saving S187780B... Getting applications for Mount Alexander Shire Council... Saving S185823S... Getting applications for Moyne Shire Council... Getting applications for Murrindindi Shire Council... Saving S187830B... Getting applications for Nillumbik Shire Council... Saving S187942B... Saving S187916C... Getting applications for Northern Grampians Shire Council... Saving S187862V... Getting applications for Port Phillip City Council... Saving S187810P... Saving S187902C... Getting applications for Pyrenees Shire Council... Getting applications for Rural City of Wangaratta... Saving S188187M... Saving S187998P... Saving S188009S... Saving S187851H... Saving S187598B... Getting applications for Shire of Campaspe... Getting applications for South Gippsland Shire Council... Getting applications for Southern Grampians Shire Council... Getting applications for SPEAR Test Council... SubmittedDate is empty for S096692H. So, skipping. Getting applications for Stonnington City Council... Saving S188291A... Saving S142422V... Saving S188226A... Saving S188107S... Saving S187783M... Saving S186998B... Getting applications for Strathbogie Shire Council... Getting applications for Surf Coast Shire Council... Saving S187977H... Getting applications for Swan Hill Rural City Council... Getting applications for Towong Shire Council... Getting applications for Warrnambool City Council... Saving S187961S... Saving S187643A... Getting applications for Wellington Shire Council... Saving S186982J... Saving S186444A... Saving S188152E... Saving S172325B... Saving S187267C... Saving S187676P... Getting applications for West Wimmera Shire Council... Getting applications for Whitehorse City Council... Saving S188110S... Saving S188169S... Saving S188088S... Saving S187622S... Saving S187954J... Saving S187849C... Getting applications for Whittlesea City Council... Saving S188370H... Saving S187564P... Saving S188242C... Saving S187841P... Saving S188158C... Saving S188104E... Saving S188032C... Saving S187418P... Saving S187874E... Saving S187859V... Saving S187698S... Saving S187697V... Getting applications for Wyndham City Council... Saving S188268M... Saving S188189C... Saving S187978C... Saving S183087C... Saving S183086H... Saving S187866C... Saving S187530C... Saving S187824P... Getting applications for Yarra City Council... Saving S188194T... Saving S187842J... Getting applications for Yarra Ranges Shire Council... Saving S188245P... Saving S188210H... Saving S187634B... Saving S186730V... Saving S188057S... Saving S187970P... Saving S186961C... Saving S187728E... Getting applications for Yarriambiack Shire Council... Saving S187449P... Saving S187825J...

Data

Downloaded 49261 times by slav123 openaustralia LoveMyData DevAppProject dcalde jesse-a-reilly GitHubMLee TheZepto srsmonty TornMarketing cankei NicMeg Jedwards157 AndreM101

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (44 MB) Use the API

rows 10 / 107993

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
2012-09-17
2 lot resubdivision
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
2012-09-17
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
2012-09-17
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
2012-09-17
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
2012-09-17
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
2012-09-17
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
2012-09-17
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
2012-09-17
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
2012-09-17
Two lot resubdivision
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741

Statistics

Average successful run time: 15 minutes

Total run time: 27 days

Total cpu time used: about 7 hours

Total disk space used: 44 MB

History

  • Auto ran revision b640683c and completed successfully .
    288 records added, 243 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    244 records added, 209 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    210 records added, 209 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    218 records added, 218 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    218 records added, 193 records removed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

spear / scraper.rb