planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria


Contributors CloCkWeRX henare mlandauer archoo

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting applications for Alpine Resorts - Mt Buller... Getting applications for Alpine Shire Council - Bright Office... Saving S248444P... Saving S247429S... Getting applications for Ararat Rural City Council... Saving S247636E... Saving S247541E... Getting applications for Ballarat City Council... Saving S247710M... Saving S247630H... Getting applications for Banyule City Council... Saving S248698T... Saving S248375A... Saving S248363P... Saving S248273S... Saving S248219E... Saving S248173B... Saving S248078M... Saving S246393S... Saving S247797B... Saving S247504T... Saving S247374P... Getting applications for Bass Coast Shire Council... Saving S248720T... Saving S248281T... Saving S247663A... Saving S243988E... Saving S245765C... Saving S247403H... Saving S247343P... Getting applications for Baw Baw Shire Council... Saving S248427P... Saving S248325H... Saving S248327A... Saving S247670E... Saving S248117A... Saving S247601A... Saving S247409E... Getting applications for Bayside City Council... Saving S248205E... Saving S248146H... Saving S248114M... Saving S247323C... Saving S247572E... Getting applications for Benalla Rural City Council... Saving S247392J... Getting applications for Boroondara City Council... Saving S248043E... Saving S247999A... Saving S247839A... Saving S206296S... Saving S219944A... Saving S247578C... Getting applications for Borough of Queenscliffe... Getting applications for Brimbank City Council... Saving S248570C... Saving S248372M... Saving S248237B... Saving S248166T... Saving S248105P... Saving S248083C... Saving S247890A... Saving S246457S... Saving S247762T... Saving S247774C... Saving S247760C... Saving S247714T... Saving S247635J... Saving S247566T... Saving S247350V... Saving S247380B... Getting applications for Buloke Shire Council... Getting applications for Cardinia Shire Council... Saving S248682C... Saving S248562B... Saving S248599A... Saving S248390H... Saving S248388C... Saving S248299B... Saving S248183T... Saving S247755M... Saving S247754S... Saving S247753V... Saving S247786M... Saving S247721B... Saving S247545M... Saving S247544S... Saving S247662C... Saving S247577H... Saving S247574V... Saving S246680J... Saving S246685M... Saving S247499T... Saving S247498A... Saving S246619S... Saving S246617B... Getting applications for Casey City Council... Saving S247603P... Saving S242596E... Saving S248503M... Saving S248412T... Saving S248028V... Saving S248212M... Saving S248177H... Saving S247934M... Saving S247759T... Saving S246385P... Saving S247432S... Saving S247809T... Saving S246445H... Saving S247608S... Saving S247445V... Saving S247322H... Saving S247514M... Saving S247408J... Saving S247279B... Getting applications for Central Goldfields Shire Council... Saving S244082C... Getting applications for City of Greater Dandenong... Saving S248169E... Saving S247433M... Getting applications for City of Greater Geelong... Saving S248613V... Saving S248536C... Saving S248230H... Saving S248221J... Saving S248216T... Saving S248210V... Saving S248195C... Saving S247962B... Saving S247968A... Saving S247947S... Saving S247027M... Saving S247758A... Saving S247321M... Saving S247623B... Saving S247612M... Saving S247716J... Saving S247525B... Saving S247231P... Saving S247373T... Getting applications for City of Wodonga... Saving S247889P... Saving S247749B... Saving S247628C... Saving S247496H... Saving S247306C... Getting applications for Colac Otway Shire... Saving S248742V... Saving S248649A... Saving S248632M... Saving S248235J... Saving S248004C... Saving S247977V... Saving S246462H... Getting applications for Corangamite Shire Council... Saving S247520A... Getting applications for Darebin City Council... Saving S248596M... Saving S248386M... Saving S248361A... Saving S248218J... Saving S248112V... Saving S248097C... Saving S246715B... Saving S247414V... Saving S246693P... Getting applications for East Gippsland Shire Council... Saving S248643B... Saving S248635A... Saving S248240B... Saving S248414J... Saving S248324M... Saving S248250T... Getting applications for Frankston City Council... Saving S248731H... Saving S248667T... Saving S248661V... Saving S248550S... Saving S248463E... Saving S247878B... Saving S247621J... Getting applications for Gannawarra Shire Council... Getting applications for Glen Eira City Council... Saving S248710B... Saving S248660B... Saving S248425A... Saving S245346A... Saving S248566H... Saving S248506A... Saving S248498M... Saving S248460T... Saving S248441C... Saving S232534T... Saving S248410C... Saving S248385S... Saving S248377P... Saving S248127S... Saving S248076V... Saving S235566E... Saving S247866S... Saving S245107P... Saving S247470A... Saving S247167B... Saving S247398H... Saving S247386A... Saving S247303S... Getting applications for Glenelg Shire Council... Saving S248328T... Saving S247768S... Getting applications for Golden Plains Shire Council... Saving S248499H... Saving S248090J... Saving S247604J... Saving S247517A... Saving S247439J... Saving S247369A... Getting applications for Greater Bendigo City Council... Saving S248471H... Saving S248298E... Saving S248294A... Saving S248257M... Saving S248131M... Saving S248072P... Saving S248013B... Saving S247508B... Saving S237363P... Saving S247684E... Saving S247722V... Saving S247707M... Saving S247519P... Saving S247453A... Saving S246545A... Saving S244960T... Getting applications for Greater Shepparton City Council... Saving S248534M... Saving S248246A... Saving S248293C... Saving S247399C... Saving S247610V... Getting applications for Hepburn Shire Council... Saving S248619T... Saving S248666A... Saving S248563V... Saving S244326A... Saving S244316E... Getting applications for Hindmarsh Shire Council... Saving S247655V... Getting applications for Hobsons Bay City Council... Saving S248609B... Saving S248510T... Saving S238966J... Saving S248296P... Saving S248039J... Saving S247969T... Saving S247940A... Saving S247933S... Saving S247825A... Saving S247704B... Saving S247720E... Saving S245011T... Getting applications for Horsham Rural City Council... Saving S248428J... Saving S248336V... Saving S248122P... Saving S247317S... Getting applications for Hume City Council... Saving S248594V... Saving S248501V... Saving S248489P... Saving S248393T... Saving S248415E... Saving S248394P... Saving S248360C... Saving S246143T... Saving S248070A... Saving S248258H... Saving S248188V... Saving S240567T... Saving S247638V... Saving S247384H... Saving S247711H... Saving S247554J... Saving S247602T... Saving S246646J... Saving S247537J... Saving S247419A... Saving S247448H... Saving S247179J... Saving S247434H... Getting applications for Indigo Shire Council... Saving S248435S... Saving S248279P... Saving S247671B... Saving S247599J... Getting applications for Kingston City Council... Saving S247297V... Saving S248461P... Saving S248418S... Saving S248367V... Saving S248283J... Saving S248153P... Saving S248001S... Saving S248113S... Saving S247815E... Saving S247787H... Saving S247547C... Saving S247516C... Saving S247160H... Saving S247316V... Saving S246079E... Getting applications for Knox City Council... Saving S248620C... Saving S248524T... Saving S248168J... Saving S248119P... Saving S248036A... Saving S248096H... Saving S247524E... Saving S247828J... Saving S247813P... Saving S247594H... Saving S246611C... Saving S247459V... Getting applications for Latrobe City Council... Saving S229111S... Saving S248018C... Saving S247783B... Saving S247220B... Saving S247423T... Saving S247364V... Getting applications for Loddon Shire Council... Saving S248625E... Getting applications for Macedon Ranges Shire Council... Saving S248366B... Saving S248220P... Saving S247362E... Saving S248048H... Saving S238041C... Getting applications for Manningham City Council... Saving S248700H... Saving S248369M... Saving S248409T... Saving S248209M... Saving S247795J... Saving S247770V... Saving S247898M... Saving S247625S... Saving S247480S... Getting applications for Mansfield Shire Council... Saving S247744A... Saving S247531M... Saving S247527S... Getting applications for Maribyrnong City Council... Saving S248309C... Saving S247836M... Saving S247705V... Saving S247669V... Saving S247461B... Getting applications for Maroondah City Council... Saving S248303E... Saving S248192S... Saving S248067A... Saving S248052C... Saving S248027B... Saving S247960J... Saving S247660M... Saving S247587B... Saving S247568J... Saving S247383M... Getting applications for Melbourne City Council... Saving S234777M... Saving S247812T... Saving S246679B... Saving S247513S... Getting applications for Melton City Council... Saving S248657B... Saving S243624S... Saving S248371S... Saving S248356H... Saving S248355M... Saving S248354S... Saving S247665P... Saving S248118T... Saving S247446S... Saving S247248B... Saving S247805M... Saving S247640B... Saving S247771S... Saving S247732P... Saving S247510E... Saving S247239C... Saving S247435C... Getting applications for Merri-Bek City Council... Saving S248617C... Saving S248600S... Saving S246050J... Saving S248495B... Saving S248249J... Saving S244378E... Saving S248213H... Saving S248179A... Saving S248171J... Saving S248091E... Saving S248089B... Saving S248086P... Saving S247920M... Saving S248073J... Saving S246900M... Saving S247822M... Saving S247618J... Saving S247555E... Saving S247518T... Saving S247436A... Getting applications for Mildura Rural City Council... Saving S248256S... Saving S248233T... Saving S247901V... Saving S247900B... Saving S247914B... Saving S247739H... Saving S247738M... Saving S247558S... Saving S247533C... Saving S247441P... Saving S247351S... Saving S247346B... Getting applications for Minister for Planning - Others... Getting applications for Minister for Planning - Social Housing... Getting applications for Mitchell Shire Council... Saving S248271B... Getting applications for Moira Shire Council... Saving S248206B... Saving S247997H... Getting applications for Monash City Council... Saving S248263A... Saving S248227H... Saving S248165A... Saving S247966H... Saving S247952H... Saving S247870M... Saving S247861P... Saving S247845J... Saving S247588V... Saving S247502C... Saving S247437T... Saving S247427B... Saving S247355A... Getting applications for Moonee Valley City Council... Saving S248526J... Saving S247995S... Saving S247939P... Saving S248160V... Saving S248120A... Saving S248099T... Saving S186257V... Saving S247793T... Saving S247823H... Saving S247281E... Saving S247658H... Saving S247107S... Getting applications for Moorabool Shire Council... Saving S247611S... Getting applications for Mornington Peninsula Shire Council... Saving S247654B... Saving S248302J... Saving S248304B... Saving S248164C... Saving S248125B... Saving S247998C... Saving S248093V... Saving S247963V... Saving S247945B... Saving S247943J... Saving S247876J... Saving S247068E... Saving S247536P... Saving S247444B... Saving S247277J... Saving S247293P... Saving S247331E... Getting applications for Mount Alexander Shire Council... Saving S248551M... Saving S248424C... Saving S248012E... Saving S247871H... Saving S247789A... Saving S243850V... Saving S247359E... Getting applications for Moyne Shire Council... Saving S248156B... Getting applications for Murrindindi Shire Council... Saving S248149T... Getting applications for Nillumbik Shire Council... Saving S248274M... Saving S247938T... Getting applications for Northern Grampians Shire Council... Saving S248059V... Saving S247703E... Getting applications for Port Phillip City Council... Saving S248694M... Saving S248488T... Saving S248260M... Saving S248267E... Saving S248196A... Saving S248108B... Saving S247965M... Saving S247396S... Saving S247311T... Saving S247367H... Getting applications for Pyrenees Shire Council... Saving S248548M... Saving S247365S... Getting applications for Rural City of Wangaratta... Saving S248194H... Saving S244561B... Saving S247964S... Getting applications for Shire of Campaspe... Getting applications for South Gippsland Shire Council... Saving S248472C... Saving S248255V... Saving S247902S... Saving S247798V... Saving S247238H... Getting applications for Southern Grampians Shire Council... Saving S247606B... Saving S247639S... Saving S247641V... Saving S247676C... Saving S247626M... Saving S247584P... Getting applications for SPEAR Test Council... SubmittedDate is empty for S096692H. So, skipping. Getting applications for Stonnington City Council... Saving S229684J... Saving S248679C... Saving S246764V... Saving S247992E... Saving S248186E... Saving S247925P... Saving S247222S... Saving S247586E... Saving S247301B... Saving S246985J... Saving S247385C... Getting applications for Strathbogie Shire Council... Saving S248185J... Saving S244170J... Saving S247784V... Saving S247750J... Getting applications for Surf Coast Shire Council... Saving S248236E... Saving S248066C... Saving S247590B... Getting applications for Swan Hill Rural City Council... Saving S248538T... Getting applications for Towong Shire Council... Saving S247899H... Getting applications for Warrnambool City Council... Saving S246353T... Saving S247503A... Getting applications for Wellington Shire Council... Saving S248671P... Saving S248514B... Saving S247607V... Saving S248493J... Saving S247174H... Saving S247972T... Saving S247982M... Saving S247780P... Saving S247632A... Saving S247695T... Saving S247233E... Saving S247615A... Getting applications for West Wimmera Shire Council... Saving S248141E... Getting applications for Whitehorse City Council... Saving S248332P... Saving S248323S... Saving S247361J... Saving S248057E... Saving S248135T... Saving S248130S... Saving S247931B... Saving S247682P... Saving S247717E... Saving S247550C... Saving S247613H... Saving S247552T... Saving S246458M... Saving S247451H... Saving S247415S... Getting applications for Whittlesea City Council... Saving S248568A... Saving S248531B... Saving S248505C... Saving S248378J... Saving S247955T... Saving S247389J... Saving S247216E... Saving S247694A... Saving S231392S... Saving S247564C... Saving S247538E... Saving S247397M... Saving S247335M... Getting applications for Wyndham City Council... Saving S246713J... Saving S248170P... Saving S247799S... Saving S247803V... Saving S247339T... Saving S246923J... Saving S247575S... Saving S247430B... Saving S246179V... Saving S246559A... Saving S247334S... Saving S247327J... Getting applications for Yarra City Council... Getting applications for Yarra Ranges Shire Council... Saving S248438C... Saving S248128M... Saving S247097P... Saving S238173P... Saving S239752S... Saving S242903T... Getting applications for Yarriambiack Shire Council... Saving S248081M... Saving S247873A...

Data

Downloaded 83017 times by slav123 openaustralia LoveMyData dcalde mlandauer DevAppProject jesse-a-reilly repose-lecture GitHubMLee TheZepto srsmonty AriesXIX parsaie TornMarketing cankei NicMeg ponynoble Elliehancock Jedwards157 AndreM101 93399339 planningalerts-scrapers odnagroup

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (52.7 MB) Use the API

rows 10 / 139395

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
2012-09-17
2 lot resubdivision
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
2012-09-17
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
2012-09-17
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
2012-09-17
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
2012-09-17
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
2012-09-17
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
2012-09-17
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
2012-09-17
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
2012-09-17
Two lot resubdivision
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741

Statistics

Average successful run time: 15 minutes

Total run time: about 1 month

Total cpu time used: about 9 hours

Total disk space used: 52.8 MB

History

  • Auto ran revision b640683c and completed successfully .
    546 records added, 493 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    535 records added, 515 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    565 records added, 496 records removed in the database
  • Auto ran revision b640683c and failed .
    199 records added, 182 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    525 records added, 525 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

spear / scraper.rb