planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria

Contributors CloCkWeRX henare mlandauer archoo

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting applications for Alpine Resorts - Mt Buller... Getting applications for Alpine Shire Council - Bright Office... Saving S249434J... Getting applications for Ararat Rural City Council... Getting applications for Ballarat City Council... Saving S250279S... Saving S250142C... Saving S249906B... Saving S249494T... Saving S249421E... Saving S249500P... Getting applications for Banyule City Council... Saving S250565P... Saving S250596P... Saving S250571B... Saving S249329C... Saving S250350M... Saving S249814M... Saving S249945C... Saving S249693E... Saving S249486S... Saving S249467B... Getting applications for Bass Coast Shire Council... Saving S250357E... Saving S247908P... Saving S245833A... Saving S249540M... Saving S249708J... Saving S249817A... Saving S249593P... Saving S249399E... Saving S249544T... Saving S249523M... Saving S249495P... Saving S249461C... Saving S249433P... Getting applications for Baw Baw Shire Council... Saving S250536E... Saving S250411B... Saving S250410E... Saving S250064P... Saving S249997J... Saving S249642T... Saving S249673T... Saving S249072C... Getting applications for Bayside City Council... Saving S249967E... Saving S249930H... Saving S249866T... Saving S249844S... Saving S249704C... Saving S249569H... Getting applications for Benalla Rural City Council... Saving S250256T... Getting applications for Boroondara City Council... Saving S250417A... Saving S249979P... Saving S249665S... Saving S249691P... Saving S249649M... Saving S249565B... Saving S248623P... Saving S249542C... Saving S249507H... Saving S249443H... Getting applications for Borough of Queenscliffe... Getting applications for Brimbank City Council... Saving S250423J... Saving S250334H... Saving S250329S... Saving S250084B... Saving S250049E... Saving S250005B... Saving S249865A... Saving S249616V... Saving S248446E... Getting applications for Buloke Shire Council... Getting applications for Cardinia Shire Council... scraper.rb:39:in `applications_page': undefined method `[]' for nil:NilClass (NoMethodError) from scraper.rb:77:in `block in all_applications' from scraper.rb:76:in `loop' from scraper.rb:76:in `all_applications' from scraper.rb:106:in `block in <main>' from scraper.rb:102:in `each' from scraper.rb:102:in `<main>'

Data

Downloaded 83103 times by slav123 openaustralia LoveMyData dcalde mlandauer DevAppProject jesse-a-reilly repose-lecture GitHubMLee TheZepto srsmonty AriesXIX parsaie cankei NicMeg TornMarketing AndreM101 93399339 planningalerts-scrapers odnagroup ponynoble Elliehancock Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (53 MB) Use the API

rows 10 / 140380

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S026214J&cacheApplicationListContext=true
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
2 lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S024425C&cacheApplicationListContext=true
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S025191P&cacheApplicationListContext=true
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S010773J&cacheApplicationListContext=true
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S018317C&cacheApplicationListContext=true
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S013074J&cacheApplicationListContext=true
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S016718J&cacheApplicationListContext=true
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023304S&cacheApplicationListContext=true
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S021086C&cacheApplicationListContext=true
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
Two lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023932B&cacheApplicationListContext=true
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml

Statistics

Average successful run time: 15 minutes

Total run time: about 1 month

Total cpu time used: about 9 hours

Total disk space used: 53.1 MB

History

  • Auto ran revision b640683c and failed .
    64 records added, 63 records removed in the database
  • Auto ran revision b640683c and failed .
    27 records added, 27 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    600 records added, 565 records removed in the database
  • Auto ran revision b640683c and completed successfully .
    569 records added, 569 records removed in the database
  • Auto ran revision b640683c and failed .
    271 records added, 271 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

spear / scraper.rb