planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria

Forked from ScraperWiki

Contributors CloCkWeRX henare

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping Alpine Resorts - Mt Buller... Scraping Alpine Shire Council - Bright Office... Scraping Ararat Rural City Council... Scraping Ballarat City Council... Scraping Banyule City Council... Scraping Bass Coast Shire Council... Scraping Baw Baw Shire Council... Scraping Bayside City Council... Scraping Benalla Rural City Council... Scraping Boroondara City Council... Scraping Borough of Queenscliffe... Scraping Brimbank City Council... Scraping Buloke Shire Council... Scraping Cardinia Shire Council... Scraping Casey City Council... Scraping Central Goldfields Shire Council... Scraping City of Greater Dandenong... Scraping City of Greater Geelong... Scraping City of Wodonga... Scraping Colac Otway Shire... Scraping Corangamite Shire Council... Scraping Darebin City Council... Scraping East Gippsland Shire Council... Scraping Frankston City Council... Scraping Gannawarra Shire Council... Scraping Glen Eira City Council... Scraping Glenelg Shire Council... Scraping Golden Plains Shire Council... Scraping Greater Bendigo City Council... Scraping Greater Shepparton City Council... Scraping Hepburn Shire Council... Scraping Hindmarsh Shire Council... /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:304:in `fetch': 502 => Net::HTTPBadGateway for https://www.spear.land.vic.gov.au/spear/publicSearch/Search.do -- unhandled response (Mechanize::ResponseCodeError) from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:949:in `response_redirect' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:299:in `fetch' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize.rb:407:in `get' from scraper.rb:80:in `applications' from scraper.rb:102:in `block in <main>' from scraper.rb:100:in `each' from scraper.rb:100:in `<main>'

Data

Downloaded 6357 times by slav123 openaustralia LoveMyData jesse-a-reilly GitHubMLee TheZepto srsmonty TornMarketing Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (34.7 MB) Use the API

rows 10 / 85466

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S026214J&cacheApplicationListContext=true
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
2 lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S024425C&cacheApplicationListContext=true
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S025191P&cacheApplicationListContext=true
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S010773J&cacheApplicationListContext=true
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S018317C&cacheApplicationListContext=true
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S013074J&cacheApplicationListContext=true
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S016718J&cacheApplicationListContext=true
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023304S&cacheApplicationListContext=true
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S021086C&cacheApplicationListContext=true
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml
2012-09-17
Two lot resubdivision
https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?spearNum=S023932B&cacheApplicationListContext=true
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741
https://www.spear.land.vic.gov.au/spear/pages/public-and-other-users/objectors.shtml

Statistics

Average successful run time: 10 minutes

Total run time: 15 days

Total cpu time used: about 3 hours

Total disk space used: 34.7 MB

History

  • Auto ran revision 49882c9b and failed .
    7 records added in the database
  • Auto ran revision 49882c9b and failed .
    16 records added in the database
  • Auto ran revision 49882c9b and failed .
    25 records added in the database
  • Auto ran revision 49882c9b and failed .
    5 records added in the database
  • Auto ran revision 49882c9b and failed .
    14 records added in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

spear / scraper.rb