planningalerts-scrapers / spear

Streamlined Planning through Electronic Applications and Referrals Victoria


Forked from ScraperWiki

Contributors CloCkWeRX henare mlandauer

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping Alpine Shire Council - Bright Office... Scraping Ararat Rural City Council... Scraping Ballarat City Council... /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:304:in `fetch': 502 => Net::HTTPBadGateway for https://www.spear.land.vic.gov.au/spear/applicationDetails/RetrievePublicApplication.do?cacheApplicationListContext=true&spearNum=S141417S -- unhandled response (Mechanize::ResponseCodeError) from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize.rb:407:in `get' from scraper.rb:53:in `extract_description' from scraper.rb:41:in `block in extract_page_data' from scraper.rb:15:in `each' from scraper.rb:15:in `extract_page_data' from scraper.rb:83:in `applications' from scraper.rb:98:in `block in <main>' from scraper.rb:96:in `each' from scraper.rb:96:in `<main>'

Data

Downloaded 6732 times by slav123 openaustralia LoveMyData jesse-a-reilly GitHubMLee TheZepto srsmonty TornMarketing Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (34.8 MB) Use the API

rows 10 / 85690

date_scraped description info_url date_received council_reference address comment_url
2012-09-17
2012-08-13
S026214J
33 DEACON AVENUE, BRIGHT VIC 3741
2012-09-17
2 lot resubdivision
2012-06-20
S024425C
15 DELANY AVENUE, BRIGHT VIC 3741
2012-09-17
2012-07-16
S025191P
MILL ROAD MOUNT BEAUTY 3699
2012-09-17
2010-12-02
S010773J
2/29A BAKERS GULLY ROAD, BRIGHT VIC 3741
2012-09-17
2011-11-07
S018317C
73 STATION STREET, POREPUNKAH VIC 3740
2012-09-17
2011-04-08
S013074J
51 DELANY AVENUE, BRIGHT VIC 3741
2012-09-17
2011-09-08
S016718J
7 THE TRACK, BRIGHT VIC 3741
2012-09-17
2012-05-14
S023304S
6 DIGGINGS ROAD, TAWONGA VIC 3697
2012-09-17
2012-02-24
S021086C
137 SCHOOL ROAD, WANDILIGONG VIC 3744
2012-09-17
Two lot resubdivision
2012-06-05
S023932B
8 TYNTYNDER LANE, BRIGHT VIC 3741

Statistics

Average successful run time: 10 minutes

Total run time: 15 days

Total cpu time used: about 3 hours

Total disk space used: 34.9 MB

History

  • Auto ran revision ae68cdaf and failed .
    91 records added, 91 records removed in the database
  • Auto ran revision ae68cdaf and failed .
    91 records added, 91 records removed in the database
  • Auto ran revision ae68cdaf and failed .
    91 records added, 91 records removed in the database
  • Auto ran revision ae68cdaf and failed .
    91 records added, 90 records removed in the database
  • Auto ran revision ae68cdaf and failed .
    91 records added, 89 records removed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

spear / scraper.rb