LoveMyData / cowra

Cowra Development Applications

README.md

Cowra Council scraper

  • System - myhorizon from solorient
  • Cookie tracking - Yes
  • Clearly defined data within a row - Yes
  • XML - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • thisweek (default)
  • thismonth
  • lastmonth
  • year (eg: 2017, minimum is 1961)

Enjoy

Contributors LoveMyData mlandauer

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on LoveMyData so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=49949842&repository_ids%5B%5D=134056878&repository_ids%5B%5D=47324812&repository_ids%5B%5D=88161914&repository_ids%5B%5D=68444421&repository_ids%5B%5D=47314642&repository_ids%5B%5D=93590295&repository_ids%5B%5D=68878229&repository_ids%5B%5D=72811725&repository_ids%5B%5D=56903014&repository_ids%5B%5D=170608803&repository_ids%5B%5D=108057954&repository_ids%5B%5D=92110889&repository_ids%5B%5D=67974508&repository_ids%5B%5D=87934825&repository_ids%5B%5D=145681800&repository_ids%5B%5D=47260725&repository_ids%5B%5D=88051332&repository_ids%5B%5D=91232291&repository_ids%5B%5D=47496147&repository_ids%5B%5D=68881868&repository_ids%5B%5D=47331141&repository_ids%5B%5D=87817830&repository_ids%5B%5D=177515286&repository_ids%5B%5D=46924700&repository_ids%5B%5D=106624312&repository_ids%5B%5D=46796215&repository_ids%5B%5D=91168909&repository_ids%5B%5D=67973091&repository_ids%5B%5D=107615216&repository_ids%5B%5D=85133473&repository_ids%5B%5D=91752802&repository_ids%5B%5D=47815673&repository_ids%5B%5D=99768398&repository_ids%5B%5D=67903220&repository_ids%5B%5D=104952368&repository_ids%5B%5D=51361943&repository_ids%5B%5D=47970061&repository_ids%5B%5D=67978193&repository_ids%5B%5D=104017335&repository_ids%5B%5D=47314661&repository_ids%5B%5D=46924659&repository_ids%5B%5D=91053021&repository_ids%5B%5D=156531533&repository_ids%5B%5D=96767060&repository_ids%5B%5D=57299199&repository_ids%5B%5D=156799498&repository_ids%5B%5D=159443632&repository_ids%5B%5D=47876278&repository_ids%5B%5D=159422813&repository_ids%5B%5D=47313800&repository_ids%5B%5D=107520757&repository_ids%5B%5D=88119130&repository_ids%5B%5D=95849825&repository_ids%5B%5D=68373869&repository_ids%5B%5D=46966464&repository_ids%5B%5D=102549557&repository_ids%5B%5D=152169956&repository_ids%5B%5D=69199374&repository_ids%5B%5D=47871639&repository_ids%5B%5D=108206347&repository_ids%5B%5D=92701523&repository_ids%5B%5D=124995950&repository_ids%5B%5D=98845885&repository_ids%5B%5D=68511763&repository_ids%5B%5D=85155894&repository_ids%5B%5D=47400030&repository_ids%5B%5D=105615080&repository_ids%5B%5D=90943444&repository_ids%5B%5D=97595478&repository_ids%5B%5D=68342363&repository_ids%5B%5D=46921298&repository_ids%5B%5D=68098781&repository_ids%5B%5D=47917197&repository_ids%5B%5D=174301699&repository_ids%5B%5D=88171467&repository_ids%5B%5D=92243788&repository_ids%5B%5D=103522127&repository_ids%5B%5D=97825255&repository_ids%5B%5D=57381657&repository_ids%5B%5D=107633285&repository_ids%5B%5D=58468748&repository_ids%5B%5D=107853888&repository_ids%5B%5D=107861107&repository_ids%5B%5D=91777660&repository_ids%5B%5D=107852602&repository_ids%5B%5D=49410115&repository_ids%5B%5D=47873122&repository_ids%5B%5D=47874423&repository_ids%5B%5D=100552305&repository_ids%5B%5D=92278881&repository_ids%5B%5D=96265559&suggested_target_id=15683093 Why? See https://morph.io/documentation/github_app

Data

Downloaded 1563 times by LoveMyData dcalde

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.12 MB) Use the API

rows 10 / 3725

council_reference address description info_url comment_url date_scraped date_received
DA 2017/149.1
Elouera Road COWRA 2794 NSW
New Building Rural Garage/Shed
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
mailto:council@cowra.nsw.gov.au
2017-10-20
2017-10-13
DA 2017/148.1
85-87 Lyall Street COWRA 2794 NSW
New Building Residential Dwelling
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
mailto:council@cowra.nsw.gov.au
2017-10-20
2017-10-13
DA 2017/147.1
102 Redfern Street COWRA 2794 NSW
New Building Residential Pergola/Awning/Patio
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
mailto:council@cowra.nsw.gov.au
2017-10-20
2017-10-13
DA 2017/146.1
36 Gower Hardy Circuit COWRA 2794 NSW
New Building Residential Garage/Shed
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
mailto:council@cowra.nsw.gov.au
2017-10-20
2017-10-13
DA 2017/145.1
75 Darling Street COWRA 2794 NSW
New Building Flats (Two or more residential units)
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
mailto:council@cowra.nsw.gov.au
2017-10-20
2017-10-12
DA 2017/144.1
18 Bank Street GOOLOOGONG 2805 NSW
New Building Rural Garage/Shed
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
mailto:council@cowra.nsw.gov.au
2017-10-20
2017-10-12
CDC 2017/39.1
603 Grenfell Road COWRA 2794 NSW
New Building Residential Swimming Pool
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
mailto:council@cowra.nsw.gov.au
2017-10-20
2017-10-12
DA 2017/143.1
Clements Road WOODSTOCK 2793 NSW
Dwelling
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
mailto:council@cowra.nsw.gov.au
2017-10-20
2017-10-11
CC 2017/143.1
Clements Road WOODSTOCK 2793 NSW
New Building Rural Dwelling
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
mailto:council@cowra.nsw.gov.au
2017-10-20
2017-10-11
CDC 2017/38.1
16 East Street WOODSTOCK 2793 NSW
New Building Residential Swimming Pool
http://myhorizon.solorient.com.au/Horizon/logonGuest.aw?domain=horizondap_cowra
mailto:council@cowra.nsw.gov.au
2017-10-20
2017-10-11

Statistics

Average successful run time: less than a minute

Total run time: 1 day

Total cpu time used: 27 minutes

Total disk space used: 1.15 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

cowra / scraper.rb