LoveMyData / lithgow_city_council_development_applications

Lithgow City Development Applications


Lithgow City Council Scraper

This site is a typical .NET site involves the followings.

  • Cookie - No
  • Pagnation - Yes
  • Javascript - Yes
  • Structured HTML - Good

Setup MORPH_PERIOD for data recovery, available options are

  • L14 - last 14 days (default)
  • thismonth
  • lastmonth

Enjoy

Contributors adamclayton LoveMyData

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting 'L14' data, changable via MORPH_PERIOD environment /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:906:in `rescue in block in connect': Failed to open TCP connection to eservices.lithgow.nsw.gov.au:443 (getaddrinfo: Name or service not known) (SocketError) from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:903:in `block in connect' from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/timeout.rb:93:in `block in timeout' from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/timeout.rb:103:in `timeout' from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:902:in `connect' from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:887:in `do_start' from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:882:in `start' from /app/vendor/bundle/ruby/2.4.0/gems/net-http-persistent-3.0.0/lib/net/http/persistent.rb:692:in `start' from /app/vendor/bundle/ruby/2.4.0/gems/net-http-persistent-3.0.0/lib/net/http/persistent.rb:622:in `connection_for' from /app/vendor/bundle/ruby/2.4.0/gems/net-http-persistent-3.0.0/lib/net/http/persistent.rb:927:in `request' from /app/vendor/bundle/ruby/2.4.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:280:in `fetch' from /app/vendor/bundle/ruby/2.4.0/gems/mechanize-2.7.6/lib/mechanize.rb:464:in `get' from scraper.rb:64:in `<main>'

Data

Downloaded 978 times by LoveMyData dcalde MichaelBone

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (630 KB) Use the API

rows 10 / 1681

council_reference address description info_url comment_url date_scraped date_received
CC226/18
Hill Range Crescent LITHGOW NSW 2790
INSTALL SHED FOR STORAGE & RE- CHLORINATION SYSTEM
mailto:council@lithgow.nsw.gov.au
2018-11-28
2018-10-24
CC225/18
11 Oscar Parade PORTLAND NSW 2847
PRIVATE - SINGLE DWELLING
mailto:council@lithgow.nsw.gov.au
2018-11-28
2018-10-19
CC212/18
18 Sandalwood Drive LITHGOW NSW 2790
SHED
mailto:council@lithgow.nsw.gov.au
2018-11-28
2018-10-02
CC213/18
1 Tom Lesslie Place SOUTH BOWENFELS NSW 2790
DWELLING
mailto:council@lithgow.nsw.gov.au
2018-11-28
2018-10-04
CC214/18
16 Sandalwood Drive LITHGOW NSW 2790
SHED
mailto:council@lithgow.nsw.gov.au
2018-11-28
2018-10-04
CC215/18
20 Girraween Drive MARRANGAROO NSW 2790
Subdivision, Removal of Aboveground Pool and Dwelling
mailto:council@lithgow.nsw.gov.au
2018-11-28
2018-10-05
CC216/18
74 Mort Street LITHGOW NSW 2790
SHED
mailto:council@lithgow.nsw.gov.au
2018-11-28
2018-10-05
CC217/18
5 Purcell Street PORTLAND NSW 2847
SHED
mailto:council@lithgow.nsw.gov.au
2018-11-28
2018-10-05
CC218/18
55 View Street LIDSDALE NSW 2790
CARPORT AND VERANDAH
mailto:council@lithgow.nsw.gov.au
2018-11-28
2018-10-09
CC219/18
4 Laidley Street LITHGOW NSW 2790
AWNING ATTACHED TO EXISTING SHED
mailto:council@lithgow.nsw.gov.au
2018-11-28
2018-10-09

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 22 minutes

Total disk space used: 675 KB

History

  • Auto ran revision 2d12cff4 and failed .
    nothing changed in the database
  • Auto ran revision 2d12cff4 and failed .
    nothing changed in the database
  • Auto ran revision 2d12cff4 and failed .
    nothing changed in the database
  • Auto ran revision 2d12cff4 and failed .
    nothing changed in the database
  • Auto ran revision 2d12cff4 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history