LoveMyData / marrickville

Marrickville Council Development Applications


Inner West Council Scraper

This site is a typical .NET site involves the followings.

  • Cookie - No
  • Pagnation - Yes
  • Javascript - Yes
  • Structured HTML - Good

Setup MORPH_PERIOD for data recovery, available options are

  • L14 - last 14 days (default)
  • thismonth
  • lastmonth

Enjoy

Contributors henare equivalentideas LoveMyData

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/......  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching connection_pool 2.2.2  Fetching unf_ext 0.0.7.5  Fetching httpclient 2.8.3  Installing connection_pool 2.2.2  Fetching mime-types-data 3.2018.0812  Installing unf_ext 0.0.7.5 with native extensions  Installing httpclient 2.8.3  Installing mime-types-data 3.2018.0812  Fetching net-http-digest_auth 1.4.1  Fetching mini_portile2 2.3.0  Installing net-http-digest_auth 1.4.1  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.2  Installing webrobots 0.1.2  Fetching sqlite3 1.3.13  Installing mini_portile2 2.3.0  Installing sqlite3 1.3.13 with native extensions  Fetching net-http-persistent 3.0.0  Installing net-http-persistent 3.0.0  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.8.5  Installing nokogiri 1.8.5 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Bundle complete! 2 Gemfile dependencies, 19 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (23.13s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Getting 'L14' data, changable via MORPH_PERIOD environment /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:904:in `initialize': execution expired (Net::OpenTimeout) from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:904:in `open' from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:904:in `block in connect' from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/timeout.rb:103:in `timeout' from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:902:in `connect' from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:887:in `do_start' from /app/vendor/ruby-2.4.1/lib/ruby/2.4.0/net/http.rb:882:in `start' from /app/vendor/bundle/ruby/2.4.0/gems/net-http-persistent-3.0.0/lib/net/http/persistent.rb:692:in `start' from /app/vendor/bundle/ruby/2.4.0/gems/net-http-persistent-3.0.0/lib/net/http/persistent.rb:622:in `connection_for' from /app/vendor/bundle/ruby/2.4.0/gems/net-http-persistent-3.0.0/lib/net/http/persistent.rb:927:in `request' from /app/vendor/bundle/ruby/2.4.0/gems/mechanize-2.7.6/lib/mechanize/http/agent.rb:280:in `fetch' from /app/vendor/bundle/ruby/2.4.0/gems/mechanize-2.7.6/lib/mechanize.rb:464:in `get' from scraper.rb:64:in `<main>'

Data

Downloaded 1246 times by LoveMyData dcalde MichaelBone

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (534 KB) Use the API

rows 10 / 880

council_reference description on_notice_to address info_url comment_url date_scraped date_received
DA201800359
to construct a 3 storey mixed use development containing a café on the ground floor and boarding house above with associated parking
2018-10-09
51 Frederick Street ST PETERS NSW 2044
mailto:council@innerwest.nsw.gov.au?subject=Development Application - DA201800359
2018-10-09
DA201700003.01
under Section 4.55 of the Environmental Planning and Assessment Act to modify Determination No. 201700003 dated 13 October 2017 to carry out a number of design changes both internal and external including altering the commercial floor plate, waste rooms, car parking layout and number of car spaces, relocate an OSD tank, increase the number of residential units from 46 to 47, alter balconies, reduce the width of the pedestrian entry to New Canterbury Road, delete a substation and replace vertical blades with operable screens
2018-10-09
147 New Canterbury Road LEWISHAM NSW 2049
mailto:council@innerwest.nsw.gov.au?subject=Development Application - DA201700003.01
2018-10-09
DA201800364
to construct a shared cycle and pedestrian path (shared path) and associated works which forms part of a Greenway link spanning approximately 730 metres in length. The shared path connects the cycle route from Parramatta Road, generally following the Inner West Light Rail and the Hawthorne Canal to Old Canterbury Road passing through the suburbs of Lewisham and Summer Hill. The works include construction of culverts, fencing, rest areas, suspended approach ramps, retaining walls, the provision of handrails and balustrades to elevated portions of the shared path with associated landscaping and tree planting.
2018-10-09
Weston Street DULWICH HILL NSW 2203
mailto:council@innerwest.nsw.gov.au?subject=Development Application - DA201800364
2018-10-09
DA201400213.03
under Section 4.55 of the Environmental Planning and Assessment Act to modify Modified Determination No. 201400213002 dated 21 January 2015 to modify floor levels, parts of the internal layout, alter openings and skylights and extend the rear building line of the main dwelling
2018-10-09
52 Arthur Street MARRICKVILLE NSW 2204
mailto:council@innerwest.nsw.gov.au?subject=Development Application - DA201400213.03
2018-10-09
DA201600221.03
under Section 4.55 of the Environmental Planning and Assessment Act to modify Modified Determination No.201600221.02 dated 17 September 2018 to modify the internal layout of Unit 301 and enclose the northern terrace to form part of the living room, relocate and alter windows and alter conditions relating to car parking
2018-10-16
392 Illawarra Road MARRICKVILLE NSW 2204
mailto:council@innerwest.nsw.gov.au?subject=Development Application - DA201600221.03
2018-10-09
DA201800378
to demolish part of the premises and construct a secondary dwelling at the rear of the existing dwelling
2018-10-16
326 New Canterbury Road LEWISHAM NSW 2049
mailto:council@innerwest.nsw.gov.au?subject=Development Application - DA201800378
2018-10-09
DA201800379
to install a pool in the rear yard and carry out associated landscaping works
2018-10-09
26 David Street MARRICKVILLE NSW 2204
mailto:council@innerwest.nsw.gov.au?subject=Development Application - DA201800379
2018-10-09
DA201800380
to construct a 2 storey building fronting Charles Street, comprising a garage on the ground floor and secondary dwelling on the first floor
2018-10-09
8 Charles Street ENMORE NSW 2042
mailto:council@innerwest.nsw.gov.au?subject=Development Application - DA201800380
2018-10-09
DA201800381
to demolish part of the premises and carry out ground and first floor alterations and additions to a dwelling house including construction of a new garage and installation of a pool in the rear yard
2018-10-09
38 Unwins Bridge Road ST PETERS NSW 2044
mailto:council@innerwest.nsw.gov.au?subject=Development Application - DA201800381
2018-10-09
DA201800382
to demolish part of the premises and carry out ground and first floor alterations and additions to a dwelling house and to construct a 2 storey structure at the rear of the site comprising a garage on the ground floor and studio on the first floor
2018-10-09
30 Belmore Street ENMORE NSW 2042
mailto:council@innerwest.nsw.gov.au?subject=Development Application - DA201800382
2018-10-09

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 19 minutes

Total disk space used: 567 KB

History

  • Auto ran revision 7f93ecd7 and failed .
    nothing changed in the database
  • Auto ran revision 7f93ecd7 and failed .
    nothing changed in the database
  • Auto ran revision 7f93ecd7 and failed .
    nothing changed in the database
  • Auto ran revision 7f93ecd7 and failed .
    nothing changed in the database
  • Auto ran revision 7f93ecd7 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

marrickville / scraper.rb