planningalerts-scrapers / leichhardt

Leichhardt Municipal Council Development Applications

Scrapes www.eservices.lmc.nsw.gov.au

Under Construction


A scraper for Development Applications published by Leichhardt Municipal Council in Australia.

Because the council is using an ICON system with an XML feed, this scraper is able to use the libiconrest_xml library.

Forked from ScraperWiki

Contributors equivalentideas

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby/Rack -----> Using Ruby version: ruby-1.9.3 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/...  Fetching dependency metadata from https://rubygems.org/..  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Rubygems 1.8.23.2 is not threadsafe, so your gems will be installed one at a time. Upgrade to Rubygems 2.1.0 or higher to enable parallel gem installation.  Fetching Ascii85 1.0.1  Installing Ascii85 1.0.1  Fetching aasm 3.0.8  Installing aasm 3.0.8  Fetching i18n 0.6.0  Installing i18n 0.6.0  Fetching multi_json 1.1.0  Installing multi_json 1.1.0  Fetching builder 3.0.0  Installing builder 3.0.0  Fetching arel 3.0.2  Installing arel 3.0.2  Fetching tzinfo 0.3.33  Installing tzinfo 0.3.33  Fetching addressable 2.2.7  Installing addressable 2.2.7  Fetching mime-types 1.17.2  Installing mime-types 1.17.2  Fetching awesome_print 1.0.2  Installing awesome_print 1.0.2  Fetching multi_xml 0.5.1  Installing multi_xml 0.5.1  Fetching json 1.6.5  Installing json 1.6.5 with native extensions  Fetching nokogiri 1.5.0  Installing nokogiri 1.5.0 with native extensions  Fetching uuidtools 2.1.3  Installing uuidtools 2.1.3  Using bundler 1.15.2  Fetching choice 0.1.4  Installing choice 0.1.4  Fetching chronic 0.6.7  Installing chronic 0.6.7  Fetching fastercsv 1.5.4  Installing fastercsv 1.5.4  Fetching oauth 0.4.5  Installing oauth 0.4.5  Fetching multipart-post 1.1.5  Installing multipart-post 1.1.5  Fetching ruby-ole 1.2.11.2  Installing ruby-ole 1.2.11.2  Fetching log4r 1.1.9  Installing log4r 1.1.9  Fetching posix-spawn 0.3.6  Installing posix-spawn 0.3.6 with native extensions  Fetching to_regexp 0.1.1  Installing to_regexp 0.1.1  Fetching upsert 0.3.4  Installing upsert 0.3.4  Fetching unf_ext 0.0.4  Installing unf_ext 0.0.4 with native extensions  Fetching fast-stemmer 1.0.1  Installing fast-stemmer 1.0.1 with native extensions  Fetching hashie 1.2.0  Installing hashie 1.2.0  Fetching gdata 1.1.2  Installing gdata 1.1.2  Fetching hpricot 0.8.4  Installing hpricot 0.8.4 with native extensions  Fetching htmlentities 4.3.1  Installing htmlentities 4.3.1  Fetching httpauth 0.1  Installing httpauth 0.1  Fetching httpclient 2.2.4  Installing httpclient 2.2.4  Fetching libxml-ruby 2.8.0  Installing libxml-ruby 2.8.0 with native extensions  Fetching net-http-digest_auth 1.1.1  Installing net-http-digest_auth 1.1.1  Fetching net-http-persistent 2.5.2  Installing net-http-persistent 2.5.2  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Fetching ruby-rc4 0.1.5  Installing ruby-rc4 0.1.5  Fetching shoulda-context 1.0.0  Installing shoulda-context 1.0.0  Fetching shoulda-matchers 1.0.0  Installing shoulda-matchers 1.0.0  Fetching polylines 0.1.0  Installing polylines 0.1.0  Fetching rack 1.4.1  Installing rack 1.4.1  Fetching rubyzip 0.9.4  Installing rubyzip 0.9.4  Fetching sqlite3 1.3.9  Installing sqlite3 1.3.9 with native extensions  Fetching simple_oauth 0.2.0  Installing simple_oauth 0.2.0  Fetching stringex 1.4.0  Installing stringex 1.4.0  Fetching trollop 1.16.2  Installing trollop 1.16.2  Fetching stackdeck 0.2.0  Installing stackdeck 0.2.0  Fetching tmail 1.2.7.1  Installing tmail 1.2.7.1 with native extensions  Fetching activesupport 3.2.6  Installing activesupport 3.2.6  Fetching typhoeus 0.3.3  Installing typhoeus 0.3.3 with native extensions  Fetching httparty 0.8.3  Installing httparty 0.8.3  Fetching money 5.0.0  Installing money 5.0.0  Fetching jwt 0.1.4  Installing jwt 0.1.4  Fetching rfgraph 0.3  Installing rfgraph 0.3  Fetching webrobots 0.0.12  Installing webrobots 0.0.12  Fetching sanitize 2.0.3  Installing sanitize 2.0.3  Fetching faraday 0.8.1  Installing faraday 0.8.1  Fetching spreadsheet 0.6.5.7  Installing spreadsheet 0.6.5.7  Fetching todonotes 0.1.0  Installing todonotes 0.1.0  Fetching unix_utils 0.0.14  Installing unix_utils 0.0.14  Fetching unf 0.0.4  Installing unf 0.0.4  Fetching pdf-reader 1.0.0  Installing pdf-reader 1.0.0  Fetching shoulda 3.0.1  Installing shoulda 3.0.1  Fetching sqlite_magic 0.0.3  Installing sqlite_magic 0.0.3  Fetching activemodel 3.2.6  Installing activemodel 3.2.6  Fetching fixed_width-multibyte 0.2.3  Installing fixed_width-multibyte 0.2.3  Fetching hash_digest 1.0.0  Installing hash_digest 1.0.0  Fetching sinew 1.0.3  Installing sinew 1.0.3  Fetching monster_mash 0.3.0  Installing monster_mash 0.3.0  Fetching aws-sdk 1.6.1  Installing aws-sdk 1.6.1  Fetching fletcher 0.4.1  Installing fletcher 0.4.1  Fetching oauth2 0.5.2  Installing oauth2 0.5.2  Fetching twitter 4.5.0  Installing twitter 4.5.0  Fetching domain_name 0.5.2  Installing domain_name 0.5.2  Fetching pismo 0.7.2  Installing pismo 0.7.2  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching activerecord 3.2.6  Installing activerecord 3.2.6  Fetching activeresource 3.2.6  Installing activeresource 3.2.6  Fetching alchemy_api 0.1.2  Installing alchemy_api 0.1.2  Fetching google-spreadsheet-ruby 0.1.8  Installing google-spreadsheet-ruby 0.1.8  Fetching google_drive 0.3.1  Installing google_drive 0.3.1  Fetching mechanize 2.5.1  Installing mechanize 2.5.1  Fetching active_record_inline_schema 0.5.7  Installing active_record_inline_schema 0.5.7  Fetching highrise 3.0.3  Installing highrise 3.0.3  Fetching roo 1.10.0  Installing roo 1.10.0  Fetching remote_table 2.0.2  Installing remote_table 2.0.2  Fetching errata 1.1.1  Installing errata 1.1.1  Fetching data_miner 2.3.4  Installing data_miner 2.3.4  Bundle complete! 86 Gemfile dependencies, 89 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from httparty:  When you HTTParty, you must party hard!  Post-install message from pdf-reader:  ********************************************  v1.0.0 of PDF::Reader introduced a new page-based API. There are extensive  examples showing how to use it in the README and examples directory.  For detailed documentation, check the rdocs for the PDF::Reader,  PDF::Reader::Page and PDF::Reader::ObjectHash classes.  The old API is marked as deprecated but will continue to work with no  visible warnings for now.  ********************************************  Bundle completed (61.51s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Skipping already saved record CC/2018/358 Skipping already saved record CCP/2018/356 Skipping already saved record CCP/2018/357 Skipping already saved record D/2018/624 Skipping already saved record OCP/2018/384 Skipping already saved record OCP/2018/385 Skipping already saved record OCP/2018/386 Skipping already saved record OCP/2018/387 Skipping already saved record PCAP/2018/431 Skipping already saved record PCAP/2018/432 Skipping already saved record PREDA/2018/301 Skipping already saved record PREDA/2018/302 Skipping already saved record PREDA/2018/303 Skipping already saved record T/2018/167 Skipping already saved record CCP/2018/359 Skipping already saved record D/2018/625 Skipping already saved record HEC/2018/50 Skipping already saved record M/2018/195 Skipping already saved record M/2018/196 Skipping already saved record OCP/2018/388 Skipping already saved record PCAP/2018/434 Skipping already saved record R/2018/97 Skipping already saved record A/2018/15 Skipping already saved record CDC/2018/170 Skipping already saved record CDCP/2018/168 Skipping already saved record CDCP/2018/169 Skipping already saved record OC/2018/391 Skipping already saved record OC/2018/392 Skipping already saved record OCP/2018/389 Skipping already saved record OCP/2018/390 Skipping already saved record PCAP/2018/436 Skipping already saved record PCAP/2018/437 Skipping already saved record PREDA/2018/304 Skipping already saved record PREDA/2018/305 Skipping already saved record PREDA/2018/306 Skipping already saved record CCP/2018/361 Skipping already saved record CDCP/2018/171 Skipping already saved record D/2018/626 Skipping already saved record D/2018/627 Skipping already saved record D/2018/628 Skipping already saved record M/2018/197 Skipping already saved record M/2018/198 Skipping already saved record OCP/2018/393 Skipping already saved record OCP/2018/394 Skipping already saved record PCAP/2018/439 Skipping already saved record PCAP/2018/440 Skipping already saved record PREDA/2018/307 Skipping already saved record PREDA/2018/308 Skipping already saved record R/2018/98 Skipping already saved record T/2018/168 Skipping already saved record CC/2018/362 Skipping already saved record D/2018/629 Skipping already saved record M/2018/199 Skipping already saved record OCP/2018/395 Skipping already saved record OCP/2018/396 Skipping already saved record OCP/2018/397 Skipping already saved record OCP/2018/398 Skipping already saved record PREDA/2018/309 Skipping already saved record PREDA/2018/310 Skipping already saved record PREDA/2018/311 Skipping already saved record T/2018/169 Skipping already saved record A/2018/16 Skipping already saved record CCP/2018/363 Skipping already saved record CCP/2018/364 Skipping already saved record CCP/2018/365 Skipping already saved record CDCP/2018/172 Skipping already saved record D/2018/630 Skipping already saved record D/2018/631 Skipping already saved record M/2018/201 Skipping already saved record OC/2018/399 Skipping already saved record OCP/2018/400 Skipping already saved record OCP/2018/401 Skipping already saved record OCP/2018/402 Skipping already saved record PCAP/2018/441 Skipping already saved record PREDA/2018/312 Skipping already saved record PREDA/2018/313 Skipping already saved record PREDA/2018/314 Skipping already saved record T/2018/170 Skipping already saved record T/2018/171 Skipping already saved record T/2018/172 Skipping already saved record BC/2018/85 Skipping already saved record CCP/2018/366 Skipping already saved record D/2018/632 Skipping already saved record OCP/2018/403 Skipping already saved record OCP/2018/404 Skipping already saved record OCP/2018/405 Skipping already saved record PCAP/2018/442 Skipping already saved record R/2018/99 Skipping already saved record BC/2018/86 Skipping already saved record D/2018/633 Skipping already saved record D/2018/634 Skipping already saved record D/2018/635 Skipping already saved record HEC/2018/51 Skipping already saved record M/2018/202 Skipping already saved record OCP/2018/406 Skipping already saved record PREDA/2018/315 Skipping already saved record CDCP/2018/174 Skipping already saved record D/2018/636 Skipping already saved record D/2018/637 Skipping already saved record D/2018/638 Skipping already saved record D/2018/639 Skipping already saved record D/2018/640 Skipping already saved record M/2018/203 Skipping already saved record OCP/2018/408 Skipping already saved record PREDA/2018/316 Skipping already saved record CC/2018/371 Skipping already saved record CCP/2018/367 Skipping already saved record CCP/2018/369 Skipping already saved record CCP/2018/370 Skipping already saved record M/2018/204 Skipping already saved record OC/2018/409 Skipping already saved record OCP/2018/410 Skipping already saved record OCP/2018/411 Skipping already saved record OCP/2018/412 Skipping already saved record PCAP/2018/444 Skipping already saved record PCAP/2018/445 Skipping already saved record PCAP/2018/446 Skipping already saved record PREDA/2018/318 Skipping already saved record SC/2018/35 Skipping already saved record T/2018/173

Data

Downloaded 4491 times by slav123 openaustralia LoveMyData jesse-a-reilly TheZepto uncoverRiley equivalentideas MikeRalphson tatol86 JPHePlanning Horizons444 razz969

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (9.09 MB) Use the API

rows 10 / 17929

date_scraped description info_url date_received council_reference address comment_url
2012-02-13
Replacement of the existing metal sheeting roof with new colorbond metal roof to match.
2012-01-09
CC/2012/1
88 Evans Street ROZELLE NSW 2039
mailto:leichhardt@lmc.nsw.gov.au?subject=Development+Application+Enquiry%3A+CC%2F2012%2F1
2012-02-13
Alterations and additions to the existing dwelling pergola and awning
2012-01-12
CC/2012/7
15 Valley Street BALMAIN NSW 2041
mailto:leichhardt@lmc.nsw.gov.au?subject=Development+Application+Enquiry%3A+CC%2F2012%2F7
2012-02-13
Demolition of existing shared internal wall between Units 1 and 2 to consolidate the units.
2012-01-17
CC/2012/11
1/5 Gallimore Avenue BALMAIN EAST NSW 2041
mailto:leichhardt@lmc.nsw.gov.au?subject=Development+Application+Enquiry%3A+CC%2F2012%2F11
2012-02-13
Cancelled refer to CDCP 2012/4 I have arranged for overpayment amount to be refunded.
2012-01-13
CDC/2012/2
4 Trevor Street LILYFIELD NSW 2040
mailto:leichhardt@lmc.nsw.gov.au?subject=Development+Application+Enquiry%3A+CDC%2F2012%2F2
2012-02-13
Refurbishment of existing Kiosk-t Muffin Break Leichhardt MarketTown
2012-01-13
CDC/2012/3
80 Flood Street LEICHHARDT NSW 2040
mailto:leichhardt@lmc.nsw.gov.au?subject=Development+Application+Enquiry%3A+CDC%2F2012%2F3
2012-02-13
Construction of a driveway
2012-01-19
CDC/2012/6
55 Ainsworth Street LILYFIELD NSW 2040
mailto:leichhardt@lmc.nsw.gov.au?subject=Development+Application+Enquiry%3A+CDC%2F2012%2F6
2012-02-13
Construction of a double carport / garage at the rear of the site fronting Easter Street. SEPP 1 Objection to landscaped area.
2012-01-05
D/2012/1
56 Albert Street LEICHHARDT NSW 2040
mailto:leichhardt@lmc.nsw.gov.au?subject=Development+Application+Enquiry%3A+D%2F2012%2F1
2012-02-13
Demolition of existing outbuilding and construction of a new double garage with associated driveway works.
2012-01-06
D/2012/2
55 Burfitt Street LEICHHARDT NSW 2040
mailto:leichhardt@lmc.nsw.gov.au?subject=Development+Application+Enquiry%3A+D%2F2012%2F2
2012-02-13
Change of use to Thai massage centre and associated works, including signage.
2012-01-06
D/2012/3
Multiple Occupancy 106 Norton Street LEICHHARDT NSW 2040
mailto:leichhardt@lmc.nsw.gov.au?subject=Development+Application+Enquiry%3A+D%2F2012%2F3
2012-02-13
Demolition of existing awning and construction of a new verandah over footpath to the Darling Street frontage.
2012-01-06
D/2012/4
Unity Hall Hotel 292-294 Darling Street BALMAIN NSW 2041
mailto:leichhardt@lmc.nsw.gov.au?subject=Development+Application+Enquiry%3A+D%2F2012%2F4

Statistics

Average successful run time: less than a minute

Total run time: 2 days

Total cpu time used: about 1 hour

Total disk space used: 9.18 MB

History

  • Auto ran revision 375302fa and completed successfully .
    5 records added in the database
    1 page scraped
  • Auto ran revision 375302fa and completed successfully .
    15 records added in the database
    1 page scraped
  • Auto ran revision 375302fa and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 375302fa and completed successfully .
    4 records added in the database
    2183 pages scraped
  • Auto ran revision 375302fa and completed successfully .
    5 records added in the database
    1 page scraped
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

leichhardt / scraper.rb