xinzhangx / holroyd

Holroyd City Council Development Applications

Scrapes eservices.holroyd.nsw.gov.au


Holroyd City Council Development applications for PlanningAlerts

Contributors xinzhangx

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... -----> Python app detected -----> Stack changed, re-installing runtime -----> Installing runtime (python-2.7.9) -----> Installing dependencies with pip  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Building lxml version 3.4.4.  Building without Cython.  Using build configuration of libxslt 1.1.28  /app/.heroku/python/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url'  warnings.warn(msg)  Collecting cssselect==0.9.1 (from -r requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting beautifulsoup4==4.1.3 (from -r requirements.txt (line 10))  Downloading beautifulsoup4-4.1.3.tar.gz (58kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 6))  Downloading requests-2.7.0-py2.py3-none-any.whl (470kB)  Installing collected packages: requests, dumptruck, beautifulsoup4, cssselect, lxml, scraperwiki   Running setup.py install for dumptruck  Running setup.py install for beautifulsoup4  Running setup.py install for cssselect  Running setup.py install for lxml  Building lxml version 3.4.4.  Building without Cython.  Using build configuration of libxslt 1.1.28  /app/.heroku/python/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url'  warnings.warn(msg)  building 'lxml.etree' extension  gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -I/tmp/pip-build-hveYe5/lxml/src/lxml/includes -I/app/.heroku/python/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -w  gcc -pthread -shared build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -lxslt -lexslt -lxml2 -lz -lm -o build/lib.linux-x86_64-2.7/lxml/etree.so  building 'lxml.objectify' extension  gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -I/tmp/pip-build-hveYe5/lxml/src/lxml/includes -I/app/.heroku/python/include/python2.7 -c src/lxml/lxml.objectify.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.objectify.o -w  gcc -pthread -shared build/temp.linux-x86_64-2.7/src/lxml/lxml.objectify.o -lxslt -lexslt -lxml2 -lz -lm -o build/lib.linux-x86_64-2.7/lxml/objectify.so  Running setup.py develop for scraperwiki  Creating /app/.heroku/python/lib/python2.7/site-packages/scraperwiki.egg-link (link to .)  Adding scraperwiki 0.3.7 to easy-install.pth file  Installed /app/.heroku/src/scraperwiki  Successfully installed beautifulsoup4-4.1.3 cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 requests-2.7.0 scraperwiki  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... INFO:root:Sqlite data does not exist yet. Will be created. INFO:root:Writing new record to sqlite: 235/2015 INFO:root:Writing new record to sqlite: 230/2015 INFO:root:Writing new record to sqlite: 221/2015 INFO:root:Writing new record to sqlite: 226/2015 INFO:root:Writing new record to sqlite: 194/2015 INFO:root:Writing new record to sqlite: 223/2015 INFO:root:Writing new record to sqlite: 236/2015 INFO:root:Writing new record to sqlite: 228/2015 INFO:root:Writing new record to sqlite: 234/2015 INFO:root:Writing new record to sqlite: 222/2015 INFO:root:Writing new record to sqlite: 596/2014 INFO:root:Writing new record to sqlite: 219/2015 INFO:root:Writing new record to sqlite: 611/2014 INFO:root:Writing new record to sqlite: 232/2015 INFO:root:Writing new record to sqlite: 223/2012 INFO:root:Writing new record to sqlite: 224/2012 INFO:root:Writing new record to sqlite: 231/2015 INFO:root:Writing new record to sqlite: 218/2015 INFO:root:Writing new record to sqlite: 237/2015 INFO:root:Writing new record to sqlite: 660/2010 INFO:root:Writing new record to sqlite: 239/2015 INFO:root:Writing new record to sqlite: 203/2015 INFO:root:Writing new record to sqlite: 210/2015 INFO:root:Writing new record to sqlite: 211/2015 INFO:root:Writing new record to sqlite: 254/2014 INFO:root:Writing new record to sqlite: 390/2014 INFO:root:Writing new record to sqlite: 225/2015 INFO:root:Writing new record to sqlite: 766/2007 INFO:root:Writing new record to sqlite: 50/2015 INFO:root:Writing new record to sqlite: 426/2013 INFO:root:Writing new record to sqlite: 217/2015 INFO:root:Writing new record to sqlite: 174/2015 INFO:root:Writing new record to sqlite: 521/2014 INFO:root:Writing new record to sqlite: 467/2011 INFO:root:Writing new record to sqlite: 233/2015 INFO:root:Writing new record to sqlite: 227/2015 INFO:root:Writing new record to sqlite: 213/2015 INFO:root:Writing new record to sqlite: 240/2015

Data

Downloaded 3 times by MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (22 KB) Use the API

rows 10 / 38

council_reference address info_url description comment_url date_received date_scraped
235/2015
2 Bettina Street MERRYLANDS WEST NSW 2160
Demolition of existing structures; construction of an attached 2 storey dual occupancy and associated Torrens subdivision into 2 lots
mailto:hcc@holroyd.nsw.gov.au?subject=Development%20Application%20Enquiry%3A%20235%2F2015
2015-06-09
2015-06-17
230/2015
5 Billabong Street PENDLE HILL NSW 2145
Demolition of existing structures; consolidation of 2 lots into 1 lot; construction of a 5 storey mixed use development comprising 25 units; ground floor commercial tenancy with at grade and 2 levels of basement parking accommodating 52 carparking spaces
mailto:hcc@holroyd.nsw.gov.au?subject=Development%20Application%20Enquiry%3A%20230%2F2015
2015-06-04
2015-06-17
221/2015
30 Bristol Street MERRYLANDS WEST NSW 2160
Alterations and additions to an existing dwelling house
mailto:hcc@holroyd.nsw.gov.au?subject=Development%20Application%20Enquiry%3A%20221%2F2015
2015-06-02
2015-06-17
226/2015
4 Burnett Street MERRYLANDS NSW 2160
Use of Shop 2 as a cafe including associated fitout and signage
mailto:hcc@holroyd.nsw.gov.au?subject=Development%20Application%20Enquiry%3A%20226%2F2015
2015-06-03
2015-06-17
194/2015
92 Burnett Street MERRYLANDS NSW 2160
Demolition of existing structures; construction of a medium density residential development comprising 6 units over 1 level of basement parking and strata subdivision into 6 lots
mailto:hcc@holroyd.nsw.gov.au?subject=Development%20Application%20Enquiry%3A%20194%2F2015
2015-05-14
2015-06-17
223/2015
84 Centenary Road SOUTH WENTWORTHVILLE NSW 2145
Demolition of existing structures; Torrens subdivision of land into 2 lots; construction of a 2 storey attached dual occupancy on Lot A and associated Torrens subdivision into 2 lots; construction of a 2 storey dwelling house on Lot B; totalling 3 lots and 3 dwellings
mailto:hcc@holroyd.nsw.gov.au?subject=Development%20Application%20Enquiry%3A%20223%2F2015
2015-06-02
2015-06-17
236/2015
38 Coleman Street MERRYLANDS NSW 2160
Conversion of an existing outbuilding into a secondary dwelling and construction of a carport
mailto:hcc@holroyd.nsw.gov.au?subject=Development%20Application%20Enquiry%3A%20236%2F2015
2015-06-09
2015-06-17
228/2015
25 Daley Street PENDLE HILL NSW 2145
Alterations and additions to an existing unauthorised structure and its use as a secondary dwelling under Affordable Rental Housing SEPP 2009
mailto:hcc@holroyd.nsw.gov.au?subject=Development%20Application%20Enquiry%3A%20228%2F2015
2015-06-03
2015-06-17
234/2015
6 George Street GUILDFORD NSW 2161
Demolition of existing structures and construction of 2 storey semi detached dwellings totalling 2 dwellings
mailto:hcc@holroyd.nsw.gov.au?subject=Development%20Application%20Enquiry%3A%20234%2F2015
2015-06-09
2015-06-17
222/2015
12 Good Street WESTMEAD NSW 2145
Demolition of existing structures; consolidation of 3 lots into 1 lot; construction of a 5 storey residential flat building comprising 33 units over basement parking accommodating 39 carparking spaces
mailto:hcc@holroyd.nsw.gov.au?subject=Development%20Application%20Enquiry%3A%20222%2F2015
2015-06-02
2015-06-17

Statistics

Average successful run time: 3 minutes

Total run time: 6 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 45.2 KB

History

  • Manually ran revision 075db80c and completed successfully .
    38 records added in the database
    1 page scraped
  • Manually ran revision 7b74423c and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

holroyd / scraper.py