planningalerts-scrapers / parramatta

Parramatta City Council Development Applications


Parramatta Council Scraper

  • Scrape detail page - Yes
  • Clearly defined data within a row - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • 7 (days)
  • 14 (days) - default
  • thismonth
  • lastmonth

Enjoy

Forked from ScraperWiki

Contributors henare LoveMyData equivalentideas jamezpolley mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Fetching gem metadata from https://rubygems.org/........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching connection_pool 2.2.2  Fetching unf_ext 0.0.7.5  Fetching httpclient 2.8.3  Installing connection_pool 2.2.2  Fetching mime-types-data 3.2018.0812  Installing httpclient 2.8.3  Installing unf_ext 0.0.7.5 with native extensions  Installing mime-types-data 3.2018.0812  Fetching net-http-digest_auth 1.4.1  Installing net-http-digest_auth 1.4.1  Fetching mini_portile2 2.3.0  Installing mini_portile2 2.3.0  Fetching ntlm-http 0.1.1  Fetching webrobots 0.1.2  Installing ntlm-http 0.1.1  Installing webrobots 0.1.2  Fetching sqlite3 1.3.13  Fetching net-http-persistent 3.0.0  Installing sqlite3 1.3.13 with native extensions  Installing net-http-persistent 3.0.0  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.8.5  Installing nokogiri 1.8.5 with native extensions  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Bundle complete! 2 Gemfile dependencies, 19 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (26.48s)  Cleaning up the bundler cache. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... 92 Development Applications to scrape. Period: last14days Saving record BC/53/2019, 20 Yarrabee Road WINSTON HILLS NSW 2153 Saving record CDP/283/2019, 13 Burrabogee Road PENDLE HILL NSW 2145 Saving record CDP/284/2019, 308 / 171 Church Street PARRAMATTA NSW 2150 Saving record CDP/285/2019, 4033 / 171 Church Street PARRAMATTA NSW 2150 Saving record DA/271/2019, 47 Becky Avenue NORTH ROCKS NSW 2151 Saving record DA/272/2019, 71 Yates Avenue DUNDAS VALLEY NSW 2117 Saving record TA/359/2019, 24 Alanas Avenue OATLANDS NSW 2117 Saving record TA/360/2019, 1 Leo Place TELOPEA NSW 2117 Saving record TA/361/2019, 17 - 19A Page Street WENTWORTHVILLE NSW 2145 Saving record BC/54/2019, 30 Twain Street WINSTON HILLS NSW 2153 Saving record BC/55/2019, 22 Yarrabee Road WINSTON HILLS NSW 2153 Saving record BC/56/2019, 18 Yarrabee Road WINSTON HILLS NSW 2153 Saving record CDP/231/2019/A, 171 Church Street PARRAMATTA NSW 2150 Saving record CDP/277/2019, 102 Bennelong Parkway SYDNEY OLYMPIC PARK NSW 2127 Saving record DA/110/2018/A, 21 Vignes Street ERMINGTON NSW 2115 Saving record DA/273/2019, 4 Hermington Street EPPING NSW 2121 Saving record DA/276/2019, 11 Burns Road WINSTON HILLS NSW 2153 Saving record DA/283/2019, 189 Macquarie Street PARRAMATTA NSW 2150 Saving record TA/362/2019, 4 Cliff Avenue WINSTON HILLS NSW 2153 Saving record TA/363/2019, 13 Charles Street OATLANDS NSW 2117 Saving record TA/364/2019, 24 Milton Avenue EASTWOOD NSW 2122 Saving record CDP/278/2019, 19A Model Farms Road WINSTON HILLS NSW 2153 Saving record CDP/290/2019, 19 Ferndale Close CONSTITUTION HILL NSW 2145 Saving record CDP/293/2019, 22 Prince Street NORTH PARRAMATTA NSW 2151 Saving record DA/275/2019, 65 Moxhams Road NORTHMEAD NSW 2152 Saving record DA/277/2019, 11 Murray Farm Road CARLINGFORD NSW 2118 Saving record DA/278/2019, 7 / 465 - 481 Wentworth Avenue TOONGABBIE NSW 2146 Saving record TA/365/2019, 38 Bowden Street HARRIS PARK NSW 2150 Saving record BC/57/2019, 26 Dorset Street EPPING NSW 2121 Saving record CDP/291/2019, 340 North Rocks Road NORTH ROCKS NSW 2151 Saving record CDP/292/2019, 17 MacArtney Street ERMINGTON NSW 2115 Saving record DA/279/2019, 8 Collett Parade PARRAMATTA NSW 2150 Saving record DA/280/2019, 10 Grand Avenue ROSEHILL NSW 2142 Saving record DA/281/2019, 11 Brelogail Street NORTHMEAD NSW 2152 Saving record DA/282/2019, 45 Delaware Road ERMINGTON NSW 2115 Saving record DA/62/2019/A, 32 Kay Street CARLINGFORD NSW 2118 Saving record DA/90/2019/A, 3 Leven Place NORTHMEAD NSW 2152 Saving record TA/366/2019, 80 New North Rocks Road NORTH ROCKS NSW 2151 Saving record TA/367/2019, 9 Trott Street PARRAMATTA NSW 2150 Saving record CDP/286/2019, 10 / 58 - 62 Fitzwilliam Road OLD TOONGABBIE NSW 2146 Saving record CDP/287/2019, 85 Bogalara Road OLD TOONGABBIE NSW 2146 Saving record DA/284/2019, 10 Bain Place DUNDAS VALLEY NSW 2117 Saving record DA/285/2019, 36 Snowdon Avenue CARLINGFORD NSW 2118 Saving record DA/286/2019, 24 Mobbs Lane CARLINGFORD NSW 2118 Saving record DA/292/2019, 13 Angus Avenue EPPING NSW 2121 Saving record DA/294/2015/A, 7 Scott Street TOONGABBIE NSW 2146 Saving record TA/368/2019, 54 Gladstone Street NORTH PARRAMATTA NSW 2151 Saving record TA/369/2019, 3 Lewis Street EPPING NSW 2121 Saving record DA/289/2019, 59A Windermere Avenue NORTHMEAD NSW 2152 Saving record DA/290/2019, 81 Felton Road CARLINGFORD NSW 2118 Saving record DA/291/2019, 45 Perry Street NORTH ROCKS NSW 2151 Saving record CDP/298/2019, 50 Chelmsford Avenue EPPING NSW 2121 Saving record DA/287/2019, 4 / 1 River Road West PARRAMATTA NSW 2150 Saving record DA/293/2019, 12 Grand Avenue ROSEHILL NSW 2142 Saving record DA/294/2019, 712 - 714 Pennant Hills Road CARLINGFORD NSW 2118 Saving record DA/295/2019, 35 Vianney Crescent TOONGABBIE NSW 2146 Saving record DA/296/2019, 1 Sirius Street DUNDAS VALLEY NSW 2117 Saving record DA/5/2008/F, 1 Nirvana Street PENDLE HILL NSW 2145 Saving record TA/370/2019, 260 Windsor Road BAULKHAM HILLS NSW 2153 Saving record BC/58/2019, 38 - 50 South Street RYDALMERE NSW 2116 Saving record DA/1157/2016/C, 657 Victoria Road MELROSE PARK NSW 2114 Saving record DA/288/2019, 2B Grand Avenue ROSEHILL NSW 2142 Saving record DA/297/2019, 8A Donald Street CARLINGFORD NSW 2118 Something not right here: {"council_reference"=>"DA/298/2019", "description"=>"Development Application - Unit 100/14 Loyalty Road, NORTH ROCKS NSW 2151 - Service of alcohol at an existing cafe.", "date_received"=>"2019-05-21", "address"=>nil, "info_url"=>"http://eplanning.parracity.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx?id=551330", "comment_url"=>"mailto:council@cityofparramatta.nsw.gov.au", "date_scraped"=>"2019-05-25"} Saving record DA/299/2019, 1 - 7 Thallon Street CARLINGFORD NSW 2118 Saving record TA/371/2019, 9 Henson Street TOONGABBIE NSW 2146 Saving record TA/372/2019, 30 Bryson Street TOONGABBIE NSW 2146 Saving record DA/300/2019, 4 Kywong Street TELOPEA NSW 2117 Saving record TA/373/2019, 5 / 83 North Rocks Road NORTH ROCKS NSW 2151 Saving record TA/374/2019, 14 - 16 Masons Drive NORTH PARRAMATTA NSW 2151 Saving record BC/59/2019, 56 Arcadian Circuit CARLINGFORD NSW 2118 Saving record DA/301/2019, 2 Rutherglen Avenue NORTHMEAD NSW 2152 Saving record DA/303/2019, 25 Cowells Lane ERMINGTON NSW 2115 Saving record DA/304/2019, 35 Moffatts Drive DUNDAS VALLEY NSW 2117 Saving record DA/305/2019, 801 - 809 Pennant Hills Road CARLINGFORD NSW 2118 Saving record DA/306/2019, 148 - 152 Marsden Road DUNDAS VALLEY NSW 2117 Saving record DA/307/2019, 8 Selkirk Street WINSTON HILLS NSW 2153 Saving record DA/308/2019, 1 - 3 The Crescent WENTWORTH POINT NSW 2127 Saving record DA/363/2014/C, 11 Park Road RYDALMERE NSW 2116 Saving record DA/380/2015/A, 53 Buckleys Road WINSTON HILLS NSW 2153 Saving record DA/468/2016/D, 12 - 22 Langston Place EPPING NSW 2121 Saving record TA/375/2019, 18 Wyoming Avenue OATLANDS NSW 2117 Saving record TA/376/2019, 42 Hassall Street PARRAMATTA NSW 2150 Saving record TA/377/2019, 2 / 171 Pennant Hills Road CARLINGFORD NSW 2118 Saving record TA/378/2019, 29 Carter Street LIDCOMBE NSW 2141 Saving record BC/60/2019, 4 / 354 Church Street PARRAMATTA NSW 2150 Saving record DA/0/2019, 113 Hassall Street ROSEHILL NSW 2142 Something not right here: {"council_reference"=>"DA/436/2016/J", "description"=>"Development Application - Parramatta Square 4 & 6, 12-28 Darcy St, 14A & 21R Darcy St, 30-38 Darcy St, 160-162 Church St, 119Z Macquarie St & 1A Civic Place, PARRAMATTA - Section 4.55 (1) modification to the construction of a mixed use development comprising of three podium levels with two commercial office towers above, four levels of basement parking and the creation of new areas of public domain. Rebuilding of Darcy Street road way and retaining walls and associated re-instatement of services, landscaping and further public domain works. The application is Nominated Integrated development under the Water Management Act 200 and Integrated Development under the National parks and Wildlife Act 1974. The application is to be determined by the Sydney West Joint Regional Planning Panel.", "date_received"=>"2019-05-24", "address"=>nil, "info_url"=>"http://eplanning.parracity.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx?id=560220", "comment_url"=>"mailto:council@cityofparramatta.nsw.gov.au", "date_scraped"=>"2019-05-25"} Saving record DA/504/2015/A, 41 Beecroft Road EPPING NSW 2121 Saving record DA/548/2018/A, 153 Macquarie Street PARRAMATTA NSW 2150 Saving record TA/379/2019, 66 Lochinvar Parade CARLINGFORD NSW 2118 Saving record TA/380/2019, 5 Perry Street NORTH ROCKS NSW 2151

Data

Downloaded 6440 times by slav123 openaustralia DevAppProject WilliamYun LoveMyData tatol86 jesse-a-reilly TheZepto wbchilds razz969 z37214728 brickworksbp Jedwards157 ajoh3691 equivalentideas henare kadrach horizons444 jayzhouny hoyathorwood Jeremy-Charlton Dave9129

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (8.64 MB) Use the API

rows 10 / 22501

description info_url date_received council_reference address comment_url date_scraped date
Removal 2 Trees
2010-12-09
TA/732/2010
5 Willoughby Street EPPING NSW 2121
2010-12-12 01:15:22
2010-12-09 00:00:00
Removal of 1 Tree
2010-12-09
TA/733/2010
18 / 47 Wentworth Avenue WESTMEAD NSW 2145
2010-12-12 01:15:22
2010-12-09 00:00:00
Removal of 2 Trees
2010-12-09
TA/734/2010
30 Brabyn Street NORTH PARRAMATTA NSW 2151
2010-12-12 01:15:22
2010-12-09 00:00:00
Removal of 1 Tree
2010-12-09
TA/735/2010
37 - 43 Stewart Street DUNDAS VALLEY NSW 2117
2010-12-12 01:15:22
2010-12-09 00:00:00
Section 96(1a) modification to an approved dwelling including raising floor levels by 300mm
2010-12-09
DA/485/2010/A
48 - 50 Meadows Street MERRYLANDS NSW 2160
2010-12-12 01:15:21
2010-12-09 00:00:00
Demolition and construction of a 2 storey residential flat building under the Affordable Rental Housing SEPP containing 12 apartments over basement carparking with access from Barangaroo Road
2010-12-09
DA/997/2010
4 Barangaroo Road TOONGABBIE NSW 2146
2010-12-12 01:15:21
2010-12-09 00:00:00
Demolition, tree removal and construction of a 3 storey residential flat building containing 12 units over basement carparking with strata subdivision
2010-12-09
DA/998/2010
34 Napier Street PARRAMATTA NSW 2150
2010-12-12 01:15:21
2010-12-09 00:00:00
Construction of a two storey dwelling house and tree removal
2010-12-09
CC/750/2010
14 Lewis Street EPPING NSW 2121
2010-12-12 01:15:21
2010-12-09 00:00:00
Demolition, tree removal and construction of a 2 storey dual occupancy development with a 1
2010-12-09
CC/751/2010
19 Rhodes Avenue GUILDFORD NSW 2161
2010-12-12 01:15:21
2010-12-09 00:00:00
Alterations and additions to existing dwelling
2010-12-09
CD/308/2010
30 Taywood Avenue WINSTON HILLS NSW 2153
2010-12-12 01:15:21
2010-12-09 00:00:00

Statistics

Average successful run time: 2 minutes

Total run time: 11 days

Total cpu time used: about 1 hour

Total disk space used: 8.68 MB

History

  • Auto ran revision 4de21a38 and completed successfully .
    90 records added, 90 records removed in the database
  • Auto ran revision 4de21a38 and completed successfully .
    100 records added, 91 records removed in the database
  • Auto ran revision 4de21a38 and completed successfully .
    96 records added, 78 records removed in the database
  • Auto ran revision 4de21a38 and completed successfully .
    85 records added, 83 records removed in the database
  • Auto ran revision 4de21a38 and completed successfully .
    97 records added, 83 records removed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

parramatta / scraper.rb