planningalerts-scrapers / parramatta

Parramatta City Council Development Applications


Parramatta Council Scraper

  • Scrape detail page - Yes
  • Clearly defined data within a row - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • 7 (days)
  • 14 (days) - default
  • thismonth
  • lastmonth

Enjoy

Note: XML feed on the site appears to be broken

Forked from ScraperWiki

Contributors henare LoveMyData equivalentideas jamezpolley mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching public_suffix 3.1.0  Using bundler 1.15.2  Fetching connection_pool 2.2.2  Fetching safe_yaml 1.0.5  Installing connection_pool 2.2.2  Installing safe_yaml 1.0.5  Fetching unf_ext 0.0.7.5  Installing public_suffix 3.1.0  Fetching hashdiff 0.4.0  Fetching httpclient 2.8.3  Installing httpclient 2.8.3  Fetching mime-types-data 3.2018.0812  Installing unf_ext 0.0.7.5 with native extensions  Installing hashdiff 0.4.0  Fetching net-http-digest_auth 1.4.1  Installing mime-types-data 3.2018.0812  Installing net-http-digest_auth 1.4.1  Fetching mini_portile2 2.3.0  Fetching ntlm-http 0.1.1  Installing ntlm-http 0.1.1  Installing mini_portile2 2.3.0  Fetching webrobots 0.1.2  Fetching sqlite3 1.3.13  Installing webrobots 0.1.2  Installing sqlite3 1.3.13 with native extensions  Fetching timecop 0.9.1  Installing timecop 0.9.1  Fetching vcr 5.0.0  Installing vcr 5.0.0  Fetching net-http-persistent 3.0.0  Installing net-http-persistent 3.0.0  Fetching crack 0.4.3  Installing crack 0.4.3  Fetching addressable 2.6.0  Installing addressable 2.6.0  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.8.5  Installing nokogiri 1.8.5 with native extensions  Fetching webmock 3.6.0  Installing webmock 3.6.0  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Bundle complete! 5 Gemfile dependencies, 27 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from hashdiff:  The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45.  Bundle completed (26.78s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Saving record BC/144/2019, 74 Pennant Parade EPPING NSW 2121 Saving record BC/145/2019, 123 Evans Road DUNDAS VALLEY NSW 2117 Saving record CDP/689/2019, 175 Church Street PARRAMATTA NSW 2150 Saving record DA/15/2018/B, 47 Dorothy Street WENTWORTHVILLE NSW 2145 Saving record DA/172/2018/B, 3 Sophia Crescent NORTH ROCKS NSW 2151 Saving record DA/611/2019, 85 Macquarie Street PARRAMATTA NSW 2150 Saving record DA/621/2019, 49 Rawson Street EPPING NSW 2121 Saving record DA/625/2019, 46 Dunrossil Avenue CARLINGFORD NSW 2118 Saving record DA/626/2019, 38 Ballandella Road TOONGABBIE NSW 2146 Saving record DA/627/2019, 17 Rawson Street EPPING NSW 2121 Saving record TA/667/2019, 543 Victoria Road ERMINGTON NSW 2115 Saving record TA/668/2019, 27 Helen Street WESTMEAD NSW 2145 Saving record TA/669/2019, 15 Parkland Avenue RYDALMERE NSW 2116 Saving record TA/670/2019, 28 Barclay Road NORTH ROCKS NSW 2151 Saving record BC/146/2019, 24 Mason Street NORTH PARRAMATTA NSW 2151 Saving record BC/147/2019, 31 Eastwood Avenue EASTWOOD NSW 2122 Saving record CDP/678/2019, 148 North Rocks Road NORTH ROCKS NSW 2151 Saving record CDP/680/2019, 109 Arcadian Circuit CARLINGFORD NSW 2118 Saving record DA/628/2019, 36 Robert Street TELOPEA NSW 2117 Saving record DA/629/2019, 15 Sandringham Drive CARLINGFORD NSW 2118 Saving record TA/671/2019, 14 Franklin Place CARLINGFORD NSW 2118 Saving record TA/673/2019, 31 Dunmore Road EPPING NSW 2121 Saving record TA/674/2019, 17 / 212 Pennant Hills Road OATLANDS NSW 2117 Saving record TA/675/2019, 8 McDonald Street NORTH ROCKS NSW 2151 Saving record CD/684/2019, 91 Thomas Street PARRAMATTA NSW 2150 Saving record CDP/553/2019/A, 40A Lamonerie Street TOONGABBIE NSW 2146 Saving record CDP/681/2019, 175 Church Street PARRAMATTA NSW 2150 Saving record CDP/696/2019, 102 Bennelong Parkway SYDNEY OLYMPIC PARK NSW 2127 Saving record DA/551/2017/A, 176A Murray Farm Road BEECROFT NSW 2119 Saving record DA/630/2019, 1 Edwin Street OATLANDS NSW 2117 Saving record DA/631/2019, 176A Murray Farm Road BEECROFT NSW 2119 Saving record DA/632/2019, 59 Robert Street TELOPEA NSW 2117 Saving record DA/634/2019, 2 Kay Street CLYDE NSW 2142 Saving record TA/676/2019, 19 Huxley Drive WINSTON HILLS NSW 2153 Saving record TA/677/2019, 6 Pleasant Court CARLINGFORD NSW 2118 Saving record TA/678/2019, 34 Heidelberg Avenue NEWINGTON NSW 2127 Saving record TA/679/2019, 45 Milton Avenue EASTWOOD NSW 2122 Saving record TA/680/2019, 16 Paragon Drive NORTH ROCKS NSW 2151 Saving record CDP/697/2019, 801 - 809 Pennant Hills Road CARLINGFORD NSW 2118 Saving record CDP/701/2019, 525 Victoria Road ERMINGTON NSW 2115 Saving record DA/1250/2016/C, 21 Wesley Street TELOPEA NSW 2117 Saving record DA/310/2018/A, 2 South Street RYDALMERE NSW 2116 Saving record DA/633/2019, 15B Albert Street NORTH PARRAMATTA NSW 2151 Saving record DA/635/2019, 43 Quarry Road DUNDAS VALLEY NSW 2117 Saving record DA/708/2018/A, 55 Eleanor Street ROSEHILL NSW 2142 Saving record CD/296/2014/A, 3 Clarke Street RYDALMERE NSW 2116 Saving record CDP/705/2019, 23 Flinders Street ERMINGTON NSW 2115 Saving record DA/1235/2016/A, 26 Tooth Avenue NEWINGTON NSW 2127 Saving record DA/358/2015/C, 153 Macquarie Street PARRAMATTA NSW 2150 Saving record DA/636/2019, 18 Masons Drive NORTH PARRAMATTA NSW 2151 Saving record DA/637/2019, 61 Chesterfield Road EPPING NSW 2121 Saving record DA/639/2019, 22 Kandy Avenue EPPING NSW 2121 Saving record DA/640/2019, 31 Gilbert Street NORTH PARRAMATTA NSW 2151 Saving record DA/76/2017/D, 153 Macquarie Street PARRAMATTA NSW 2150 Saving record DA/76/2019/A, 9 Murdoch Street ERMINGTON NSW 2115 Saving record TA/681/2019, 19 Apple Street CONSTITUTION HILL NSW 2145 Saving record TA/682/2019, 80 Calder Road RYDALMERE NSW 2116 Saving record TA/683/2019, 9 Fleming Street CARLINGFORD NSW 2118 Saving record TA/684/2019, 32 Wycombe Street EPPING NSW 2121 Saving record CDP/703/2019, 5 Glenavy Street WENTWORTHVILLE NSW 2145 Saving record TA/685/2019, 11 Carlton Road NORTH ROCKS NSW 2151 Saving record CD/694/2019, 87 Thomas Street PARRAMATTA NSW 2150 Saving record DA/38/2011/A, 9 Broulee Place CARLINGFORD NSW 2118 Saving record DA/641/2019, 105 / 2 Chester Street EPPING NSW 2121 Saving record DA/642/2019, 263 Marsden Road CARLINGFORD NSW 2118 Saving record DA/680/2018/A, 26 Murray Street NORTHMEAD NSW 2152 Saving record TA/686/2019, 57 Lamorna Avenue BEECROFT NSW 2119 Saving record TA/687/2019, 5 Christina Street RYDALMERE NSW 2116 Saving record TA/688/2019, 27 Arkana Street TELOPEA NSW 2117 Saving record TA/689/2019, 60 Calder Road RYDALMERE NSW 2116 Saving record TA/690/2019, 25 Marwood Drive BEECROFT NSW 2119 Saving record TA/691/2019, 27 Bennelong Parkway WENTWORTH POINT NSW 2127 Saving record BC/148/2019, 2 Stewart Street ERMINGTON NSW 2115 Saving record CDP/698/2019, 278 North Rocks Road NORTH ROCKS NSW 2151 Saving record CDP/704/2019, 8 Parkview Drive SYDNEY OLYMPIC PARK NSW 2127 Saving record DA/638/2019, 85 Macquarie Street PARRAMATTA NSW 2150 Saving record TA/692/2019, 1 - 9 Shirley Street CARLINGFORD NSW 2118 Saving record CDP/700/2019, 100 / 226 Windsor Road WINSTON HILLS NSW 2153 Saving record DA/643/2019, 26 Nottingham Street NORTHMEAD NSW 2152 Saving record DA/644/2019, 68 Dandarbong Avenue CARLINGFORD NSW 2118 Saving record DA/645/2019, 163 Pennant Hills Road CARLINGFORD NSW 2118 Saving record TA/693/2019, 44 Prospect Street ROSEHILL NSW 2142 Saving record TA/694/2019, 26 Thomas Street PARRAMATTA NSW 2150 Saving record TA/695/2019, 15 Broulee Place CARLINGFORD NSW 2118 Saving record TA/696/2019, 51A Perry Street DUNDAS VALLEY NSW 2117 Saving record TA/697/2019, 24 Hainsworth Street WESTMEAD NSW 2145 Saving record BC/149/2019, 45 Edenlee Street EPPING NSW 2121 Saving record BC/150/2019, 12 Roland Avenue NORTHMEAD NSW 2152 Saving record TA/698/2019, 6 Ryde Street EPPING NSW 2121 Saving record TA/699/2019, 11 Rangihou Crescent PARRAMATTA NSW 2150 Saving record TA/700/2019, 19 Selkirk Street WINSTON HILLS NSW 2153 Saving record TA/701/2019, 70 - 72 Grose Street NORTH PARRAMATTA NSW 2151

Data

Downloaded 7875 times by slav123 openaustralia DevAppProject WilliamYun LoveMyData irwin-r jesse-a-reilly tatol86 TheZepto wbchilds razz969 brickworksbp z37214728 jayzhouny Jedwards157 henare kadrach horizons444 hoyathorwood Jeremy-Charlton Dave9129 ajoh3691 equivalentideas

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (9.15 MB) Use the API

rows 10 / 23644

description info_url date_received council_reference address comment_url date_scraped date
Removal 2 Trees
2010-12-09
TA/732/2010
5 Willoughby Street EPPING NSW 2121
2010-12-12 01:15:22
2010-12-09 00:00:00
Removal of 1 Tree
2010-12-09
TA/733/2010
18 / 47 Wentworth Avenue WESTMEAD NSW 2145
2010-12-12 01:15:22
2010-12-09 00:00:00
Removal of 2 Trees
2010-12-09
TA/734/2010
30 Brabyn Street NORTH PARRAMATTA NSW 2151
2010-12-12 01:15:22
2010-12-09 00:00:00
Removal of 1 Tree
2010-12-09
TA/735/2010
37 - 43 Stewart Street DUNDAS VALLEY NSW 2117
2010-12-12 01:15:22
2010-12-09 00:00:00
Section 96(1a) modification to an approved dwelling including raising floor levels by 300mm
2010-12-09
DA/485/2010/A
48 - 50 Meadows Street MERRYLANDS NSW 2160
2010-12-12 01:15:21
2010-12-09 00:00:00
Demolition and construction of a 2 storey residential flat building under the Affordable Rental Housing SEPP containing 12 apartments over basement carparking with access from Barangaroo Road
2010-12-09
DA/997/2010
4 Barangaroo Road TOONGABBIE NSW 2146
2010-12-12 01:15:21
2010-12-09 00:00:00
Demolition, tree removal and construction of a 3 storey residential flat building containing 12 units over basement carparking with strata subdivision
2010-12-09
DA/998/2010
34 Napier Street PARRAMATTA NSW 2150
2010-12-12 01:15:21
2010-12-09 00:00:00
Construction of a two storey dwelling house and tree removal
2010-12-09
CC/750/2010
14 Lewis Street EPPING NSW 2121
2010-12-12 01:15:21
2010-12-09 00:00:00
Demolition, tree removal and construction of a 2 storey dual occupancy development with a 1
2010-12-09
CC/751/2010
19 Rhodes Avenue GUILDFORD NSW 2161
2010-12-12 01:15:21
2010-12-09 00:00:00
Alterations and additions to existing dwelling
2010-12-09
CD/308/2010
30 Taywood Avenue WINSTON HILLS NSW 2153
2010-12-12 01:15:21
2010-12-09 00:00:00

Statistics

Average successful run time: 2 minutes

Total run time: 12 days

Total cpu time used: about 1 hour

Total disk space used: 18.1 MB

History

  • Auto ran revision f4c0592b and completed successfully .
    92 records added, 81 records removed in the database
  • Auto ran revision f4c0592b and completed successfully .
    81 records added, 81 records removed in the database
  • Auto ran revision f4c0592b and completed successfully .
    83 records added, 83 records removed in the database
  • Auto ran revision f4c0592b and completed successfully .
    91 records added, 84 records removed in the database
  • Auto ran revision f4c0592b and completed successfully .
    96 records added, 89 records removed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

parramatta / scraper.rb