planningalerts-scrapers / parramatta

Parramatta City Council Development Applications


Parramatta Council Scraper

  • Scrape detail page - Yes
  • Clearly defined data within a row - Yes

Setup MORPH_PERIOD for data recovery, available options are

  • 7 (days)
  • 14 (days) - default
  • thismonth
  • lastmonth

Enjoy

Note: XML feed on the site appears to be broken

Forked from ScraperWiki

Contributors henare LoveMyData equivalentideas jamezpolley mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.4.1 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/.........  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Fetching public_suffix 3.1.0  Using bundler 1.15.2  Fetching connection_pool 2.2.2  Fetching safe_yaml 1.0.5  Installing connection_pool 2.2.2  Installing public_suffix 3.1.0  Fetching unf_ext 0.0.7.5  Installing safe_yaml 1.0.5  Fetching hashdiff 0.4.0  Fetching httpclient 2.8.3  Installing hashdiff 0.4.0  Fetching mime-types-data 3.2018.0812  Installing httpclient 2.8.3  Installing mime-types-data 3.2018.0812  Installing unf_ext 0.0.7.5 with native extensions  Fetching net-http-digest_auth 1.4.1  Installing net-http-digest_auth 1.4.1  Fetching mini_portile2 2.3.0  Fetching ntlm-http 0.1.1  Installing mini_portile2 2.3.0  Installing ntlm-http 0.1.1  Fetching webrobots 0.1.2  Installing webrobots 0.1.2  Fetching sqlite3 1.3.13  Fetching timecop 0.9.1  Installing timecop 0.9.1  Installing sqlite3 1.3.13 with native extensions  Fetching vcr 5.0.0  Installing vcr 5.0.0  Fetching net-http-persistent 3.0.0  Installing net-http-persistent 3.0.0  Fetching addressable 2.6.0  Installing addressable 2.6.0  Fetching crack 0.4.3  Installing crack 0.4.3  Fetching mime-types 3.2.2  Installing mime-types 3.2.2  Fetching nokogiri 1.8.5  Installing nokogiri 1.8.5 with native extensions  Fetching webmock 3.6.0  Installing webmock 3.6.0  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20180417  Installing domain_name 0.5.20180417  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Bundle complete! 5 Gemfile dependencies, 27 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Post-install message from hashdiff:  The HashDiff constant used by this gem conflicts with another gem of a similar name. As of version 1.0 the HashDiff constant will be completely removed and replaced by Hashdiff. For more information see https://github.com/liufengyun/hashdiff/issues/45.  Bundle completed (26.53s)  Cleaning up the bundler cache.  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.2). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`. -----> Detecting rake tasks   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Saving record BC/80/2019, 404 - 406 Church Street PARRAMATTA NSW 2150 Saving record DA/398/2019, 10 Lomax Street EPPING NSW 2121 Saving record DA/401/2019, 1 Islay Street WINSTON HILLS NSW 2153 Saving record DA/402/2015/A, 15 Azile Court CARLINGFORD NSW 2118 Saving record DA/402/2019, 94B Baker Street CARLINGFORD NSW 2118 Saving record DA/59/2017/B, 10 Winton Avenue NORTHMEAD NSW 2152 Saving record CDP/430/2019, 23 Rippon Avenue DUNDAS NSW 2117 Saving record CDP/439/2019, 4 Hermington Street EPPING NSW 2121 Saving record DA/1289/1995/A, 41 Milton Avenue EASTWOOD NSW 2122 Saving record DA/403/2019, 49 Primrose Avenue RYDALMERE NSW 2116 Saving record DA/404/2019, 38 / 10 - 14 Hazlewood Place EPPING NSW 2121 Saving record DA/565/2018/B, 46 Tintern Avenue TELOPEA NSW 2117 Saving record TA/462/2019, 24 Lower Mount Street WENTWORTHVILLE NSW 2145 Saving record DA/1065/2016/B, 94 Jenkins Road CARLINGFORD NSW 2118 Saving record DA/405/2019, 23 Harold Street PARRAMATTA NSW 2150 Saving record DA/406/2019, 6 Eastwood Avenue EASTWOOD NSW 2122 Saving record DA/540/2016/C, 88 Church Street PARRAMATTA NSW 2150 Saving record DA/838/2018/A, 439 Wentworth Avenue TOONGABBIE NSW 2146 Saving record TA/463/2019, 5 Strickland Place WENTWORTHVILLE NSW 2145 Saving record TA/464/2019, 65 Warwick Road DUNDAS VALLEY NSW 2117 Saving record DA/354/2018/A, 23 Perry Street NORTH ROCKS NSW 2151 Saving record DA/407/2019, 21 Hassall Street PARRAMATTA NSW 2150 Saving record DA/408/2019, 70 Cowper Street GRANVILLE NSW 2142 Saving record TA/465/2019, 5 - 7 Owens Avenue NEWINGTON NSW 2127 Saving record TA/466/2019, 39 Dorothy Street RYDALMERE NSW 2116 Saving record TA/467/2019, 41 Chesterfield Road EPPING NSW 2121 Saving record TA/468/2019, 4 Taywood Avenue WINSTON HILLS NSW 2153 Saving record TA/469/2019, 2 / 42 Hassall Street PARRAMATTA NSW 2150 Saving record TA/470/2019, 15 - 19 Early Street PARRAMATTA NSW 2150 Saving record BC/81/2019, 6 Rebecca Parade WINSTON HILLS NSW 2153 Saving record DA/411/2019, 25 Bryson Street TOONGABBIE NSW 2146 Saving record DA/412/2019, 23A Broadoaks Street ERMINGTON NSW 2115 Saving record DA/715/2018/B, 67 Chanel Street TOONGABBIE NSW 2146 Saving record TA/471/2019, 6 Selkirk Street WINSTON HILLS NSW 2153 Saving record BC/82/2019, 102 Isabella Street NORTH PARRAMATTA NSW 2151 Saving record DA/410/2019, 32 Smith Street PARRAMATTA NSW 2150 Saving record DA/413/2019, 9 / 16 Buckleys Road WINSTON HILLS NSW 2153 Saving record DA/414/2019, 1 Kingsford Street ERMINGTON NSW 2115 Saving record DA/416/2019, 43 Dorothy Street RYDALMERE NSW 2116 Saving record DA/417/2019, 46 Fennell Street NORTH PARRAMATTA NSW 2151 Saving record DA/446/2018/A, 7 Dobson Crescent DUNDAS VALLEY NSW 2117 Something not right here: {"council_reference"=>"DA/467/2015/B", "description"=>"Development Application - Section 4.55(2) modification to approved DA/467/2015 for retention of existing heritage item and construction of a nine storey residential flat building with 21 apartments. Modifications include deletion of external stairs, internal layout modification and modification to roof top form.", "date_received"=>"2019-07-17", "address"=>nil, "date_scraped"=>"2019-07-23", "info_url"=>"http://eplanning.parracity.nsw.gov.au/Pages/XC.Track/SearchApplication.aspx?id=571382"} Saving record TA/472/2019, 389A North Rocks Road CARLINGFORD NSW 2118 Saving record TA/473/2019, 10 Valley Road EASTWOOD NSW 2122 Saving record BC/84/2019, 2 Windsor Road NORTHMEAD NSW 2152 Saving record BC/85/2019, 3 Campbell Street NORTHMEAD NSW 2152 Saving record CDP/441/2019, 1A Terry Road EASTWOOD NSW 2122 Saving record CDP/442/2019, 291 Pennant Hills Road CARLINGFORD NSW 2118 Saving record CDP/443/2019, 33A Stanley Road EPPING NSW 2121 Saving record CDP/444/2019, 36 Bevan Street NORTHMEAD NSW 2152 Saving record CDP/445/2019, 389 Wentworth Avenue TOONGABBIE NSW 2146 Saving record CDP/450/2019, 2 Morshead Avenue CARLINGFORD NSW 2118 Saving record DA/418/2019, 202 Kissing Point Road DUNDAS NSW 2117 Saving record DA/420/2019, 11 Murrills Crescent BAULKHAM HILLS NSW 2153 Saving record DA/421/2019, 29 Grand Avenue CAMELLIA NSW 2142 Saving record DA/422/2019, 11A Parkham Road OATLANDS NSW 2117 Saving record CDP/446/2019, 80 Chesterfield Road EPPING NSW 2121 Saving record DA/424/2019, 3 Campbell Street NORTHMEAD NSW 2152 Saving record DA/425/2019, 107 Carnarvon Street SILVERWATER NSW 2128 Saving record TA/474/2019, 20 Wigram Street HARRIS PARK NSW 2150 Saving record TA/475/2019, 37 Albert Street NORTH PARRAMATTA NSW 2151 Saving record TA/476/2019, 1 - 3 Virginia Street ROSEHILL NSW 2142 Saving record TA/477/2019, 5 Railway Parade WESTMEAD NSW 2145 Saving record TA/478/2019, 12 Kerry Avenue EPPING NSW 2121 Saving record TA/479/2019, 6 Dora Crescent DUNDAS NSW 2117 Saving record TA/480/2019, 36 Lochinvar Parade CARLINGFORD NSW 2118 Saving record TA/481/2019, 20 Goodin Road BAULKHAM HILLS NSW 2153 Saving record TA/482/2019, 11 Treeview Place NORTH ROCKS NSW 2151 Saving record TA/483/2019, 573 North Rocks Road CARLINGFORD NSW 2118 Saving record CDP/447/2019, 171 Church Street PARRAMATTA NSW 2150 Saving record CDP/448/2019, 31 Deakin Street SILVERWATER NSW 2128 Saving record DA/423/2019, 12 - 14 Birnie Avenue LIDCOMBE NSW 2141 Saving record TA/484/2019, 5 Cooke Way EPPING NSW 2121 Saving record TA/485/2019, 126 - 128 Good Street HARRIS PARK NSW 2150 Saving record DA/195/2019/A, 64 Caprera Road NORTHMEAD NSW 2152 Saving record TA/486/2019, 543 - 545 North Rocks Road CARLINGFORD NSW 2118 Saving record TA/487/2019, 29 Bennelong Parkway WENTWORTH POINT NSW 2127 Saving record TA/488/2019, 26 Lord Avenue DUNDAS VALLEY NSW 2117 Saving record TA/489/2019, 42 Wandella Avenue NORTHMEAD NSW 2152 Saving record TA/490/2019, 12 Gore Street PARRAMATTA NSW 2150

Data

Downloaded 7224 times by slav123 DevAppProject openaustralia WilliamYun LoveMyData irwin-r jesse-a-reilly tatol86 TheZepto wbchilds razz969 brickworksbp z37214728 Jedwards157 jayzhouny hoyathorwood Jeremy-Charlton Dave9129 ajoh3691 equivalentideas henare kadrach horizons444

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (8.83 MB) Use the API

rows 10 / 22901

description info_url date_received council_reference address comment_url date_scraped date
Removal 2 Trees
2010-12-09
TA/732/2010
5 Willoughby Street EPPING NSW 2121
2010-12-12 01:15:22
2010-12-09 00:00:00
Removal of 1 Tree
2010-12-09
TA/733/2010
18 / 47 Wentworth Avenue WESTMEAD NSW 2145
2010-12-12 01:15:22
2010-12-09 00:00:00
Removal of 2 Trees
2010-12-09
TA/734/2010
30 Brabyn Street NORTH PARRAMATTA NSW 2151
2010-12-12 01:15:22
2010-12-09 00:00:00
Removal of 1 Tree
2010-12-09
TA/735/2010
37 - 43 Stewart Street DUNDAS VALLEY NSW 2117
2010-12-12 01:15:22
2010-12-09 00:00:00
Section 96(1a) modification to an approved dwelling including raising floor levels by 300mm
2010-12-09
DA/485/2010/A
48 - 50 Meadows Street MERRYLANDS NSW 2160
2010-12-12 01:15:21
2010-12-09 00:00:00
Demolition and construction of a 2 storey residential flat building under the Affordable Rental Housing SEPP containing 12 apartments over basement carparking with access from Barangaroo Road
2010-12-09
DA/997/2010
4 Barangaroo Road TOONGABBIE NSW 2146
2010-12-12 01:15:21
2010-12-09 00:00:00
Demolition, tree removal and construction of a 3 storey residential flat building containing 12 units over basement carparking with strata subdivision
2010-12-09
DA/998/2010
34 Napier Street PARRAMATTA NSW 2150
2010-12-12 01:15:21
2010-12-09 00:00:00
Construction of a two storey dwelling house and tree removal
2010-12-09
CC/750/2010
14 Lewis Street EPPING NSW 2121
2010-12-12 01:15:21
2010-12-09 00:00:00
Demolition, tree removal and construction of a 2 storey dual occupancy development with a 1
2010-12-09
CC/751/2010
19 Rhodes Avenue GUILDFORD NSW 2161
2010-12-12 01:15:21
2010-12-09 00:00:00
Alterations and additions to existing dwelling
2010-12-09
CD/308/2010
30 Taywood Avenue WINSTON HILLS NSW 2153
2010-12-12 01:15:21
2010-12-09 00:00:00

Statistics

Average successful run time: 2 minutes

Total run time: 11 days

Total cpu time used: about 1 hour

Total disk space used: 17.7 MB

History

  • Auto ran revision f4c0592b and completed successfully .
    79 records added, 70 records removed in the database
  • Auto ran revision f4c0592b and completed successfully .
    70 records added, 62 records removed in the database
  • Auto ran revision f4c0592b and completed successfully .
    70 records added, 69 records removed in the database
  • Auto ran revision f4c0592b and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision f4c0592b and completed successfully .
    75 records added, 64 records removed in the database
  • ...
  • Forked from ScraperWiki

Show complete history

Scraper code

Ruby

parramatta / scraper.rb