ianheggie-oaf / nsw_joint_regional_planning_panels

NSW Sydney and Regional Planning Panels Register

README.md

NSW Joint Regional Planning Panels

This is a scraper that runs on Morph. To get started see the documentation

It scrapes planning applications currently under assessment from the NSW Planning Portal's planning panels register.

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

Expected output

Getting page 0...
Saving PPSSTH-123...
Saving PPSSCC-456...
...
Getting page 3...
Finished - added 42 records.

Execution time under a minute

To run the tests

bundle exec rspec

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors mlandauer benrfairless ianheggie-oaf

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G-----> Installing bundler 2.3.10 [1G-----> Removing BUNDLED WITH version in the Gemfile.lock [1G-----> Compiling Ruby [1G-----> Using Ruby version: ruby-3.2.2 [1G-----> Installing dependencies using bundler 2.3.10 [1G Running: BUNDLE_WITHOUT='development:test' BUNDLE_PATH=vendor/bundle BUNDLE_BIN=vendor/bundle/bin BUNDLE_DEPLOYMENT=1 bundle install -j4 [1G Fetching gem metadata from https://rubygems.org/......... [1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git [1G Using bundler 2.4.10 [1G Fetching public_suffix 7.0.5 [1G Fetching base64 0.3.0 [1G Fetching connection_pool 3.0.2 [1G Fetching domain_name 0.6.20240107 [1G Installing base64 0.3.0 [1G Installing connection_pool 3.0.2 [1G Installing public_suffix 7.0.5 [1G Installing domain_name 0.6.20240107 [1G Fetching mutex_m 0.3.0 [1G Fetching logger 1.7.0 [1G Installing mutex_m 0.3.0 [1G Fetching mime-types-data 3.2026.0701 [1G Installing logger 1.7.0 [1G Fetching net-http-digest_auth 1.4.1 [1G Installing net-http-digest_auth 1.4.1 [1G Fetching nkf 0.3.0 [1G Fetching racc 1.8.1 [1G Installing mime-types-data 3.2026.0701 [1G Fetching webrick 1.9.2 [1G Installing nkf 0.3.0 with native extensions [1G Installing racc 1.8.1 with native extensions [1G Installing webrick 1.9.2 [1G Fetching webrobots 0.1.2 [1G Installing webrobots 0.1.2 [1G Fetching sqlite3 2.2.0 (x86_64-linux-gnu) [1G Fetching rubyntlm 0.6.5 [1G Installing rubyntlm 0.6.5 [1G Fetching net-http-persistent 4.0.8 [1G Installing net-http-persistent 4.0.8 [1G Fetching addressable 2.9.0 [1G Installing addressable 2.9.0 [1G Fetching httpclient 2.9.0 [1G Installing sqlite3 2.2.0 (x86_64-linux-gnu) [1G Installing httpclient 2.9.0 [1G Fetching http-cookie 1.1.6 [1G Installing http-cookie 1.1.6 [1G Fetching mime-types 3.7.0 [1G Installing mime-types 3.7.0 [1G Fetching sqlite_magic 0.0.6 [1G Installing sqlite_magic 0.0.6 [1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176) [1G Fetching nokogiri 1.17.2 (x86_64-linux) [1G Installing nokogiri 1.17.2 (x86_64-linux) [1G Fetching mechanize 2.14.0 [1G Installing mechanize 2.14.0 [1G Bundle complete! 12 Gemfile dependencies, 24 gems now installed. [1G Gems in the groups 'development' and 'test' were not installed. [1G Bundled gems are installed into `./vendor/bundle` [1G Bundle completed (5.50s) [1G Cleaning up the bundler cache. [1G Removing bundler (2.3.10) [1G-----> Detecting rake tasks [1G [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Getting page 0... Saving PPSSTH-638... Saving PPSHCC-428... Saving PPSHCC-431... Saving PPSHCC-429... Saving PPSSTH-621... Saving PPSWES-440... Saving PPSWES-439... Saving PPSHCC-426... Saving PPSNTH-527... Getting page 1... Saving PPSNTH-536... Saving PPSSTH-619... Saving PPSSWC-681... Saving PPSHCC-425... Saving PPSSTH-614... Saving PPSNTH-526... Saving PPSNTH-427... Saving PPSWES-425... Saving PPSSTH-620... Getting page 2... Saving PPSSTH-637... Saving PPSWES-426... Saving PPSSTH-612... Saving PPSSEC-455... Saving PPSNTH-524... Saving PPSWES-441... Saving PPSWES-424... Saving PPSHCC-419... Saving PPSWES-423... Getting page 3... Saving PPSWES-401... Saving PPSNTH-522... Saving PPSSTH-613... Saving PPSNTH-504... Saving PPSHCC-420... Saving PPSSTH-610... Saving PPSNTH-500... Saving PPSNTH-510... Saving PPSSTH-611... Getting page 4... Saving PPSHCC-421... Saving PPSWES-397... Saving PPSSTH-600... Saving PPSNTH-496... Saving PPSSNH-771... Saving PPSHCC-427... Saving PPSNTH-512... Saving PPSSTH-586... Saving PPSSWC-679... Getting page 5... Saving PPSSNH-769... Saving PPSNTH-488... Saving PPSNTH-489... Saving PPSSTH-581... Saving PPSWES-396... Saving PPSHCC-412... Saving PPSSTH-587... Saving PPSHCC-422... Saving PPSNTH-482... Getting page 6... Saving PPSHCC-413... Saving PPSSCC-804... Saving PPSWES-373... Saving PPSSCC-800... Saving PPSWES-442... Saving PPSSTH-574... Saving PPSNTH-481... Saving PPSWES-358... Saving PPSSTH-575... Getting page 7... Saving PPSWES-360... Saving PPSNTH-478... Saving PPSNTH-479... Saving PPSWES-377... Saving PPSNTH-473... Saving PPSNTH-480... Saving PPSSTH-599... Saving PPSSNH-763... Saving PPSSTH-568... Getting page 8... Saving PPSHCC-405... Saving PPSWES-376... Saving PPSSTH-597... Saving PPSHCC-385... Saving PPSSTH-588... Saving PPSHCC-387... Saving PPSHCC-384... Saving PPSSWC-680... Saving PPSSTH-569... Getting page 9... Saving PPSNTH-468... Saving PPSHCC-382... Saving PPSSWC-677... Saving PPSSWC-675... Saving PPSSEC-446... Saving PPSWES-446... Saving PPSSTH-563... Saving PPSNTH-471... Saving PPSWES-318... Getting page 10... Saving PPSSNH-739... Saving PPSNTH-470... Saving PPSSTH-550... Saving PPSSCC-783... Saving PPSSNH-732... Saving PPSHCC-377... Saving PPSHCC-374... Saving PPSWES-310... Saving PPSNTH-455... Getting page 11... Saving PPSNTH-456... Saving PPSHCC-372... Saving PPSNTH-434... Saving PPSNTH-428... Saving PPSSNH-659... Saving PPSHCC-364... Saving PPSHCC-365... Saving PPSSCC-684... Saving PPSHCC-353... Getting page 12... Saving PPSWES-321... Saving PPSSCC-653... Saving PPSNTH-387... Saving PPSSWC-487... Saving PPSSWC-443... Saving PPSSWC-434... Saving PPSSCC-592... Saving PPSHCC-294... Saving PPSSTH-412... Getting page 13... Saving PPSSTH-343... Saving PPSHCC-271... Saving PPSHCC-260... Saving PPSSCC-425... Saving PPSSCC-396... Saving PPSSWC-343... Saving PPS-2019ECI008... Saving PPSSWC-199... Getting page 14... Finished - added 125 records.

Data

Downloaded 157 times by ianheggie-oaf

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (72 KB) Use the API

rows 10 / 125

council_reference address description info_url date_scraped date_received
PPSSTH-638
157 Alexandra Street East Albury 2640,159 Alexandra Street East Albury 2640,163 Alexandra Street East Albury 2640, NSW
Twenty Seven (27) Apartments - Carparking, Vegetation Removal & Lot Consolidation
https://www.planningportal.nsw.gov.au/planning-panel/residential-flat-building-affordable-housing-4
2026-08-14
2026-08-06
PPSHCC-428
17 Ivory Close Heatherbrae 2324, NSW
Proposed change of use of the Site at 17 Ivory Close, from approved storage of logistic goods to an electronic waste recycling facility.
https://www.planningportal.nsw.gov.au/planning-panel/change-use-warehouse-resource-recovery-facility
2026-08-14
2026-08-05
PPSHCC-431
52 Wyndella Road Lochinvar 2321, NSW
Construction of a new two-storey junior school building, single storey modular building, canteen, and ancillary works, and use of the land as an educational establishment.
https://www.planningportal.nsw.gov.au/planning-panel/educational-establishment-school-1
2026-08-14
2026-08-11
PPSHCC-429
1496 Hue Hue Road Wyee 2259,106 Wyee Road Wyee 2259, NSW
Supermarket with specialty retail and commercial premises and carparking.
https://www.planningportal.nsw.gov.au/planning-panel/wyee-retail
2026-08-14
2026-08-05
PPSSTH-621
26 Ridge Street Bega 2550, NSW
Installation of a 3MW solar farm with related infrastructure and battery energy storage system.
https://www.planningportal.nsw.gov.au/planning-panel/electricity-generating-facility-solar-and-bess
2026-08-14
2026-07-24
PPSWES-440
293 Hawkins Road Yoogali 2680, NSW
4.95MW Solar Farm & BESS
https://www.planningportal.nsw.gov.au/planning-panel/electricity-generating-facility-495mw-solar-farm-and-four-4-bess-battery-energy-storage-system
2026-08-14
2026-07-14
PPSWES-439
10 French Smith Place Kelso 2795, NSW
Partial demolition, additions and alterations to existing school
https://www.planningportal.nsw.gov.au/planning-panel/holy-family-catholic-primary-school
2026-08-14
2026-07-08
PPSHCC-426
19 Scotch Creek Road Millers Forest 2324, NSW
Light Industry (Sand and Gravel Processing Facility) including alterations and additions to site infrastructure, decommissioning of former aquaculture ponds, construction of flood mound and shed (2 Stages)
https://www.planningportal.nsw.gov.au/planning-panel/sand-and-gravel-processing-facility
2026-08-14
2026-07-13
PPSNTH-527
930 Kiandool Lane Bohena Creek 2390, NSW
Construct and Operate a Carbon Dioxide (CO2) plant, which will connect to the adjacent existing Wilga Park Power Station
https://www.planningportal.nsw.gov.au/planning-panel/construct-and-operate-carbon-dioxide-co2-plant
2026-08-14
2026-07-07
PPSNTH-536
3 Heffron Street Tweed Heads South 2486,5 Heffron Street Tweed Heads South 2486,6 Seymour Street Tweed Heads South 2486, NSW
In-fill Affordable (Social) Housing - Residential flat building comprising of 32 units.
https://www.planningportal.nsw.gov.au/planning-panel/affordable-social-housing-heffron-street
2026-08-14
2026-07-23

Statistics

Average successful run time: less than a minute

Total run time: less than a minute

Total cpu time used: less than 5 seconds

Total disk space used: 373 KB

History

  • Manually ran revision 2e296b37 and completed successfully .
    125 records added in the database
  • Created on morph.io