planningalerts-scrapers / nsw_joint_regional_planning_panels

NSW Joint Regional Planning Panels Development Register


NSW Joint Regional Planning Panels

This is a scraper that runs on Morph. To get started see the documentation

It scrapes planning applications currently under assessment from the NSW Planning Portal's planning panels register.

Add any issues to https://github.com/planningalerts-scrapers/issues/issues

To run the scraper

bundle exec ruby scraper.rb

Expected output

Getting page 0...
Saving PPSSTH-123...
Saving PPSSCC-456...
...
Getting page 3...
Finished - added 42 records.

Execution time under a minute

To run the tests

bundle exec rspec

To run style and coding checks

bundle exec rubocop

To check for security updates

gem install bundler-audit
bundle-audit

Contributors mlandauer benrfairless ianheggie-oaf

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Getting page 0... Saving PPSSTH-638... Saving PPSHCC-428... Saving PPSHCC-431... Saving PPSHCC-429... Saving PPSSTH-621... Saving PPSWES-440... Saving PPSWES-439... Saving PPSHCC-426... Saving PPSNTH-527... Getting page 1... Saving PPSNTH-536... Saving PPSSTH-619... Saving PPSSWC-681... Saving PPSHCC-425... Saving PPSSTH-614... Saving PPSNTH-526... Saving PPSNTH-427... Saving PPSWES-425... Saving PPSSTH-620... Getting page 2... Saving PPSSTH-637... Saving PPSWES-426... Saving PPSSTH-612... Saving PPSSEC-455... Saving PPSNTH-524... Saving PPSWES-441... Saving PPSWES-424... Saving PPSHCC-419... Saving PPSWES-423... Getting page 3... Saving PPSWES-401... Saving PPSNTH-522... Saving PPSSTH-613... Saving PPSNTH-504... Saving PPSHCC-420... Saving PPSSTH-610... Saving PPSNTH-500... Saving PPSNTH-510... Saving PPSSTH-611... Getting page 4... Saving PPSHCC-421... Saving PPSWES-397... Saving PPSSTH-600... Saving PPSNTH-496... Saving PPSSNH-771... Saving PPSHCC-427... Saving PPSNTH-512... Saving PPSSTH-586... Saving PPSSWC-679... Getting page 5... Saving PPSSNH-769... Saving PPSNTH-488... Saving PPSNTH-489... Saving PPSSTH-581... Saving PPSWES-396... Saving PPSHCC-412... Saving PPSSTH-587... Saving PPSHCC-422... Saving PPSNTH-482... Getting page 6... Saving PPSHCC-413... Saving PPSSCC-804... Saving PPSWES-373... Saving PPSSCC-800... Saving PPSWES-442... Saving PPSSTH-574... Saving PPSNTH-481... Saving PPSWES-358... Saving PPSSTH-575... Getting page 7... Saving PPSWES-360... Saving PPSNTH-478... Saving PPSNTH-479... Saving PPSWES-377... Saving PPSNTH-473... Saving PPSNTH-480... Saving PPSSTH-599... Saving PPSSNH-763... Saving PPSSTH-568... Getting page 8... Saving PPSHCC-405... Saving PPSWES-376... Saving PPSSTH-597... Saving PPSHCC-385... Saving PPSSTH-588... Saving PPSHCC-387... Saving PPSHCC-384... Saving PPSSWC-680... Saving PPSSTH-569... Getting page 9... Saving PPSNTH-468... Saving PPSHCC-382... Saving PPSSWC-677... Saving PPSSWC-675... Saving PPSSEC-446... Saving PPSWES-446... Saving PPSSTH-563... Saving PPSNTH-471... Saving PPSWES-318... Getting page 10... Saving PPSSNH-739... Saving PPSNTH-470... Saving PPSSTH-550... Saving PPSSCC-783... Saving PPSSNH-732... Saving PPSHCC-377... Saving PPSHCC-374... Saving PPSWES-310... Saving PPSNTH-455... Getting page 11... Saving PPSNTH-456... Saving PPSHCC-372... Saving PPSNTH-434... Saving PPSNTH-428... Saving PPSSNH-659... Saving PPSHCC-364... Saving PPSHCC-365... Saving PPSSCC-684... Saving PPSHCC-353... Getting page 12... Saving PPSWES-321... Saving PPSSCC-653... Saving PPSNTH-387... Saving PPSSWC-487... Saving PPSSWC-443... Saving PPSSWC-434... Saving PPSSCC-592... Saving PPSHCC-294... Saving PPSSTH-412... Getting page 13... Saving PPSSTH-343... Saving PPSHCC-271... Saving PPSHCC-260... Saving PPSSCC-425... Saving PPSSCC-396... Saving PPSSWC-343... Saving PPS-2019ECI008... Saving PPSSWC-199... Getting page 14... Finished - added 125 records.

Data

Downloaded 11368 times by dcalde openaustralia mlandauer DevAppProject AthleticoPrawn jesse-a-reilly WilliamYun tkrikke repose-lecture vlp-cmd 538digital TheZepto LoveMyData qs4v8thvrq-boop Joel-Tan_valocity sufiyanirfan3 muzzie86 horizons444 seegolovemee mattykn Brookerichards888 cankei vietbaracon odnagroup gdmhunter mehscrewit henare jayzhouny planometric-vic Jedwards157

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (359 MB) Use the API

rows 1 / 1

value_blob type name
4448
Fixnum
starting_id

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (359 MB) Use the API

rows 10 / 515954

status date_scraped capital_investment_value lga description info_url region jrpp_id council_da_no date_of_determination date_received date_of_panel_meeting council_reference determination on_notice_from address on_notice_to panel_meeting_venue type_of_development chair date_of_assesment_report_received jrpp_members number_of_lots_proposed number_of_submissons date_of_council_notice_of_determination date_of_site_visit council_planning_officer_recommendation type_of_matter panel_reference planning_proposal_ref._number project_description address/location date_panel_appointed_rpa date_of_completion regional_panel_chair panel_meeting_time number_of_submissons_received gateway_determination_date panel_meeting_date dept._ref._number date_of_advice_request date_da_registered_with_secretariat da_lodgement_date da_number date_of_council's_notice_of_determination address_location please_contact_council_for_all_enquiries_until_panel_meeting_is_scheduled dept__ref__number planning_proposal_ref__number planning_panel date_referred_to_panel subject_to_legal_appeal description_of_legal_appeal date_panel_appointed_ppa scc_id panel_reference_for_development_application
Completed
2012-08-09
$9,000,000
Goulburn Mulwaree Council
Stock and Sale Yards
Southern Joint Regional Planning Panel
1
DA001/0910
19-Feb-2010
2009-07-01
19-Feb-2010
2009STH001
Refused
2009-07-08
68 and 102 Mazamet Road, Goulburn
2009-08-07
Goulburn Mulwaree Council Chambers, at Civic Centre, Ground Floor, at 184-194 Bourke Street, Goulburn
Designated Development
Completed
2012-08-09
$28,000,000
Wollongong City Council
4 Storey office/research building
Southern Joint Regional Planning Panel
2
2009/779
24-Sep-2009
2009-07-03
24-Sep-2009
2009STH002
Approved
2009-07-10
Squires Way, Fairy Meadow NSW 2519
2009-08-05
Wollongong City Council, Administration Building, Level 9, 41 Burelli Street, Wollongong
Capital Investment Value > $10M
PAM ALLAN
14-Sep-2009
Completed
2012-08-09
$29,000,000
Wollongong City Council
3 Storey research office and laboratory building
Southern Joint Regional Planning Panel
3
2009/780
24-Sep-2009
2009-07-03
24-Sep-2009
2009STH003
Approved
2009-07-10
Squires Way, Fairy Meadow NSW 2519
2009-08-05
Wollongong City Council, Administration Building Level 9, 41 Burelli Street Wollongong
Capital Investment Value > $10M
PAM ALLAN
14-Sep-2009
Completed
2012-08-09
$25,000,000
Blacktown City Council
20 storey mixed used development
Sydney West Joint Regional Planning Panel
4
DA-09-1574
26-Aug-2010
2009-07-08
26-Aug-2010
2009SYW001
Approved
2009-07-29
Second Avenue, Blacktown
2009-08-12
Blacktown City Council, Committee Rooms 2 & 3, 5th Floor, 62 Flushcombe Road, Blacktown
Capital Investment Value > $10M
JANET THOMSON
Completed
2012-08-09
$45,000,000
Marrickville Council
Mixed use development
Sydney East Joint Regional Planning Panel
5
2009/00262
16-Dec-2009
2009-07-21
16-Dec-2009
2009SYE001
Approved
2009-07-29
139 - 143 Parramatta Road, Camperdown
2009-08-13
Marrickville Council Function Room, Level 3, 2-14 Fisher Street, Petersham
Capital Investment Value > $10M
Completed
2012-08-09
$25,000,000
Wollongong City Council
Masterplan retirement village 158 units
Southern Joint Regional Planning Panel
6
2009/843
03-Dec-2009
2009-07-17
03-Dec-2009
2009STH004
Refused
2009-07-27
24-60 Hooka Creek Road, BERKELEY NSW 2506
2009-09-07
Level 10 Council Chambers, Wollongong City Council Administration Building, 41 Burelli Street, Wollongong
Capital Investment Value > $10M
Completed
2012-08-09
$8,900,000
Wollongong City Council
Redevelopment of North Beach Bathers Pavilion and associated works
Southern Joint Regional Planning Panel
7
2009/883
19-Nov-2009
2009-07-24
18-Nov-2009
2009STH005
Approved
2009-08-05
Lot 70 Cliff Road, WOLLONGONG NSW 2500
2009-09-11
Wollongong City Council , Level 10, 41 Burelli Street Wollongong
CIV > $5M - Council interest
Completed
2012-08-09
$6,000,000
Shellharbour City Council
Subdivision to create 82 residential lots, 1 large lot, 1 public reserve & residue lot
Southern Joint Regional Planning Panel
8
251/2009
19-Nov-2009
2009-07-30
19-Nov-2009
2009STH006
Approved
2009-08-13
Lot 8001, Sloop Avenue, Shell Cove
2009-08-27
Shellharbour Council Function Room, Council's Administration Centre, Ground Floor, Lamerton House, Lamerton Crescent, Shellharbour
CIV > $5M - Council interest
PAM ALLAN
85
Completed
2012-08-09
$40,000,000
Marrickville Council
Marrickville RSL site
Sydney East Joint Regional Planning Panel
9
DA200900288
2009-08-06
04-Nov-2009
2009SYE004
Withdrawn
2009-08-13
359 Illawarra Rd, Marrickville
2009-08-27
Capital Investment Value > $10M
Completed
2012-08-09
$12,000,000
Pittwater Council
Subdivision, Construction of a Focal Neighbourhood Centre
Sydney East Joint Regional Planning Panel
10
N0283/09
12-Nov-2009
2009-07-24
12-Nov-2009
2009SYE002
Refused
2009-08-24
23B Macpherson St, Warriewood
2009-09-23
Mona Vale Memorial Hall, 1 Park Street, Mona Vale
Capital Investment Value > $10M

Statistics

Average successful run time: 3 minutes

Total run time: 24 days

Total cpu time used: about 4 hours

Total disk space used: 360 MB

History

  • Auto ran revision 4c2399aa and completed successfully .
    125 records added in the database
  • Auto ran revision 4c2399aa and completed successfully .
    125 records added in the database
  • Auto ran revision 4c2399aa and completed successfully .
    125 records added in the database
  • Auto ran revision 4474d524 and completed successfully .
    125 records added in the database
  • Auto ran revision 4474d524 and completed successfully .
    122 records added in the database
  • ...
  • Created on morph.io

Show complete history