N-2-O / nsw_planning_major_projects

Scrapes major project assessments in NSW


Scrapes State Significant Applications in NSW.

This is a scraper that runs on Morph.

Contributors N-2-O

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 67, in <module> main() File "scraper.py", line 61, in main visit_pages(conn) File "scraper.py", line 48, in visit_pages apps = get_data(html, conn) File "scraper.py", line 40, in get_data start, end = get_application_exhibition(base_html + link) File "scraper.py", line 24, in get_application_exhibition return d[0], d[1] IndexError: list index out of range

Data

Downloaded 1 time by N-2-O

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.86 MB) Use the API

rows 10 / 7076

council_reference address council description info_url date_scraped on_notice_from on_notice_to
SSI-9371
Land Between North Star And Nsw/Qld Border
Gwydir Shire, Moree Plains Shire
Inland Rail - North Star to NSW/Queensland Border
02/22/23
SSD-32927319
500 Harris Street, Ultimo
City of Sydney
Powerhouse Ultimo Renewal
02/22/23
SSD-17017460
Off Construction Road, Mannering Park Nsw
Central Coast, Lake Macquarie City
Chain Valley Colliery Consolidation Project
02/22/23
SSD-11591659
279 Deep Creek Road, Nsw 2324
Mid-Coast
Deep Creek Quarry
02/22/23
SSD-17899480
23-27 Lytton Street, Wentworthville
Cumberland
Wentworthville Northside West Clinic Extension
02/22/23
SSD-7293
Sancrox Road Sancrox
Port Macquarie-Hastings
Sancrox Quarry Expansion Project
02/22/23
SSD-31822612
91 Pacific Highway Hornsby
Hornsby Shire
Alterations and Additions to Barker College
02/22/23
DA176-9-2004-Mod-3
, ,North-West Of Goulburn,New South Wales,,Australia
Upper Lachlan Shire
MOD 3 - Additional buildings in substation compound
02/22/23
SSD-10096818
258 Arumpo Road, Wentworth
Wentworth Shire
Buronga Landfill Expansion
02/22/23
SSD-9368-Mod-5
Farmland Drive Schofields Nsw 2762
Blacktown
Alex Avenue Public School Modification 5 - Staging
02/22/23

Statistics

Average successful run time: half a minute

Total run time: about 3 hours

Total cpu time used: 14 minutes

Total disk space used: 1.94 MB

History

  • Auto ran revision c813e04f and failed .
    nothing changed in the database
  • Auto ran revision c813e04f and failed .
    1 record added in the database
  • Auto ran revision c813e04f and failed .
    1 record added in the database
  • Auto ran revision c813e04f and failed .
    1 record added, 1 record removed in the database
  • Auto ran revision c813e04f and failed .
    1 record added, 1 record removed in the database
  • ...
  • Created on morph.io

Show complete history