planningalerts-scrapers / saplanningportal

South Australia Development Applications - SA Planning Portal

README.md

South Australia (SA) Planning Portal scraper

Server - .NET
Cookie tracking - No
Pagnation - Yes
Javascript - No
Ajax - Yes
Clearly defined data within a record - Yes
Scrape detail page - No

Setup MORPH_PERIOD for data recovery, available options are

thisweek (default)
thismonth
lastmonth
year (ie. 2017, min 2003)

Enjoy

Contributors

Last run failed 2019-02-15 with status code 255.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> PHP app detected [1G-----> Bootstrapping... [1G [1G ! ERROR: Failed to download minimal PHP for bootstrapping. [1G Please try again, or contact support if this problem persists. [1G

Data

Downloaded 611 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.31 MB) Use the API

rows 10 / 4831

id	council_reference	address	description	info_url	comment_url	date_scraped	date_received
1	252/D341/17	Wattle Street Brompton, SA	Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.	http://www.saplanningportal.sa.gov.au/public_register#view-59720-LDE	http://www.saplanningportal.sa.gov.au/public_register	2017-10-17	2017-10-15
2	040/D295/17	17-23 Ashburton Street Blair Athol, SA	Land Division	http://www.saplanningportal.sa.gov.au/public_register#view-59714-LDE	http://www.saplanningportal.sa.gov.au/public_register	2017-10-17	2017-10-13
3	145/D202/17	Valley View Drive McLaren Vale, SA	1 in to 2 land division	http://www.saplanningportal.sa.gov.au/public_register#view-59712-LDE	http://www.saplanningportal.sa.gov.au/public_register	2017-10-17	2017-10-13
4	170/D195/17	Andrea Avenue Newton, SA	Torrens Title land division. One allotment into three. Existing dwelling to be demolished.	http://www.saplanningportal.sa.gov.au/public_register#view-59628-LDE	http://www.saplanningportal.sa.gov.au/public_register	2017-10-17	2017-10-13
5	170/D196/17	8-10 Gilbert Street NEWTON, SA	1 into 4 Torrens division	http://www.saplanningportal.sa.gov.au/public_register#view-59717-LDE	http://www.saplanningportal.sa.gov.au/public_register	2017-10-17	2017-10-13
6	211/D172/17	37 and 39 Malurus Avenue Lockleys, SA	division of land to create 3 new allotments from the existing two.	http://www.saplanningportal.sa.gov.au/public_register#view-59713-LDE	http://www.saplanningportal.sa.gov.au/public_register	2017-10-17	2017-10-13
7	361/D188/17	19 Uranbo Street Salisbury North, SA	Torrens Land Division. One Allotment into Two Allotments.	http://www.saplanningportal.sa.gov.au/public_register#view-59715-LDE	http://www.saplanningportal.sa.gov.au/public_register	2017-10-17	2017-10-13
8	361/D189/17	7 Gilbert Street Ingle Farm, SA	Land Division	http://www.saplanningportal.sa.gov.au/public_register#view-59719-LDE	http://www.saplanningportal.sa.gov.au/public_register	2017-10-17	2017-10-13
9	100/D241/17	9 Rosedale Avenue Morphettville, SA	Division of land to create two new Torrens title allotments	http://www.saplanningportal.sa.gov.au/public_register#view-59699-LDE	http://www.saplanningportal.sa.gov.au/public_register	2017-10-17	2017-10-12
10	100/D242/17	19 Lawson Avenue Morphettville, SA	Division of land to create two new Torrens title allotments	http://www.saplanningportal.sa.gov.au/public_register#view-59700-LDE	http://www.saplanningportal.sa.gov.au/public_register	2017-10-17	2017-10-12

Statistics

Average successful run time: half a minute

Total run time: about 4 hours

Total cpu time used: 2 minutes

Total disk space used: 1.34 MB

History

Auto ran revision 696d0df8 and failed 2019-02-15.

run time 19 s

nothing changed in the database
Auto ran revision 696d0df8 and failed 2019-02-14.

run time 15 s

nothing changed in the database
Auto ran revision 696d0df8 and failed 2019-02-13.

run time 14 s

nothing changed in the database
Auto ran revision 696d0df8 and failed 2019-02-12.

run time 15 s

nothing changed in the database
Auto ran revision 696d0df8 and failed 2019-02-11.

run time 15 s

nothing changed in the database
...
Created on morph.io 2017-10-17

Show complete history

Scraper code

PHP

saplanningportal / scraper.php

git clone URL