planningalerts-scrapers / saplanningportal
South Australia Development Applications - SA Planning Portal
South Australia (SA) Planning Portal scraper
Add any issues to https://github.com/planningalerts-scrapers/issues/issues
- Server - .NET
- Cookie tracking - No
- Pagnation - Yes
- Javascript - No
- Ajax - Yes
- Clearly defined data within a record - Yes
- Scrape detail page - No
Enjoy
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Ruby app detected
[1G-----> Compiling Ruby
[1G-----> Using Ruby version: ruby-2.5.3
[1G-----> Installing dependencies using bundler version 1.15.2
[1G Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment
[1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.
[1G Fetching gem metadata from https://rubygems.org/......
[1G Fetching version metadata from https://rubygems.org/.
[1G Fetching https://github.com/openaustralia/scraperwiki-ruby.git
[1G Using bundler 1.15.2
[1G Fetching connection_pool 2.2.2
[1G Fetching unf_ext 0.0.7.5
[1G Fetching httpclient 2.8.3
[1G Installing connection_pool 2.2.2
[1G Installing unf_ext 0.0.7.5 with native extensions
[1G Installing httpclient 2.8.3
[1G Fetching json 2.2.0
[1G Installing json 2.2.0 with native extensions
[1G Fetching mime-types-data 3.2018.0812
[1G Installing mime-types-data 3.2018.0812
[1G Fetching net-http-digest_auth 1.4.1
[1G Installing net-http-digest_auth 1.4.1
[1G Fetching mini_portile2 2.4.0
[1G Installing mini_portile2 2.4.0
[1G Fetching ntlm-http 0.1.1
[1G Installing ntlm-http 0.1.1
[1G Fetching webrobots 0.1.2
[1G Installing webrobots 0.1.2
[1G Fetching rubysl-base64 2.0.0
[1G Installing rubysl-base64 2.0.0
[1G Fetching sqlite3 1.4.0
[1G Installing sqlite3 1.4.0 with native extensions
[1G Fetching net-http-persistent 3.0.0
[1G Installing net-http-persistent 3.0.0
[1G Fetching mime-types 3.2.2
[1G Installing mime-types 3.2.2
[1G Fetching nokogiri 1.10.1
[1G Installing nokogiri 1.10.1 with native extensions
[1G Fetching unf 0.1.4
[1G Installing unf 0.1.4
[1G Fetching sqlite_magic 0.0.6
[1G Installing sqlite_magic 0.0.6
[1G Fetching domain_name 0.5.20180417
[1G Installing domain_name 0.5.20180417
[1G Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)
[1G Fetching http-cookie 1.0.3
[1G Installing http-cookie 1.0.3
[1G Fetching mechanize 2.7.6
[1G Installing mechanize 2.7.6
[1G Bundle complete! 4 Gemfile dependencies, 21 gems now installed.
[1G Gems in the groups development and test were not installed.
[1G Bundled gems are installed into ./vendor/bundle.
[1G Bundle completed (32.71s)
[1G Cleaning up the bundler cache.
[1G Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.17.3). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.
[1G-----> Detecting rake tasks
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Scraping page 1 of 22
Scraping page 2 of 22
Scraping page 3 of 22
Scraping page 4 of 22
Scraping page 5 of 22
Scraping page 6 of 22
Scraping page 7 of 22
Scraping page 8 of 22
Scraping page 9 of 22
Scraping page 10 of 22
Scraping page 11 of 22
Scraping page 12 of 22
Scraping page 13 of 22
Scraping page 14 of 22
Scraping page 15 of 22
Scraping page 16 of 22
Scraping page 17 of 22
Scraping page 18 of 22
Scraping page 19 of 22
Scraping page 20 of 22
Scraping page 21 of 22
Something not right here: {"council_reference"=>"21041857", "address"=>"", "description"=>"To convert existing strata titles to Torrens title allotments", "info_url"=>"https://plan.sa.gov.au/development_application_register#view-21041857-DAP", "comment_url"=>"https://plan.sa.gov.au/development_application_register", "date_scraped"=>"2022-01-25", "date_received"=>"2022-01-06"}
Scraping page 22 of 22
Data
Downloaded
1953 times
by
To download data sign in with GitHub
rows 10 / 45410
| id | council_reference | address | description | info_url | comment_url | date_scraped | date_received |
|---|---|---|---|---|---|---|---|
|
1
|
252/D341/17
|
Wattle Street Brompton, SA
|
Boundary Realignment. Torrens Title division. 2 semi-detached dwellings. 1 detached dwelling.
|
2017-10-17
|
2017-10-15
|
||
|
2
|
040/D295/17
|
17-23 Ashburton Street Blair Athol, SA
|
Land Division
|
2017-10-17
|
2017-10-13
|
||
|
3
|
145/D202/17
|
Valley View Drive McLaren Vale, SA
|
1 in to 2 land division
|
2017-10-17
|
2017-10-13
|
||
|
4
|
170/D195/17
|
Andrea Avenue Newton, SA
|
Torrens Title land division. One allotment into three. Existing dwelling to be demolished.
|
2017-10-17
|
2017-10-13
|
||
|
5
|
170/D196/17
|
8-10 Gilbert Street NEWTON, SA
|
1 into 4 Torrens division
|
2017-10-17
|
2017-10-13
|
||
|
6
|
211/D172/17
|
37 and 39 Malurus Avenue Lockleys, SA
|
division of land to create 3 new allotments from the existing two.
|
2017-10-17
|
2017-10-13
|
||
|
7
|
361/D188/17
|
19 Uranbo Street Salisbury North, SA
|
Torrens Land Division. One Allotment into Two Allotments.
|
2017-10-17
|
2017-10-13
|
||
|
8
|
361/D189/17
|
7 Gilbert Street Ingle Farm, SA
|
Land Division
|
2017-10-17
|
2017-10-13
|
||
|
9
|
100/D241/17
|
9 Rosedale Avenue Morphettville, SA
|
Division of land to create two new Torrens title allotments
|
2017-10-17
|
2017-10-12
|
||
|
10
|
100/D242/17
|
19 Lawson Avenue Morphettville, SA
|
Division of land to create two new Torrens title allotments
|
2017-10-17
|
2017-10-12
|
Statistics
Average successful run time: 3 minutes
Total run time: 2 days
Total cpu time used: 39 minutes
Total disk space used: 15.4 MB
History
-
Auto
ran
revision
67f31762
and
completed successfully
.
1650 records added, 1529 records removed, 1 record updated in the database
-
Auto
ran
revision
67f31762
and
completed successfully
.
1596 records added, 1572 records removed, 1 record updated in the database
-
Auto
ran
revision
67f31762
and
completed successfully
.
1637 records added, 1607 records removed, 1 record updated in the database
-
Auto
ran
revision
67f31762
and
completed successfully
.
1567 records added, 1441 records removed, 1 record updated in the database
-
Auto
ran
revision
67f31762
and
completed successfully
.
1493 records added, 1434 records removed, 1 record updated in the database
- ...
- Created on morph.io