otherchirps / port_stephens
Port Stephens Development Applications
Scrapes datracker.portstephens.nsw.gov.au, www.google-analytics.com, maps.googleapis.com, and 1 other domain
The official Port Stephens Council Development Application Tracker (DA Tracker)
Contributors
Last run completed successfully
.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Python app detected
[1G-----> Installing python-2.7.6
[1G $ pip install -r requirements.txt
[1G Collecting beautifulsoup4==4.3.2 (from -r requirements.txt (line 1))
[1G /app/.heroku/python/lib/python2.7/site-packages/pip-8.1.2-py2.7.egg/pip/_vendor/requests/packages/urllib3/util/ssl_.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#snimissingwarning.
[1G SNIMissingWarning
[1G /app/.heroku/python/lib/python2.7/site-packages/pip-8.1.2-py2.7.egg/pip/_vendor/requests/packages/urllib3/util/ssl_.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.
[1G InsecurePlatformWarning
[1G Downloading beautifulsoup4-4.3.2.tar.gz (143kB)
[1G Collecting python-dateutil==2.4.2 (from -r requirements.txt (line 2))
[1G Downloading python_dateutil-2.4.2-py2.py3-none-any.whl (188kB)
[1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 4))
[1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki
[1G Collecting selenium==2.46.0 (from -r requirements.txt (line 5))
[1G Downloading selenium-2.46.0.tar.gz (2.6MB)
[1G Collecting six>=1.5 (from python-dateutil==2.4.2->-r requirements.txt (line 2))
[1G Downloading six-1.10.0-py2.py3-none-any.whl
[1G Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 4))
[1G Downloading dumptruck-0.1.6.tar.gz
[1G Collecting requests (from scraperwiki->-r requirements.txt (line 4))
[1G Downloading requests-2.12.4-py2.py3-none-any.whl (576kB)
[1G Installing collected packages: beautifulsoup4, six, python-dateutil, dumptruck, requests, scraperwiki, selenium
[1G Running setup.py install for beautifulsoup4: started
[1G Running setup.py install for beautifulsoup4: finished with status 'done'
[1G Running setup.py install for dumptruck: started
[1G Running setup.py install for dumptruck: finished with status 'done'
[1G Running setup.py develop for scraperwiki
[1G Running setup.py install for selenium: started
[1G Running setup.py install for selenium: finished with status 'done'
[1G Successfully installed beautifulsoup4-4.3.2 dumptruck-0.1.6 python-dateutil-2.4.2 requests-2.12.4 scraperwiki selenium-2.46.0 six-1.10.0
[1G
[1G ! Hello! It looks like your application is using an outdated version of Python.
[1G ! This caused the security warning you saw above during the 'pip install' step.
[1G ! We recommend 'python-2.7.12', which you can specify in a 'runtime.txt' file.
[1G ! -- Much Love, Heroku.
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Saving: 016-2017-00000012-001
Saving: 016-2015-00000536-003
Saving: 016-2017-00000011-001
Saving: 009-2017-00000004-001
Saving: 009-2017-00000003-001
Saving: 016-2016-00000746-002
Saving: 016-2017-00000010-001
Saving: 016-2017-00000006-001
Saving: 016-2017-00000009-001
Saving: 016-2017-00000007-001
Saving: 016-2017-00000005-001
Skipping: 016-2017-00000004-001
Skipping: 016-2017-00000001-001
Skipping: 016-2017-00000002-001
Skipping: 016-2017-00000003-001
Skipping: 009-2017-00000001-001
Skipping: 009-2017-00000002-001
Data
Downloaded
1 time
by
To download data sign in with GitHub
rows 10 / 171
| council_reference | address | description | info_url | comment_url | date_scraped | date_received |
|---|---|---|---|---|---|---|
| council_reference
016-2015-00000370-001
|
address
9 Scott St, Wallalong 2320 NSW
|
description
Dwelling House
|
info_url | comment_url | date_scraped
2015-06-19
|
date_received
2015-06-19
|
| council_reference
016-2015-00000374-001
|
address
3 Semillon Cl, Hinton 2321 NSW
|
description
Storage Shed
|
info_url | comment_url | date_scraped
2015-06-19
|
date_received
2015-06-19
|
| council_reference
016-2015-00000373-001
|
address
19 Tomaree Rd, Shoal Bay 2315 NSW
|
description
Single Storey Dwelling & Secondary Dwelling ( Granny Flat)
|
info_url | comment_url | date_scraped
2015-06-19
|
date_received
2015-06-19
|
| council_reference
016-2015-00000372-001
|
address
12 Heather St, Heatherbrae 2324 NSW
|
description
Commercial Development - Showroom & Caretakers Cottage & Shed
|
info_url | comment_url | date_scraped
2015-06-19
|
date_received
2015-06-19
|
| council_reference
016-2015-00000371-001
|
address
48 Argyle Ave, Anna Bay 2316 NSW
|
description
Storage & Tool Shed
|
info_url | comment_url | date_scraped
2015-06-19
|
date_received
2015-06-19
|
| council_reference
016-2015-00000369-001
|
address
7 Cecilia Cl, Salt Ash 2318 NSW
|
description
Demolish Dwelling & Garage
|
info_url | comment_url | date_scraped
2015-06-19
|
date_received
2015-06-19
|
| council_reference
016-2015-00000367-001
|
address
1057 Lemon Tree Passage Rd, Tanilba Bay 2319 NSW
|
description
Commercial Premises - Demolish Existing
|
info_url | comment_url | date_scraped
2015-06-19
|
date_received
2015-06-19
|
| council_reference
016-2015-00000368-001
|
address
47 Osprey Cct, Medowie 2318 NSW
|
description
Dwelling House
|
info_url | comment_url | date_scraped
2015-06-19
|
date_received
2015-06-19
|
| council_reference
016-2004-00000709-002
|
address
137 Sandy Point Rd, Corlette 2315 NSW
|
description
Section 96(1) to Approved Three (3) Lot Torrens Title Subdivision - Amend Condition 3
|
info_url | comment_url | date_scraped
2015-06-19
|
date_received
2015-06-19
|
| council_reference
016-2009-00000709-002
|
address
8 Hank St, Heatherbrae 2324 NSW
|
description
S.96 Amendment - amendement to condition
|
info_url | comment_url | date_scraped
2015-06-19
|
date_received
2015-06-19
|
Statistics
Average successful run time: 13 minutes
Total run time: about 2 hours
Total cpu time used: half a minute
Total disk space used: 116 KB
History
-
Manually
ran
revision
afc61167
and
completed successfully
.
11 records added in the database52 pages scraped
-
Manually
ran
revision
afc61167
and
failed
.
nothing changed in the database
-
Manually
ran
revision
afc61167
and
completed successfully
.
6 records added in the database52 pages scraped
-
Manually
ran
revision
afc61167
and
completed successfully
.
68 records added in the database39 pages scraped
-
Manually
ran
revision
afc61167
and
completed successfully
.
59 records added in the database39 pages scraped
- ...
- Created on morph.io