This is a scraper that runs on Morph. To get started see the documentation

It scrapes all public notices of the City of Launceston: https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/AllPublicNotices.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOTAL.ENQ

Contributors mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.6.2 -----> Installing pip -----> Installing requirements with pip  Collecting beautifulsoup4==4.9.3  Downloading beautifulsoup4-4.9.3-py3-none-any.whl (115 kB)  Collecting scraperwiki==0.5.1  Downloading scraperwiki-0.5.1.tar.gz (7.7 kB)  Collecting soupsieve>1.2  Downloading soupsieve-2.2.1-py3-none-any.whl (33 kB)  Collecting requests  Downloading requests-2.26.0-py2.py3-none-any.whl (62 kB)  Collecting six  Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)  Collecting sqlalchemy  Downloading SQLAlchemy-1.4.22-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)  Collecting alembic  Downloading alembic-1.6.5-py2.py3-none-any.whl (164 kB)  Collecting python-editor>=0.3  Downloading python_editor-1.0.4-py3-none-any.whl (4.9 kB)  Collecting python-dateutil  Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)  Collecting Mako  Downloading Mako-1.1.4-py2.py3-none-any.whl (75 kB)  Collecting greenlet!=0.4.17  Downloading greenlet-1.1.0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (155 kB)  Collecting importlib-metadata  Downloading importlib_metadata-4.6.3-py3-none-any.whl (17 kB)  Collecting zipp>=0.5  Downloading zipp-3.5.0-py3-none-any.whl (5.7 kB)  Collecting typing-extensions>=3.6.4  Downloading typing_extensions-3.10.0.0-py3-none-any.whl (26 kB)  Collecting MarkupSafe>=0.9.2  Downloading MarkupSafe-2.0.1-cp36-cp36m-manylinux2010_x86_64.whl (30 kB)  Collecting certifi>=2017.4.17  Downloading certifi-2021.5.30-py2.py3-none-any.whl (145 kB)  Collecting charset-normalizer~=2.0.0  Downloading charset_normalizer-2.0.4-py3-none-any.whl (36 kB)  Collecting idna<4,>=2.5  Downloading idna-3.2-py3-none-any.whl (59 kB)  Collecting urllib3<1.27,>=1.21.1  Downloading urllib3-1.26.6-py2.py3-none-any.whl (138 kB)  Building wheels for collected packages: scraperwiki  Building wheel for scraperwiki (setup.py): started  Building wheel for scraperwiki (setup.py): finished with status 'done'  Created wheel for scraperwiki: filename=scraperwiki-0.5.1-py3-none-any.whl size=6543 sha256=36d6dc3835b43daeb78d9a014a4867972c7366a19472ab9c66859b04126e84c3  Stored in directory: /tmp/pip-ephem-wheel-cache-4jznyh71/wheels/cd/f8/ac/cd66eb1c557ab40d35c1ed852da3e9b37baa3e21b61906a5cf  Successfully built scraperwiki  Installing collected packages: zipp, typing-extensions, six, MarkupSafe, importlib-metadata, greenlet, urllib3, sqlalchemy, python-editor, python-dateutil, Mako, idna, charset-normalizer, certifi, soupsieve, requests, alembic, scraperwiki, beautifulsoup4  Successfully installed Mako-1.1.4 MarkupSafe-2.0.1 alembic-1.6.5 beautifulsoup4-4.9.3 certifi-2021.5.30 charset-normalizer-2.0.4 greenlet-1.1.0 idna-3.2 importlib-metadata-4.6.3 python-dateutil-2.8.2 python-editor-1.0.4 requests-2.26.0 scraperwiki-0.5.1 six-1.16.0 soupsieve-2.2.1 sqlalchemy-1.4.22 typing-extensions-3.10.0.0 urllib3-1.26.6 zipp-3.5.0   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... INFO:root:Found 24 public notices /app/.heroku/python/lib/python3.6/site-packages/scraperwiki/sql.py:75: SAWarning: SQLite version (3, 7, 9) is older than 3.7.16, and will not support right nested joins, as are sometimes used in more complex ORM scenarios. SQLAlchemy 1.4 and above no longer tries to rewrite these joins. connect_args={'timeout': DATABASE_TIMEOUT})

Data

Downloaded 4217 times by openaustralia LoveMyData dcalde jesse-a-reilly TheZepto MikeRalphson Jedwards157 andrewrit

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.8 MB) Use the API

rows 10 / 3519

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to legal_description
DA0003/2014
7 Penquite Road NEWSTEAD TAS 7250
Business and professional services - medical centre; change of use and construction of a shed
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0003/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-01-02
2014-04-05
2014-04-23
DA0012/2014
25 West Park Drive WEST LAUNCESTON TAS 7250
Residential - subdivision - subdivide and consolidate land
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0012/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-01-10
2014-04-05
2014-04-23
DA0020/2014
152 Bathurst Street LAUNCESTON TAS 7250
Residential - multiple dwellings; removal of a tree
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0020/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-01-16
2014-04-02
2014-04-15
DA0054/2014
80 Peel Street West WEST LAUNCESTON TAS 7250
Residential - single dwelling; construction of a new dwelling and tree removal
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0054/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-02-18
2014-04-05
2014-04-23
DA0055/2014
2 McHugh Street KINGS MEADOWS TAS 7249
Residential - Subdivision - boundary adjustment; construction and use of multiple dwellings
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0055/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-02-19
2014-03-29
2014-04-11
DA0085/2014
31 Erina Street EAST LAUNCESTON TAS 7250
Residential - single dwelling; extension to existing garage and retaining wall
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0085/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-03-14
2014-03-29
2014-04-11
DA0086/2014
280 George Town Road ROCHERLEA TAS 7248
Recycling and waste disposal - recycling depot; covered wash bay
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0086/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-03-14
2014-03-29
2014-04-11
DA0091/2014
7 Everest Place NEWSTEAD TAS 7250
Residential - single dwelling; replace garage and redevelop rear of dwelling
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0091/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-03-17
2014-03-29
2014-04-11
DA0092/2014
7 Cardigan Street EAST LAUNCESTON TAS 7250
Residential -subdivision; subdivide land into two lots
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0092/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-03-17
2014-04-05
2014-04-23
DA0094/2014
41 Roberts Crescent NEWNHAM TAS 7248
Residential - single dwelling; construction of a building
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0094/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-03-18
2014-04-09
2014-04-28

Statistics

Average successful run time: half a minute

Total run time: 18 days

Total cpu time used: about 1 hour

Total disk space used: 1.85 MB

History

  • Auto ran revision fdc61b0f and completed successfully .
    nothing changed in the database
  • Auto ran revision fdc61b0f and completed successfully .
    nothing changed in the database
  • Auto ran revision fdc61b0f and completed successfully .
    5 records added in the database
  • Auto ran revision fdc61b0f and completed successfully .
    nothing changed in the database
  • Auto ran revision fdc61b0f and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

launceston / scraper.py