This is a scraper that runs on Morph. To get started see the documentation

It scrapes all public notices of the City of Launceston: https://onlineservice.launceston.tas.gov.au/eProperty/P1/PublicNotices/AllPublicNotices.aspx?r=P1.LCC.WEBGUEST&f=%24P1.ESB.PUBNOTAL.ENQ

Contributors mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.6.2 -----> Installing pip -----> Installing requirements with pip  Collecting beautifulsoup4==4.9.3  Downloading beautifulsoup4-4.9.3-py3-none-any.whl (115 kB)  Collecting scraperwiki==0.5.1  Downloading scraperwiki-0.5.1.tar.gz (7.7 kB)  Preparing metadata (setup.py): started  Preparing metadata (setup.py): finished with status 'done'  Collecting soupsieve>1.2  Downloading soupsieve-2.2.1-py3-none-any.whl (33 kB)  Collecting requests  Downloading requests-2.26.0-py2.py3-none-any.whl (62 kB)  Collecting six  Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)  Collecting sqlalchemy  Downloading SQLAlchemy-1.4.25-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)  Collecting alembic  Downloading alembic-1.7.4-py3-none-any.whl (209 kB)  Collecting importlib-resources  Downloading importlib_resources-5.2.2-py3-none-any.whl (27 kB)  Collecting importlib-metadata  Downloading importlib_metadata-4.8.1-py3-none-any.whl (17 kB)  Collecting Mako  Downloading Mako-1.1.5-py2.py3-none-any.whl (75 kB)  Collecting greenlet!=0.4.17  Downloading greenlet-1.1.2-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB)  Collecting charset-normalizer~=2.0.0  Downloading charset_normalizer-2.0.7-py3-none-any.whl (38 kB)  Collecting certifi>=2017.4.17  Downloading certifi-2021.10.8-py2.py3-none-any.whl (149 kB)  Collecting urllib3<1.27,>=1.21.1  Downloading urllib3-1.26.7-py2.py3-none-any.whl (138 kB)  Collecting idna<4,>=2.5  Downloading idna-3.3-py3-none-any.whl (61 kB)  Collecting typing-extensions>=3.6.4  Downloading typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)  Collecting zipp>=0.5  Downloading zipp-3.6.0-py3-none-any.whl (5.3 kB)  Collecting MarkupSafe>=0.9.2  Downloading MarkupSafe-2.0.1-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (30 kB)  Building wheels for collected packages: scraperwiki  Building wheel for scraperwiki (setup.py): started  Building wheel for scraperwiki (setup.py): finished with status 'done'  Created wheel for scraperwiki: filename=scraperwiki-0.5.1-py3-none-any.whl size=6545 sha256=1e64276cb7cd46f00dd55be64dc30d01d0b5cddd19af64082e38313fefbba7ee  Stored in directory: /tmp/pip-ephem-wheel-cache-qal1rtmq/wheels/cd/f8/ac/cd66eb1c557ab40d35c1ed852da3e9b37baa3e21b61906a5cf  Successfully built scraperwiki  Installing collected packages: zipp, typing-extensions, MarkupSafe, importlib-metadata, greenlet, urllib3, sqlalchemy, Mako, importlib-resources, idna, charset-normalizer, certifi, soupsieve, six, requests, alembic, scraperwiki, beautifulsoup4  Successfully installed Mako-1.1.5 MarkupSafe-2.0.1 alembic-1.7.4 beautifulsoup4-4.9.3 certifi-2021.10.8 charset-normalizer-2.0.7 greenlet-1.1.2 idna-3.3 importlib-metadata-4.8.1 importlib-resources-5.2.2 requests-2.26.0 scraperwiki-0.5.1 six-1.16.0 soupsieve-2.2.1 sqlalchemy-1.4.25 typing-extensions-3.10.0.2 urllib3-1.26.7 zipp-3.6.0   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... INFO:root:Found 22 public notices /app/.heroku/python/lib/python3.6/site-packages/scraperwiki/sql.py:75: SAWarning: SQLite version (3, 7, 9) is older than 3.7.16, and will not support right nested joins, as are sometimes used in more complex ORM scenarios. SQLAlchemy 1.4 and above no longer tries to rewrite these joins. connect_args={'timeout': DATABASE_TIMEOUT})

Data

Downloaded 4426 times by openaustralia LoveMyData dcalde jesse-a-reilly TheZepto Jedwards157 andrewrit MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.86 MB) Use the API

rows 10 / 3649

council_reference address description info_url comment_url date_scraped date_received on_notice_from on_notice_to legal_description
DA0003/2014
7 Penquite Road NEWSTEAD TAS 7250
Business and professional services - medical centre; change of use and construction of a shed
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0003/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-01-02
2014-04-05
2014-04-23
DA0012/2014
25 West Park Drive WEST LAUNCESTON TAS 7250
Residential - subdivision - subdivide and consolidate land
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0012/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-01-10
2014-04-05
2014-04-23
DA0020/2014
152 Bathurst Street LAUNCESTON TAS 7250
Residential - multiple dwellings; removal of a tree
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0020/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-01-16
2014-04-02
2014-04-15
DA0054/2014
80 Peel Street West WEST LAUNCESTON TAS 7250
Residential - single dwelling; construction of a new dwelling and tree removal
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0054/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-02-18
2014-04-05
2014-04-23
DA0055/2014
2 McHugh Street KINGS MEADOWS TAS 7249
Residential - Subdivision - boundary adjustment; construction and use of multiple dwellings
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0055/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-02-19
2014-03-29
2014-04-11
DA0085/2014
31 Erina Street EAST LAUNCESTON TAS 7250
Residential - single dwelling; extension to existing garage and retaining wall
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0085/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-03-14
2014-03-29
2014-04-11
DA0086/2014
280 George Town Road ROCHERLEA TAS 7248
Recycling and waste disposal - recycling depot; covered wash bay
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0086/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-03-14
2014-03-29
2014-04-11
DA0091/2014
7 Everest Place NEWSTEAD TAS 7250
Residential - single dwelling; replace garage and redevelop rear of dwelling
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0091/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-03-17
2014-03-29
2014-04-11
DA0092/2014
7 Cardigan Street EAST LAUNCESTON TAS 7250
Residential -subdivision; subdivide land into two lots
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0092/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-03-17
2014-04-05
2014-04-23
DA0094/2014
41 Roberts Crescent NEWNHAM TAS 7248
Residential - single dwelling; construction of a building
mailto:council@launceston.tas.gov.au?subject=Comment+re%3A+Planning+Application+DA0094/2014+%28from+www.planningalerts.org.au%29
2014-04-09
2014-03-18
2014-04-09
2014-04-28

Statistics

Average successful run time: half a minute

Total run time: 18 days

Total cpu time used: about 1 hour

Total disk space used: 1.91 MB

History

  • Auto ran revision fdc61b0f and completed successfully .
    nothing changed in the database
  • Auto ran revision fdc61b0f and completed successfully .
    nothing changed in the database
  • Auto ran revision fdc61b0f and completed successfully .
    2 records added in the database
  • Auto ran revision fdc61b0f and completed successfully .
    nothing changed in the database
  • Auto ran revision fdc61b0f and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

launceston / scraper.py