N-2-O / launceston

Scrapes all public notices of the City of Launceston:


This is a scraper that runs on Morph. To get started see the documentation

Contributors N-2-O

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Traceback (most recent call last): File "/app/.heroku/python/lib/python3.6/urllib/request.py", line 1318, in do_open encode_chunked=req.has_header('Transfer-encoding')) File "/app/.heroku/python/lib/python3.6/http/client.py", line 1239, in request self._send_request(method, url, body, headers, encode_chunked) File "/app/.heroku/python/lib/python3.6/http/client.py", line 1285, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/app/.heroku/python/lib/python3.6/http/client.py", line 1234, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/app/.heroku/python/lib/python3.6/http/client.py", line 1026, in _send_output self.send(msg) File "/app/.heroku/python/lib/python3.6/http/client.py", line 964, in send self.connect() File "/app/.heroku/python/lib/python3.6/http/client.py", line 1392, in connect super().connect() File "/app/.heroku/python/lib/python3.6/http/client.py", line 936, in connect (self.host,self.port), self.timeout, self.source_address) File "/app/.heroku/python/lib/python3.6/socket.py", line 722, in create_connection raise err File "/app/.heroku/python/lib/python3.6/socket.py", line 713, in create_connection sock.connect(sa) TimeoutError: [Errno 110] Connection timed out During handling of the above exception, another exception occurred: Traceback (most recent call last): File "scraper.py", line 101, in <module> main() File "scraper.py", line 95, in main visit_page(conn) File "scraper.py", line 20, in visit_page page = scraperwiki.scrape(public_notices_url, "", userAgent) File "/app/.heroku/python/lib/python3.6/site-packages/scraperwiki/utils.py", line 34, in scrape f = six.moves.urllib.request.urlopen(req) File "/app/.heroku/python/lib/python3.6/urllib/request.py", line 223, in urlopen return opener.open(url, data, timeout) File "/app/.heroku/python/lib/python3.6/urllib/request.py", line 526, in open response = self._open(req, data) File "/app/.heroku/python/lib/python3.6/urllib/request.py", line 544, in _open '_open', req) File "/app/.heroku/python/lib/python3.6/urllib/request.py", line 504, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python3.6/urllib/request.py", line 1361, in https_open context=self._context, check_hostname=self._check_hostname) File "/app/.heroku/python/lib/python3.6/urllib/request.py", line 1320, in do_open raise URLError(err) urllib.error.URLError: <urlopen error [Errno 110] Connection timed out>

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (12 KB) Use the API

rows 0 / 0

Statistics

Total run time: 4 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 28.9 KB

History

  • Manually ran revision 526cce10 and failed .
    nothing changed in the database
  • Manually ran revision 71c294eb and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

launceston / scraper.py