reitermarkus / heizoelpreise-oesterreich

Scrapes www.fastenergy.at and www.dudley.gov.uk

Heizöl zum richtigen Zeitpunkt günstig online kaufen und sparen. Mit dem Heizölpreis-Rechner die aktuellen Heizölpreise vergleichen.


This is a scraper that runs on Morph which parses fuel oil prices from FastEnergy.

Contributors reitermarkus

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 3 is python-3.6.2 (you are using python-3.5.1, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-3.6.2).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-3.5.1 -----> Installing pip -----> Installing requirements with pip  Collecting lxml (from -r /tmp/build/requirements.txt (line 1))  Downloading lxml-4.1.1-cp35-cp35m-manylinux1_x86_64.whl (5.5MB)  Collecting cssselect (from -r /tmp/build/requirements.txt (line 2))  Downloading cssselect-1.0.3-py2.py3-none-any.whl  Collecting scraperwiki (from -r /tmp/build/requirements.txt (line 3))  Downloading scraperwiki-0.5.1.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting six (from scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading six-1.11.0-py2.py3-none-any.whl  Collecting sqlalchemy (from scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading SQLAlchemy-1.2.1.tar.gz (5.5MB)  Collecting alembic (from scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading alembic-0.9.7.tar.gz (1.0MB)  Collecting idna<2.7,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading idna-2.6-py2.py3-none-any.whl (56kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting urllib3<1.23,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB)  Collecting Mako (from alembic->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading Mako-1.0.7.tar.gz (564kB)  Collecting python-editor>=0.3 (from alembic->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading python-editor-1.0.3.tar.gz  Collecting python-dateutil (from alembic->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading python_dateutil-2.6.1-py2.py3-none-any.whl (194kB)  Collecting MarkupSafe>=0.9.2 (from Mako->alembic->scraperwiki->-r /tmp/build/requirements.txt (line 3))  Downloading MarkupSafe-1.0.tar.gz  Installing collected packages: lxml, cssselect, idna, chardet, urllib3, certifi, requests, six, sqlalchemy, MarkupSafe, Mako, python-editor, python-dateutil, alembic, scraperwiki  Running setup.py install for sqlalchemy: started  Running setup.py install for sqlalchemy: finished with status 'done'  Running setup.py install for MarkupSafe: started  Running setup.py install for MarkupSafe: finished with status 'done'  Running setup.py install for Mako: started  Running setup.py install for Mako: finished with status 'done'  Running setup.py install for python-editor: started  Running setup.py install for python-editor: finished with status 'done'  Running setup.py install for alembic: started  Running setup.py install for alembic: finished with status 'done'  Running setup.py install for scraperwiki: started  Running setup.py install for scraperwiki: finished with status 'done'  Successfully installed Mako-1.0.7 MarkupSafe-1.0 alembic-0.9.7 certifi-2018.1.18 chardet-3.0.4 cssselect-1.0.3 idna-2.6 lxml-4.1.1 python-dateutil-2.6.1 python-editor-1.0.3 requests-2.18.4 scraperwiki-0.5.1 six-1.11.0 sqlalchemy-1.2.1 urllib3-1.22   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Traceback (most recent call last): File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 1240, in do_open h.request(req.get_method(), req.selector, req.data, headers) File "/app/.heroku/python/lib/python3.5/http/client.py", line 1083, in request self._send_request(method, url, body, headers) File "/app/.heroku/python/lib/python3.5/http/client.py", line 1128, in _send_request self.endheaders(body) File "/app/.heroku/python/lib/python3.5/http/client.py", line 1079, in endheaders self._send_output(message_body) File "/app/.heroku/python/lib/python3.5/http/client.py", line 911, in _send_output self.send(msg) File "/app/.heroku/python/lib/python3.5/http/client.py", line 854, in send self.connect() File "/app/.heroku/python/lib/python3.5/http/client.py", line 1237, in connect server_hostname=server_hostname) File "/app/.heroku/python/lib/python3.5/ssl.py", line 376, in wrap_socket _context=self) File "/app/.heroku/python/lib/python3.5/ssl.py", line 747, in __init__ self.do_handshake() File "/app/.heroku/python/lib/python3.5/ssl.py", line 983, in do_handshake self._sslobj.do_handshake() File "/app/.heroku/python/lib/python3.5/ssl.py", line 628, in do_handshake self._sslobj.do_handshake() ssl.SSLError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:645) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "scraper.py", line 23, in <module> html = scraperwiki.scrape("http://www.fastenergy.at/heizoelpreis-tendenz.htm") File "/app/.heroku/python/lib/python3.5/site-packages/scraperwiki/utils.py", line 34, in scrape f = six.moves.urllib.request.urlopen(req) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 162, in urlopen return opener.open(url, data, timeout) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 471, in open response = meth(req, response) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 581, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 503, in error result = self._call_chain(*args) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 443, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 686, in http_error_302 return self.parent.open(new, timeout=req.timeout) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 465, in open response = self._open(req, data) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 483, in _open '_open', req) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 443, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 1283, in https_open context=self._context, check_hostname=self._check_hostname) File "/app/.heroku/python/lib/python3.5/urllib/request.py", line 1242, in do_open raise URLError(err) urllib.error.URLError: <urlopen error [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:645)>

Data

Downloaded 8346 times by reitermarkus MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3 KB) Use the API

rows 9 / 9

name id price_difference price_yesterday price_today
Burgenland
burgenland
0.0
0.6881
0.6881
Kärnten
kaernten
0.0
0.7071
0.7071
Niederösterreich
niederoesterreich
0.0
0.7041
0.7041
Oberösterreich
oberoesterreich
0.0
0.6997
0.6997
Salzburg
salzburg
0.0
0.7212
0.7212
Steiermark
steiermark
0.0
0.6984
0.6984
Tirol
tirol
0.0
0.7447
0.7447
Vorarlberg
vorarlberg
0.0
0.738
0.738
Wien
wien
0.0
0.6881
0.6881

Statistics

Average successful run time: 1 minute

Total run time: about 1 month

Total cpu time used: 8 minutes

Total disk space used: 30.3 KB

History

  • Auto ran revision 73f16d6d and failed .
    nothing changed in the database
    95 pages scraped
  • Auto ran revision 73f16d6d and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 73f16d6d and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 73f16d6d and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 73f16d6d and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

heizoelpreise-oesterreich / scraper.py