ar73m / weather

Ukrainian Hydrometeorological Center - http://meteo.gov.ua/


This is a scraper that runs on Morph. To get started see the documentation

Contributors ar73m

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.9, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.9 -----> Installing pip -----> Installing requirements with pip  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 8))  Downloading https://files.pythonhosted.org/packages/63/c7/4f2a2a4ad6c6fa99b14be6b3c1cece9142e2d915aa7c43c908677afc8fa4/lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 9))  Downloading https://files.pythonhosted.org/packages/aa/e5/9ee1460d485b94a6d55732eb7ad5b6c084caf73dd6f9cb0bb7d2a78fafe8/cssselect-0.9.1.tar.gz  Collecting grab==0.6.21 (from -r /tmp/build/requirements.txt (line 10))  Downloading https://files.pythonhosted.org/packages/0c/5a/f848d597aa1167190f4b1f93cba0673525ccc0bc81f8611402c9805f9df2/grab-0.6.21.tar.gz (89kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/15/27/3330a343de80d6849545b6c7723f8c9a08b4b104de964ac366e7e6b318df/dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/49/df/50aa1999ab9bde74656c2919d9c0c085fd2b3775fd3eca826012bef76d8c/requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting pycurl (from grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading https://files.pythonhosted.org/packages/77/d9/d272b38e6e25d2686e22f6058820298dadead69340b1c57ff84c87ef81f0/pycurl-7.43.0.1.tar.gz (195kB)  Collecting selection (from grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading https://files.pythonhosted.org/packages/89/03/efb907762bf9a9b71674f30da34dca16e6dcf0f6384de2459f57bf9953d7/selection-0.0.13.tar.gz  Collecting weblib>=0.1.10 (from grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading https://files.pythonhosted.org/packages/b6/8e/f30e554fac3c4d44aa348053246067a1acbf8dc26923f6304819f39be474/weblib-0.1.29.tar.gz  Collecting six (from grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading https://files.pythonhosted.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl  Collecting idna<2.7,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/27/cc/6dd9a3869f15c2edfab863b992838277279ce92663d334df9ecf5106f5c6/idna-2.6-py2.py3-none-any.whl (56kB)  Collecting urllib3<1.23,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/63/cb/6965947c13a94236f6d4b8223e21beb4d576dc72e8130bd7880f600839b8/urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/7c/e6/92ad559b7192d846975fc916b65f667c7b8c3a32bea7372340bfe9a15fa5/certifi-2018.4.16-py2.py3-none-any.whl (150kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting pytils (from weblib>=0.1.10->grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading https://files.pythonhosted.org/packages/c6/c1/12b556b5bb393ce5130d57af862d045f57fee764797c0fe837e49cb2a5da/pytils-0.3.tar.gz (89kB)  Collecting user_agent (from weblib>=0.1.10->grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading https://files.pythonhosted.org/packages/c3/ca/15546284f62edfec7666ecb6403a6e77f5db850def37cd36f140d99cce02/user_agent-0.1.9.tar.gz  Installing collected packages: dumptruck, idna, urllib3, certifi, chardet, requests, scraperwiki, lxml, cssselect, pycurl, pytils, six, user-agent, weblib, selection, grab  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Running setup.py install for pycurl: started  Running setup.py install for pycurl: finished with status 'done'  Running setup.py install for pytils: started  Running setup.py install for pytils: finished with status 'done'  Running setup.py install for user-agent: started  Running setup.py install for user-agent: finished with status 'done'  Running setup.py install for weblib: started  Running setup.py install for weblib: finished with status 'done'  Running setup.py install for selection: started  Running setup.py install for selection: finished with status 'done'  Running setup.py install for grab: started  Running setup.py install for grab: finished with status 'done'  Successfully installed certifi-2018.4.16 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 grab-0.6.21 idna-2.6 lxml-3.4.4 pycurl-7.43.0.1 pytils-0.3 requests-2.18.4 scraperwiki selection-0.0.13 six-1.11.0 urllib3-1.22 user-agent-0.1.9 weblib-0.1.29   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Start 2018/05/25 05:06:12 Parse ������ Parse �᪠�?� ���� Parse �.��?���. Parse �.��ઢ� Parse �����?��� Parse ���⠭�� Parse ��������� Parse ��ॣ��� Parse ��०��� Parse ������� Parse �?�������� Error: list index out of range, URL: https://meteo.gov.ua/ua/33966 Parse �?�������� Error: 'NoneType' object has no attribute '__getitem__', URL: https://meteo.gov.ua/ua/33966 Parse �?���?��� Parse ���ਭ��� Parse �������?� Parse ����ࠤ Parse ������?�� Parse ���?��� Parse �த� Parse �.��१��� Parse �.������ Parse �.������쪨� Parse �.����ᠭ��. Parse ���.���?� Parse ������� Parse �?����� Parse �����ᥭ��� Parse ��������� Parse ����� Parse �����஭ Parse ���ᨭ Parse ���?����� Parse ����?� Parse �㡨���� Parse ����� ���� Error: list index out of range, URL: https://meteo.gov.ua/ua/34524 Parse ������楢� Error: 'NoneType' object has no attribute '__getitem__', URL: https://meteo.gov.ua/ua/34524 Parse ��?��� Parse ������ Parse ������쪠 Parse ������� Parse �ண���� Parse ��㦡� Parse �㡭� Parse ����?� Parse ��⮬�� Parse ���ਭ�� Parse �����?��� Parse ������� Parse �������த�� Parse �������� Parse ����⮭��� Parse �����?� Parse ?����-�࠭�?���� Parse ��୮������ Parse ?����� Parse ?��� Parse �.���?��᪨� Parse ���'ﭪ� Parse ���?� Parse ���� Parse ���� Parse ��ਫ?��� Parse �ய�����쪨� Parse �����直 Parse ������ Parse ������� Parse ������� Parse ���?���?��� Parse ���������쪥 Parse ����⮯ Parse �����⥭� Parse ���஢��� Parse ���᭮�ࠤ Parse �६����� Parse �ਢ�� �?� Parse ���'����� Parse ������� Parse ������ Parse �㡭� Parse �㣠���� Parse ����� Parse ��?��� Parse ��?� Parse ���?� Parse �������? Parse ���?㯮�� Parse ���?⮯��� Parse �������� Parse ��஭?��� Parse �?��?�'� Parse ���.-���?��� Parse �����᪠ Parse �.������쪨� Parse �.������ Parse �.��客�� Parse �.�?ண��� Parse �.��㤥��� Parse �.����� Parse �?��� Parse �?������ Parse ������?��஢��� Parse ������࣮த Parse �����᪮� Error: list index out of range, URL: https://meteo.gov.ua/ua/33899 Parse �.��i���� Error: 'NoneType' object has no attribute '__getitem__', URL: https://meteo.gov.ua/ua/33899 Parse ����� Parse ����� Parse ������� Parse ����� Parse �砪?� Parse ������ࠤ Parse ��ࢮ����� Parse ���� Parse ��������쪠 Parse �������� Parse ���⠢� Parse ����譠 Parse �ਫ㪨 Parse ���訡 Parse ����-���쪠 Parse ���?� Parse �?��� Parse ����?�쭠 Parse ����� Parse ������ Parse ��୨ Parse ���⮢� Parse ������� Parse ��?⫮������ Parse ����⨭ Parse �����?��� Parse ��ࡪ� Parse �����쭨���� Parse �?���ய��� Parse �����쪥 Parse ��?�� Parse ��਩ Parse ���?����� Parse �㬨 Parse ��୮�?�� Parse �����?� Parse �����쪥 Parse ��ઠ Parse ����த Parse ����� Parse ����?� Parse ����?� Parse ���ᮭ Parse ��i�쭨� Parse ����쭨�쪨� Parse ��૨ Parse ���� Parse ������� Parse ��ઠ�� Parse ����?��? Parse ����?�?� Parse ����ਭ Parse ��୮���� Parse ��୮����쪥 Parse �����?� Parse �����?��� Parse ���� Parse ����?� Parse ���⨭ Parse ���?�� Parse �६�� End 2018/05/25 05:07:21

Data

Downloaded 8 times by ar73m MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (40 KB) Use the API

rows 10 / 165

url datetime hu pres update_date id wind temp sun city
28 вересня 12:00
56 %
739 мм. рт. ст.
2017/09/28 06:14:36
33966
7 м/с
14.7 °C
6:35 - 11:54 - 18:29
БІЛОГОРСЬК
28 вересня 21:00
96 %
744 мм. рт. ст.
2017/09/28 06:14:46
34524
4 м/с
-2.3 °C
6:20 - 11:53 - 18:13
ДЕБАЛЬЦЕВО
28 вересня 21:00
79 %
0 мм. рт. ст.
2017/09/28 06:15:22
33899
10 м/с
17.2 °C
- 00:00 -
О.ЗМIЇНИЙ
25 травня 06:00
87 %
748 мм. рт. ст.
2018/05/25 05:06:15
34510
2 м/с
16.7 °C
4:36 - 15:38 - 20:14
БАХМУТ
25 травня 06:00
78 %
757 мм. рт. ст.
2018/05/25 05:06:15
33915
3 м/с
15.6 °C
5:01 - 15:21 - 20:22
АСКАНІЯ НОВА
25 травня 06:00
80 %
760 мм. рт. ст.
2018/05/25 05:06:16
33830
4 м/с
20 °C
5:16 - 15:19 - 20:35
Б.ДНІСТР.
25 травня 06:00
82 %
748 мм. рт. ст.
2018/05/25 05:06:16
33464
1 м/с
16.7 °C
5:03 - 15:47 - 20:50
Б.ЦЕРКВА
25 травня 06:00
94 %
763 мм. рт. ст.
2018/05/25 05:06:16
33354
1 м/с
15.6 °C
4:56 - 15:52 - 20:48
БАРИШІВКА
25 травня 06:00
77 %
753 мм. рт. ст.
2018/05/25 05:06:17
33788
2 м/с
15.3 °C
5:03 - 15:28 - 20:31
БАШТАНКА
25 травня 06:00
73 %
759 мм. рт. ст.
2018/05/25 05:06:17
34717
4 м/с
18.1 °C
4:48 - 15:24 - 20:12
БЕРДЯНСЬК

Statistics

Average successful run time: 4 minutes

Total run time: 1 day

Total cpu time used: 15 minutes

Total disk space used: 65.5 KB

History

  • Auto ran revision a12f250a and completed successfully .
    162 records added, 162 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    162 records added, 162 records removed in the database
    167 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    162 records added, 162 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    162 records added, 162 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    162 records added, 162 records removed in the database
    167 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

weather / scraper.py