ar73m / weather

Ukrainian Hydrometeorological Center - http://meteo.gov.ua/


This is a scraper that runs on Morph. To get started see the documentation

Contributors ar73m

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.9  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to /app/.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting grab==0.6.21 (from -r /tmp/build/requirements.txt (line 10))  Downloading grab-0.6.21.tar.gz (89kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading requests-2.13.0-py2.py3-none-any.whl (584kB)  Collecting pycurl (from grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading pycurl-7.43.0.tar.gz (182kB)  Collecting selection (from grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading selection-0.0.13.tar.gz  Collecting weblib>=0.1.10 (from grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading weblib-0.1.24.tar.gz  Collecting six (from grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading six-1.10.0-py2.py3-none-any.whl  Collecting pytils (from weblib>=0.1.10->grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading pytils-0.3.tar.gz (89kB)  Collecting user_agent (from weblib>=0.1.10->grab==0.6.21->-r /tmp/build/requirements.txt (line 10))  Downloading user_agent-0.1.8.tar.gz  Installing collected packages: dumptruck, requests, scraperwiki, lxml, cssselect, pycurl, pytils, six, user-agent, weblib, selection, grab  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Running setup.py install for pycurl: started  Running setup.py install for pycurl: finished with status 'done'  Running setup.py install for pytils: started  Running setup.py install for pytils: finished with status 'done'  Running setup.py install for user-agent: started  Running setup.py install for user-agent: finished with status 'done'  Running setup.py install for weblib: started  Running setup.py install for weblib: finished with status 'done'  Running setup.py install for selection: started  Running setup.py install for selection: finished with status 'done'  Running setup.py install for grab: started  Running setup.py install for grab: finished with status 'done'  Successfully installed cssselect-0.9.1 dumptruck-0.1.6 grab-0.6.21 lxml-3.4.4 pycurl-7.43.0 pytils-0.3 requests-2.13.0 scraperwiki selection-0.0.13 six-1.10.0 user-agent-0.1.8 weblib-0.1.24   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Start 2017/03/22 20:22:12 Parse ������ Parse �᪠�?� ���� Parse �.��?���. Parse �.��ઢ� Parse �����?��� Parse ���⠭�� Parse ��������� Parse ��ॣ��� Parse ��०��� Parse ������� Parse �?�������� Error: [Errno 28] Operation timed out after 10000 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33966 Parse �?�������� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33966 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33446 Parse �?���?��� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33446 Error: [Errno 28] Operation timed out after 10004 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33717 Parse ���ਭ��� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33717 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/34302 Parse �������?� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/34302 Parse ����ࠤ Parse ������?�� Parse ���?��� Parse �த� Parse �.��१��� Parse �.������ Parse �.������쪨� Parse �.����ᠭ��. Parse ���.���?� Parse ������� Parse �?����� Parse �����ᥭ��� Parse ��������� Parse ����� Parse �����஭ Parse ���ᨭ Parse ���?����� Parse ����?� Parse �㡨���� Parse ����� ���� Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/34524 Parse ������楢� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/34524 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/34504 Parse ��?��� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/34504 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33524 Parse ������ Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33524 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33719 Parse ������쪠 Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33719 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/34519 Parse ������� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/34519 Error: [Errno 28] Operation timed out after 10002 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33398 Parse �ண���� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33398 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33058 Parse ��㦡� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33058 Error: [Errno 28] Operation timed out after 10000 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33296 Parse �㡭� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33296 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33581 Parse ����?� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33581 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33325 Parse ��⮬�� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33325 Error: [Errno 28] Operation timed out after 10003 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33564 Parse ���ਭ�� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33564 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/34601 Parse �����?��� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/34601 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33759 Parse ������� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33759 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33586 Parse �������த�� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33586 Error: [Errno 28] Operation timed out after 10002 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33609 Parse �������� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33609 Error: [Errno 28] Operation timed out after 10002 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33484 Parse ����⮭��� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33484 Parse �����?� Parse ?����-�࠭�?���� Parse ��୮������ Parse ?����� Parse ?��� Parse �.���?��᪨� Parse ���'ﭪ� Parse ���?� Parse ���� Parse ���� Parse ��ਫ?��� Parse �ய�����쪨� Parse �����直 Parse ������ Parse ������� Parse ������� Parse ���?���?��� Parse ���������쪥 Parse ����⮯ Parse �����⥭� Parse ���஢��� Parse ���᭮�ࠤ Parse �६����� Parse �ਢ�� �?� Parse ���'����� Parse ������� Parse ������ Parse �㡭� Parse �㣠���� Parse ����� Parse ��?��� Parse ��?� Parse ���?� Parse �������? Parse ���?㯮�� Parse ���?⮯��� Parse �������� Parse ��஭?��� Parse �?��?�'� Parse ���.-���?��� Parse �����᪠ Parse �.������쪨� Parse �.������ Parse �.��客�� Parse �.�?ண��� Parse �.��㤥��� Parse �.����� Parse �?��� Parse �?������ Parse ������?��஢��� Parse ������࣮த Parse �����᪮� Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33899 Parse �.��i���� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33899 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33213 Parse ����� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33213 Error: [Errno 28] Operation timed out after 10003 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33837 Parse ����� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33837 Parse ������� Parse ����� Parse �砪?� Parse ������ࠤ Parse ��ࢮ����� Parse ���� Parse ��������쪠 Parse �������� Parse ���⠢� Parse ����譠 Parse �ਫ㪨 Parse ���訡 Parse ����-���쪠 Parse ���?� Parse �?��� Parse ����?�쭠 Parse ����� Parse ������ Parse ��୨ Parse ���⮢� Parse ������� Parse ��?⫮������ Parse ����⨭ Parse �����?��� Parse ��ࡪ� Parse �����쭨���� Parse �?���ய��� Parse �����쪥 Parse ��?�� Parse ��਩ Parse ���?����� Parse �㬨 Parse ��୮�?�� Parse �����?� Parse �����쪥 Parse ��ઠ Parse ����த Parse ����� Parse ����?� Parse ����?� Parse ���ᮭ Parse ��i�쭨� Parse ����쭨�쪨� Parse ��૨ Parse ���� Parse ������� Parse ��ઠ�� Parse ����?��? Parse ����?�?� Parse ����ਭ Parse ��୮���� Parse ��୮����쪥 Parse �����?� Parse �����?��� Parse ���� Parse ����?� Parse ���⨭ Parse ���?�� Parse �६�� End 2017/03/22 20:27:33

Data

Downloaded 8 times by ar73m MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (37 KB) Use the API

rows 10 / 165

url datetime hu pres update_date id wind temp sun city
21 березня 11:00
56 %
739 мм. рт. ст.
2017/03/21 11:34:54
33966
7 м/с
14.7 °C
5:44 - 12:11 - 17:55
БІЛОГОРСЬК
21 березня 11:00
88 %
739 мм. рт. ст.
2017/03/21 11:34:55
33446
2 м/с
5.8 °C
6:06 - 12:12 - 18:18
БІЛОПІЛЛЯ
21 березня 11:00
55 %
748 мм. рт. ст.
2017/03/21 11:34:55
33717
2 м/с
8.6 °C
5:53 - 12:12 - 18:05
БОБРИНЕЦЬ
21 березня 11:00
57 %
742 мм. рт. ст.
2017/03/21 11:34:56
34302
5 м/с
6.6 °C
5:40 - 12:12 - 17:52
БОГОДУХІВ
21 березня 20:00
96 %
744 мм. рт. ст.
2017/03/21 11:35:02
34524
4 м/с
-2.3 °C
5:28 - 12:12 - 17:40
ДЕБАЛЬЦЕВО
21 березня 11:00
55 %
748 мм. рт. ст.
2017/03/21 11:35:03
34504
4 м/с
8.8 °C
5:42 - 12:11 - 17:53
ДНІПРО
21 березня 11:00
52 %
733 мм. рт. ст.
2017/03/21 11:35:03
33524
3 м/с
12.6 °C
6:26 - 12:12 - 18:38
ДОЛИНА
21 березня 11:00
53 %
744 мм. рт. ст.
2017/03/21 11:35:03
33719
2 м/с
8.1 °C
5:51 - 12:12 - 18:03
ДОЛИНСЬКА
21 березня 11:00
80 %
749 мм. рт. ст.
2017/03/21 11:35:04
34519
3 м/с
5.9 °C
5:31 - 12:11 - 17:42
ДОНЕЦЬК
21 березня 11:00
64 %
734 мм. рт. ст.
2017/03/21 11:35:04
33398
4 м/с
12.5 °C
6:28 - 12:12 - 18:40
ДРОГОБИЧ

Statistics

Average successful run time: 5 minutes

Total run time: about 5 hours

Total cpu time used: 2 minutes

Total disk space used: 300 KB

History

  • Auto ran revision a12f250a and completed successfully .
    142 records added, 142 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    154 records added, 154 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    160 records added, 160 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    158 records added, 158 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    124 records added, 124 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    151 records added, 151 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    88 records added, 88 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    159 records added, 159 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
  • Auto ran revision a12f250a and completed successfully .
    158 records added, 158 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    145 records added, 145 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    156 records added, 156 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    145 records added, 145 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    153 records added, 153 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    160 records added, 160 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 160 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Manually ran revision a12f250a and completed successfully .
    160 records added, 167 records removed in the database
    1418 pages scraped
  • Manually ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    162 records added, 162 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    166 records added, 166 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    166 records added, 166 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    166 records added, 166 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    167 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    336 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    171 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    168 pages scraped
  • Manually ran revision a12f250a and completed successfully .
    167 records added, 166 records removed in the database
    168 pages scraped
  • Manually ran revision a12f250a and completed successfully .
    166 records added, 166 records removed in the database
    168 pages scraped
  • Manually ran revision a12f250a and completed successfully .
    166 records added in the database
    168 pages scraped
  • Created on morph.io

Scraper code

Python

weather / scraper.py