ar73m / weather

Ukrainian Hydrometeorological Center - http://meteo.gov.ua/

Scrapes meteo.gov.ua

Погода в Украине и в мире. Точный прогноз погоды для Украины.Погодные информеры. Погодные карты, спутниковые снимки, температура воды. Новостные ленты о погоде в Украине и мире. Погода и здоровье


This is a scraper that runs on Morph. To get started see the documentation

Contributors ar73m

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.9  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting grab==0.6.21 (from -r requirements.txt (line 10))  Downloading grab-0.6.21.tar.gz (89kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 6))  Downloading requests-2.13.0-py2.py3-none-any.whl (584kB)  Collecting pycurl (from grab==0.6.21->-r requirements.txt (line 10))  Downloading pycurl-7.43.0.tar.gz (182kB)  Collecting selection (from grab==0.6.21->-r requirements.txt (line 10))  Downloading selection-0.0.13.tar.gz  Collecting weblib>=0.1.10 (from grab==0.6.21->-r requirements.txt (line 10))  Downloading weblib-0.1.24.tar.gz  Collecting six (from grab==0.6.21->-r requirements.txt (line 10))  Downloading six-1.10.0-py2.py3-none-any.whl  Collecting pytils (from weblib>=0.1.10->grab==0.6.21->-r requirements.txt (line 10))  Downloading pytils-0.3.tar.gz (89kB)  Collecting user_agent (from weblib>=0.1.10->grab==0.6.21->-r requirements.txt (line 10))  Downloading user_agent-0.1.8.tar.gz  Installing collected packages: dumptruck, requests, scraperwiki, lxml, cssselect, pycurl, pytils, six, user-agent, weblib, selection, grab  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Running setup.py install for pycurl: started  Running setup.py install for pycurl: finished with status 'done'  Running setup.py install for pytils: started  Running setup.py install for pytils: finished with status 'done'  Running setup.py install for user-agent: started  Running setup.py install for user-agent: finished with status 'done'  Running setup.py install for weblib: started  Running setup.py install for weblib: finished with status 'done'  Running setup.py install for selection: started  Running setup.py install for selection: finished with status 'done'  Running setup.py install for grab: started  Running setup.py install for grab: finished with status 'done'  Successfully installed cssselect-0.9.1 dumptruck-0.1.6 grab-0.6.21 lxml-3.4.4 pycurl-7.43.0 pytils-0.3 requests-2.13.0 scraperwiki selection-0.0.13 six-1.10.0 user-agent-0.1.8 weblib-0.1.24   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Start 2017/02/24 16:18:21 Parse ������ Parse �᪠�?� ���� Parse �.��?���. Parse �.��ઢ� Parse �����?��� Parse ���⠭�� Parse ��������� Parse ��ॣ��� Parse ��०��� Parse ������� Parse �?�������� Error: [Errno 28] Operation timed out after 10002 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33966 Parse �?�������� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33966 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33446 Parse �?���?��� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33446 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33717 Parse ���ਭ��� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33717 Error: [Errno 28] Operation timed out after 10002 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/34302 Parse �������?� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/34302 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33887 Parse ����ࠤ Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33887 Error: [Errno 28] Operation timed out after 10001 milliseconds with 0 bytes received, URL: http://meteo.gov.ua/ua/33347 Parse ������?�� Error: 'NoneType' object has no attribute '__getitem__', URL: http://meteo.gov.ua/ua/33347 Parse ���?��� Parse �த� Parse �.��१��� Parse �.������ Parse �.������쪨� Parse �.����ᠭ��. Parse ���.���?� Parse ������� Parse �?����� Parse �����ᥭ��� Parse ��������� Parse ����� Parse �����஭ Parse ���ᨭ Parse ���?����� Parse ����?� Parse �㡨���� Parse ����� ���� Parse ������楢� Parse ��?��� Parse ������ Parse ������쪠 Parse ������� Parse �ண���� Parse ��㦡� Parse �㡭� Parse ����?� Parse ��⮬�� Parse ���ਭ�� Parse �����?��� Parse ������� Parse �������த�� Parse �������� Parse ����⮭��� Parse �����?� Parse ?����-�࠭�?���� Parse ��୮������ Parse ?����� Parse ?��� Parse �.���?��᪨� Parse ���'ﭪ� Parse ���?� Parse ���� Parse ���� Parse ��ਫ?��� Parse �ய�����쪨� Parse �����直 Parse ������ Parse ������� Parse ������� Parse ���?���?��� Parse ���������쪥 Parse ����⮯ Parse �����⥭� Parse ���஢��� Parse ���᭮�ࠤ Parse �६����� Parse �ਢ�� �?� Parse ���'����� Parse ������� Parse ������ Parse �㡭� Parse �㣠���� Parse ����� Parse ��?��� Parse ��?� Parse ���?� Parse �������? Parse ���?㯮�� Parse ���?⮯��� Parse �������� Parse ��஭?��� Parse �?��?�'� Parse ���.-���?��� Parse �����᪠ Parse �.������쪨� Parse �.������ Parse �.��客�� Parse �.�?ண��� Parse �.��㤥��� Parse �.����� Parse �?��� Parse �?������ Parse ������?��஢��� Parse ������࣮த Parse �����᪮� Parse �.��i���� Parse ����� Parse ����� Parse ������� Parse ����� Parse �砪?� Parse ������ࠤ Parse ��ࢮ����� Parse ���� Parse ��������쪠 Parse �������� Parse ���⠢� Parse ����譠 Parse �ਫ㪨 Parse ���訡 Parse ����-���쪠 Parse ���?� Parse �?��� Parse ����?�쭠 Parse ����� Parse ������ Parse ��୨ Parse ���⮢� Parse ������� Parse ��?⫮������ Parse ����⨭ Parse �����?��� Parse ��ࡪ� Parse �����쭨���� Parse �?���ய��� Parse �����쪥 Parse ��?�� Parse ��਩ Parse ���?����� Parse �㬨 Parse ��୮�?�� Parse �����?� Parse �����쪥 Parse ��ઠ Parse ����த Parse ����� Parse ����?� Parse ����?� Parse ���ᮭ Parse ��i�쭨� Parse ����쭨�쪨� Parse ��૨ Parse ���� Parse ������� Parse ��ઠ�� Parse ����?��? Parse ����?�?� Parse ����ਭ Parse ��୮���� Parse ��୮����쪥 Parse �����?� Parse �����?��� Parse ���� Parse ����?� Parse ���⨭ Parse ���?�� Parse �६�� End 2017/02/24 16:20:52

Data

Downloaded 8 times by ar73m MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (36 KB) Use the API

rows 10 / 165

url datetime hu pres update_date id wind temp sun city
21 лютого 11:00
56 %
739 мм. рт. ст.
2017/02/21 05:15:27
33966
7 м/с
14.7 °C
6:34 - 10:43 - 17:17
БІЛОГОРСЬК
21 лютого 05:00
86 %
735 мм. рт. ст.
2017/02/21 05:15:28
33446
4 м/с
-1.7 °C
7:05 - 10:28 - 17:33
БІЛОПІЛЛЯ
21 лютого 05:00
96 %
745 мм. рт. ст.
2017/02/21 05:15:29
33717
1 м/с
0.2 °C
6:48 - 10:35 - 17:23
БОБРИНЕЦЬ
21 лютого 05:00
96 %
738 мм. рт. ст.
2017/02/21 05:15:29
34302
5 м/с
-0.3 °C
6:39 - 10:27 - 17:06
БОГОДУХІВ
21 лютого 05:00
96 %
759 мм. рт. ст.
2017/02/21 05:15:29
33887
1 м/с
-0.3 °C
6:59 - 10:41 - 17:40
БОЛГРАД
21 лютого 05:00
91 %
745 мм. рт. ст.
2017/02/21 05:15:30
33347
3 м/с
-2.5 °C
6:57 - 10:27 - 17:24
БОРИСПІЛЬ
24 лютого 17:00
85 %
741 мм. рт. ст.
2017/02/24 16:18:22
34510
4 м/с
7.3 °C
6:21 - 10:42 - 17:03
БАХМУТ
24 лютого 17:00
83 %
752 мм. рт. ст.
2017/02/24 16:18:23
33915
8 м/с
9.3 °C
6:34 - 10:49 - 17:23
АСКАНІЯ НОВА
24 лютого 17:00
57 %
753 мм. рт. ст.
2017/02/24 16:18:23
33830
3 м/с
14.7 °C
6:48 - 10:49 - 17:37
Б.ДНІСТР.
24 лютого 17:00
70 %
733 мм. рт. ст.
2017/02/24 16:18:24
33464
6 м/с
8 °C
6:53 - 10:40 - 17:33
Б.ЦЕРКВА

Statistics

Average successful run time: 4 minutes

Total run time: about 4 hours

Total cpu time used: 2 minutes

Total disk space used: 295 KB

History

  • Auto ran revision a12f250a and completed successfully .
    159 records added, 159 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
  • Auto ran revision a12f250a and completed successfully .
    158 records added, 158 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    145 records added, 145 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    156 records added, 156 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    145 records added, 145 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    153 records added, 153 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    160 records added, 160 records removed in the database
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 160 records removed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    nothing changed in the database
    166 pages scraped
  • Manually ran revision a12f250a and completed successfully .
    160 records added, 167 records removed in the database
    1418 pages scraped
  • Manually ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    162 records added, 162 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    166 records added, 166 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    166 records added, 166 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    166 records added, 166 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    167 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    336 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    171 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    167 records added, 167 records removed in the database
    168 pages scraped
  • Auto ran revision a12f250a and completed successfully .
    165 records added, 165 records removed in the database
    168 pages scraped
  • Manually ran revision a12f250a and completed successfully .
    167 records added, 166 records removed in the database
    168 pages scraped
  • Manually ran revision a12f250a and completed successfully .
    166 records added, 166 records removed in the database
    168 pages scraped
  • Manually ran revision a12f250a and completed successfully .
    166 records added in the database
    168 pages scraped
  • Created on morph.io

Scraper code

Python

weather / scraper.py