metaodi / covid-19-scraper-canton-sg

COVID-19 case numbers for the canton St. Gallen


Scraper for COVID-19 cases number in canton St. Gallen

This is a repo for a scraper of cantonal case numbers, it's based on the #covid19mon hackathon challange.

You can find the data on morph.io (as SQLite, CSV and API): https://morph.io/metaodi/covid-19-scraper-canton-sg

Contributors metaodi

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.6.2 -----> Installing pip -----> Installing requirements with pip  Collecting beautifulsoup4  Downloading beautifulsoup4-4.8.2-py3-none-any.whl (106 kB)  Collecting requests  Downloading requests-2.23.0-py2.py3-none-any.whl (58 kB)  Collecting dateparser  Downloading dateparser-0.7.4-py2.py3-none-any.whl (353 kB)  Collecting soupsieve>=1.2  Downloading soupsieve-2.0-py2.py3-none-any.whl (32 kB)  Collecting idna<3,>=2.5  Downloading idna-2.9-py2.py3-none-any.whl (58 kB)  Collecting certifi>=2017.4.17  Downloading certifi-2019.11.28-py2.py3-none-any.whl (156 kB)  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1  Downloading urllib3-1.25.8-py2.py3-none-any.whl (125 kB)  Collecting chardet<4,>=3.0.2  Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB)  Collecting python-dateutil  Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)  Collecting regex!=2019.02.19  Downloading regex-2020.2.20-cp36-cp36m-manylinux2010_x86_64.whl (690 kB)  Collecting tzlocal  Downloading tzlocal-2.0.0-py2.py3-none-any.whl (15 kB)  Collecting pytz  Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB)  Collecting six>=1.5  Downloading six-1.14.0-py2.py3-none-any.whl (10 kB)  Installing collected packages: soupsieve, beautifulsoup4, idna, certifi, urllib3, chardet, requests, six, python-dateutil, regex, pytz, tzlocal, dateparser  Successfully installed beautifulsoup4-4.8.2 certifi-2019.11.28 chardet-3.0.4 dateparser-0.7.4 idna-2.9 python-dateutil-2.8.1 pytz-2019.3 regex-2020.2.20 requests-2.23.0 six-1.14.0 soupsieve-2.0 tzlocal-2.0.0 urllib3-1.25.8   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Error: 'NoneType' object has no attribute 'group' Traceback (most recent call last): Traceback (most recent call last): File "scraper.py", line 115, in <module> File "scraper.py", line 115, in <module> parse_page(soup, conn) parse_page(soup, conn) File "scraper.py", line 63, in parse_page File "scraper.py", line 63, in parse_page case_str = re.search(".*Best.tigte F.lle\:\W*(\d+)", box_str).group(1) case_str = re.search(".*Best.tigte F.lle\:\W*(\d+)", box_str).group(1) AttributeError: 'NoneType' object has no attribute 'group' AttributeError: 'NoneType' object has no attribute 'group'

Statistics

Average successful run time: half a minute

Total run time: 10 minutes

Total cpu time used: half a minute

Total disk space used: 42.5 KB

History

  • Auto ran revision 0bd507e6 and failed .
    nothing changed in the database
  • Auto ran revision 0bd507e6 and failed .
    nothing changed in the database
  • Auto ran revision 0bd507e6 and failed .
    nothing changed in the database
  • Auto ran revision 0bd507e6 and failed .
    nothing changed in the database
  • Auto ran revision 0bd507e6 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history