CharlieIO / CSGOTeamBotScraper

HLTV Teams and stats


This is a scraper that runs on Morph. This is used to update the CSGOTeamBot's DB.

Contributors CharlieIO

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.9, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.9 -----> Installing pip -----> Installing requirements with pip  Collecting beautifulsoup4==4.4.1 (from -r /tmp/build/requirements.txt (line 1))  Downloading beautifulsoup4-4.4.1-py2-none-any.whl (81kB)  Collecting decorator==4.0.6 (from -r /tmp/build/requirements.txt (line 2))  Downloading decorator-4.0.6-py2.py3-none-any.whl  Collecting nltk==3.0.5 (from -r /tmp/build/requirements.txt (line 3))  Downloading nltk-3.0.5.zip (1.2MB)  Collecting oauthlib==1.0.3 (from -r /tmp/build/requirements.txt (line 4))  Downloading oauthlib-1.0.3.tar.gz (109kB)  Collecting praw==3.3.0 (from -r /tmp/build/requirements.txt (line 5))  Downloading praw-3.3.0-py2.py3-none-any.whl (69kB)  Collecting psycopg2==2.6.1 (from -r /tmp/build/requirements.txt (line 6))  Downloading psycopg2-2.6.1.tar.gz (371kB)  Collecting python-twitter==2.2 (from -r /tmp/build/requirements.txt (line 7))  Downloading python_twitter-2.2-py2-none-any.whl (60kB)  Collecting requests==2.8.0 (from -r /tmp/build/requirements.txt (line 8))  Downloading requests-2.8.0-py2.py3-none-any.whl (476kB)  Collecting requests-oauthlib==0.5.0 (from -r /tmp/build/requirements.txt (line 9))  Downloading requests_oauthlib-0.5.0-py2.py3-none-any.whl  Collecting schedule==0.3.2 (from -r /tmp/build/requirements.txt (line 10))  Downloading schedule-0.3.2.tar.gz  Collecting six==1.10.0 (from -r /tmp/build/requirements.txt (line 11))  Downloading six-1.10.0-py2.py3-none-any.whl  Collecting textblob==0.10.0 (from -r /tmp/build/requirements.txt (line 12))  Downloading textblob-0.10.0-py2.py3-none-any.whl (633kB)  Collecting update-checker==0.11 (from -r /tmp/build/requirements.txt (line 13))  Downloading update_checker-0.11-py2.py3-none-any.whl  Collecting virtualenv==14.0.1 (from -r /tmp/build/requirements.txt (line 14))  Downloading virtualenv-14.0.1-py2.py3-none-any.whl (1.8MB)  Installing collected packages: beautifulsoup4, decorator, six, nltk, oauthlib, requests, update-checker, praw, psycopg2, requests-oauthlib, python-twitter, schedule, textblob, virtualenv  Running setup.py install for nltk: started  Running setup.py install for nltk: finished with status 'done'  Running setup.py install for oauthlib: started  Running setup.py install for oauthlib: finished with status 'done'  Running setup.py install for psycopg2: started  Running setup.py install for psycopg2: finished with status 'done'  Running setup.py install for schedule: started  Running setup.py install for schedule: finished with status 'done'  Successfully installed beautifulsoup4-4.4.1 decorator-4.0.6 nltk-3.0.5 oauthlib-1.0.3 praw-3.3.0 psycopg2-2.6.1 python-twitter-2.2 requests-2.8.0 requests-oauthlib-0.5.0 schedule-0.3.2 six-1.10.0 textblob-0.10.0 update-checker-0.11 virtualenv-14.0.1  -----> Downloading NLTK corpora…  ! 'nltk.txt' not found, not downloading any corpora  ! Learn more: https://devcenter.heroku.com/articles/python-nltk  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Statistics

Average successful run time: about 1 hour

Total run time: 20 days

Total cpu time used: about 9 hours

Total disk space used: 43.6 KB

History

  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

CSGOTeamBotScraper / scraper.py