CharlieIO / CSGOTeamBotScraper

HLTV Teams and stats


This is a scraper that runs on Morph. This is used to update the CSGOTeamBot's DB.

Contributors CharlieIO

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.9  $ pip install -r requirements.txt  Collecting beautifulsoup4==4.4.1 (from -r requirements.txt (line 1))  Downloading beautifulsoup4-4.4.1-py2-none-any.whl (81kB)  Collecting decorator==4.0.6 (from -r requirements.txt (line 2))  Downloading decorator-4.0.6-py2.py3-none-any.whl  Collecting nltk==3.0.5 (from -r requirements.txt (line 3))  Downloading nltk-3.0.5.zip (1.2MB)  Collecting oauthlib==1.0.3 (from -r requirements.txt (line 4))  Downloading oauthlib-1.0.3.tar.gz (109kB)  Collecting praw==3.3.0 (from -r requirements.txt (line 5))  Downloading praw-3.3.0-py2.py3-none-any.whl (69kB)  Collecting psycopg2==2.6.1 (from -r requirements.txt (line 6))  Downloading psycopg2-2.6.1.tar.gz (371kB)  Collecting python-twitter==2.2 (from -r requirements.txt (line 7))  Downloading python_twitter-2.2-py2-none-any.whl (60kB)  Collecting requests==2.8.0 (from -r requirements.txt (line 8))  Downloading requests-2.8.0-py2.py3-none-any.whl (476kB)  Collecting requests-oauthlib==0.5.0 (from -r requirements.txt (line 9))  Downloading requests_oauthlib-0.5.0-py2.py3-none-any.whl  Collecting schedule==0.3.2 (from -r requirements.txt (line 10))  Downloading schedule-0.3.2.tar.gz  Collecting six==1.10.0 (from -r requirements.txt (line 11))  Downloading six-1.10.0-py2.py3-none-any.whl  Collecting textblob==0.10.0 (from -r requirements.txt (line 12))  Downloading textblob-0.10.0-py2.py3-none-any.whl (633kB)  Collecting update-checker==0.11 (from -r requirements.txt (line 13))  Downloading update_checker-0.11-py2.py3-none-any.whl  Collecting virtualenv==14.0.1 (from -r requirements.txt (line 14))  Downloading virtualenv-14.0.1-py2.py3-none-any.whl (1.8MB)  Installing collected packages: beautifulsoup4, decorator, six, nltk, oauthlib, requests, update-checker, praw, psycopg2, requests-oauthlib, python-twitter, schedule, textblob, virtualenv  Running setup.py install for nltk: started  Running setup.py install for nltk: finished with status 'done'  Running setup.py install for oauthlib: started  Running setup.py install for oauthlib: finished with status 'done'  Running setup.py install for psycopg2: started  Running setup.py install for psycopg2: finished with status 'done'  Running setup.py install for schedule: started  Running setup.py install for schedule: finished with status 'done'  Successfully installed beautifulsoup4-4.4.1 decorator-4.0.6 nltk-3.0.5 oauthlib-1.0.3 praw-3.3.0 psycopg2-2.6.1 python-twitter-2.2 requests-2.8.0 requests-oauthlib-0.5.0 schedule-0.3.2 six-1.10.0 textblob-0.10.0 update-checker-0.11 virtualenv-14.0.1   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Statistics

Average successful run time: about 1 hour

Total run time: 8 days

Total cpu time used: about 4 hours

Total disk space used: 51.9 KB

History

  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    6 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    84 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    44 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    7 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    73 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    82 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Manually ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and failed .
    3132 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    11241 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    11155 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
    8797 pages scraped
  • Auto ran revision d796c755 and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
    10724 pages scraped
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
    10624 pages scraped
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision ac46090f and completed successfully .
    nothing changed in the database
  • Auto ran revision 91a780ca and completed successfully .
    nothing changed in the database
    10557 pages scraped
  • Auto ran revision 91a780ca and completed successfully .
    nothing changed in the database
  • Auto ran revision 91a780ca and completed successfully .
    nothing changed in the database
  • Auto ran revision 91a780ca and completed successfully .
    nothing changed in the database
  • Auto ran revision 91a780ca and completed successfully .
    nothing changed in the database
  • Auto ran revision 91a780ca and completed successfully .
    nothing changed in the database
  • Auto ran revision 527937c3 and completed successfully .
    nothing changed in the database
    10366 pages scraped
  • Auto ran revision 527937c3 and completed successfully .
    nothing changed in the database
  • Auto ran revision 527937c3 and completed successfully .
    nothing changed in the database
  • Auto ran revision 527937c3 and completed successfully .
    nothing changed in the database
    84 pages scraped
  • Auto ran revision 527937c3 and completed successfully .
    nothing changed in the database
  • Auto ran revision 527937c3 and completed successfully .
    nothing changed in the database
    10228 pages scraped
  • Auto ran revision b73a82da and completed successfully .
    nothing changed in the database
  • Manually ran revision b73a82da and completed successfully .
    nothing changed in the database
  • Auto ran revision 1da3dc9e and completed successfully .
    nothing changed in the database
  • Auto ran revision 1da3dc9e and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 65e4673f and completed successfully .
    nothing changed in the database
    10157 pages scraped
  • Manually ran revision dc7e34fd and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

CSGOTeamBotScraper / scraper.py