Stanpol / slon_ru_paid_users

Paid users count at slon.ru

Scrapes slon.ru

Деловые новости и блоги


This is a scraper that runs on Morph. It scrapes the number of premium users on Slon.ru.

Contributors Stanpol

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.9  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting bs4==0.0.1 (from -r requirements.txt (line 8))  Downloading bs4-0.0.1.tar.gz  Collecting lxml==3.4.4 (from -r requirements.txt (line 9))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r requirements.txt (line 10))  Downloading cssselect-0.9.1.tar.gz  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 6))  Downloading requests-2.11.1-py2.py3-none-any.whl (514kB)  Collecting beautifulsoup4 (from bs4==0.0.1->-r requirements.txt (line 8))  Downloading beautifulsoup4-4.5.1-py2-none-any.whl (83kB)  Installing collected packages: dumptruck, requests, scraperwiki, beautifulsoup4, bs4, lxml, cssselect  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for bs4: started  Running setup.py install for bs4: finished with status 'done'  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Successfully installed beautifulsoup4-4.5.1 bs4-0.0.1 cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 requests-2.11.1 scraperwiki   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 7, in <module> users=int(number.text.replace(" ", "")) AttributeError: 'NoneType' object has no attribute 'text'

Data

Downloaded 1 time by Stanpol

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (5 KB) Use the API

rows 10 / 63

users date
21011
06/23/16
21030
06/24/16
21042
06/25/16
21110
06/27/16
21150
06/28/16
21150
06/29/16
21146
06/30/16
21051
07/01/16
20998
07/02/16
20971
07/03/16

Statistics

Average successful run time: 1 minute

Total run time: about 2 hours

Total cpu time used: less than a minute

Total disk space used: 26.3 KB

History

  • Auto ran revision fb362091 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision fb362091 and failed .
    nothing changed in the database
  • Auto ran revision fb362091 and failed .
    nothing changed in the database
  • Auto ran revision fb362091 and failed .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision fb362091 and failed .
    nothing changed in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    nothing changed in the database
  • Auto ran revision fb362091 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and failed .
    nothing changed in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    nothing changed in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    nothing changed in the database
  • Auto ran revision fb362091 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision fb362091 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    nothing changed in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    nothing changed in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
    44 pages scraped
  • Auto ran revision fb362091 and failed .
    nothing changed in the database
  • Auto ran revision fb362091 and failed .
    nothing changed in the database
  • Auto ran revision fb362091 and failed .
    nothing changed in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Manually ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Auto ran revision fb362091 and completed successfully .
    1 record added in the database
  • Manually ran revision fb362091 and completed successfully .
    1 record added in the database
  • Manually ran revision bae3e3ab and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

slon_ru_paid_users / scraper.py