Work in progress...

installation

system dependencies

sudo apt-get install python-dev

with virtualenv

obtain virtualenv

Check https://virtualenv.pypa.io/en/latest/installation.html or follow these instructions:

if Debian equal/newer than jessie (virtualenv version equal or greater than 1.9)
sudo apt-get install python-virtualenv
if Debian older than jessie (or virtualenv version prior to 1.9)
sudo apt-get install ca-certificates gnupg
curl https://pypi.python.org/packages/source/v/virtualenv/virtualenv-13.1.0.tar.gz#md5=70f63a429b7dd7c3e10f6af09ed32554 > /pathtovirtualenvdownload/virtualenv-13.1.0.tar.gz # or latest
curl https://pypi.python.org/packages/source/v/virtualenv/virtualenv-13.1.0.tar.gz.asc > /pathtovirtualenvdownload/virtualenv-13.1.0.tar.gz.asc # or latest
mkdir /tmp/.gnupg
chmod 700 /tmp/.gnupg
gpg --homedir /tmp/.gnupg --keyserver hkps.pool.sks-keyservers.net --recv-keys 3372DCFA
gpg --homedir /tmp/.gnupg --fingerprint 3372DCFA # check is 7C6B 7C5D 5E2B 6356 A926  F04F 6E3C BCE9 3372 DCFA
gpg --homedir /tmp/.gnupg --verify /pathtovirtualenvdownload/virtualenv-13.1.0.tar.gz.asc
tar xzf /pathtovirtualenvdownload/virtualenv-13.1.0.tar.gz --directory /pathtovirtualenvbin/
echo "alias virtualenv='python  /pathtovirtualenvbin/virtualenv-13.1.0/virtualenv.py'" >> ~/.bashrc # or other shell start
source ~/.bashrc # or other shell start

create a virtualenv

mkdir ~/.virtualenvs
virtualenv ~/.virtualenvs/oiienv
source ~/.virtualenvs/oiienv/bin/activate

install dependencies in virtualenv

git clone https://github.com/juga0/page_watcher_scraper
cd page_watcher_scraper
pip install -r requirements.txt

configuration

More about pagewatcherscraper/pagewatcherscraper/settings.py: TBD More about pagewatcherscraper/configlocal.py: TBD If you need local settings, edit pagewatcherscraper/pagewatcherscraper/settingslocal.py and pagewatcherscraper/config_local.py

running

To list the scrappers:

scrapy list

To run pagewatcherscraper:

cd page_watcher_scraper
./scraper.py

configuring cron job

Create an script like this replacing the path by your path:

cd page_watcher_scraper
vim run.sh

#!/bin/bash
cd /mypath/page_watcher_scraper && source /mypath/page_watcher_scraper/environment && source /mypath/.virtualenvs/oiienv/bin/activate && /mypath/.virtualenvs/oiienv/bin/python /mypath/page_watcher_scraper/scraper.py >> /mypath/page_watcher_scraper/cronlog.txt

Edit crontab:

crontab -e

To run every day at 14:35h:

35 14    * * * /bin/bash /home/duy/page_watcher_scraper/run.sh

Contributors juga0

The scraper is queued to run. It was queued automatically .

Console output of last run

Statistics

Average successful run time: 4 minutes

Total run time: about 1 month

Total cpu time used: 42 minutes

Total disk space used: 287 KB

History

  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    16 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and failed .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and failed .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    16 pages scraped
  • Auto ran revision 7d5f437c and failed .
    nothing changed in the database
  • Auto ran revision 7d5f437c and failed .
    nothing changed in the database
  • Auto ran revision 7d5f437c and failed .
    nothing changed in the database
  • Auto ran revision 7d5f437c and failed .
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    12 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    29 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    12 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    12 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    42 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    19 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    14 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    17 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    9 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    10 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    9 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    12 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    9 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    12 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    10 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    13 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    12 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and failed .
    nothing changed in the database
  • Auto ran revision 7d5f437c and failed .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
    11 pages scraped
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and failed .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 7d5f437c and completed successfully .
    nothing changed in the database
  • Auto ran revision 4f0bcca7 and completed successfully .
    nothing changed in the database
  • Auto ran revision 4f0bcca7 and completed successfully .
    nothing changed in the database
  • Auto ran revision 4f0bcca7 and completed successfully .
    nothing changed in the database
  • Auto ran revision 4f0bcca7 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8a88ca17 and completed successfully .
    nothing changed in the database
  • Manually ran revision 8a88ca17 and completed successfully .
    nothing changed in the database
  • Manually ran revision d78b190f and failed .
    nothing changed in the database
  • Manually ran revision 9509d295 and completed successfully .
    nothing changed in the database
  • Manually ran revision 9509d295 and completed successfully .
    nothing changed in the database
  • Manually ran revision 76f4ae1e and failed .
    nothing changed in the database
  • Manually ran revision 76f4ae1e and completed successfully .
    nothing changed in the database
  • Manually ran revision b8129df6 and completed successfully .
    nothing changed in the database
  • Manually ran revision b7a421ff and completed successfully .
    nothing changed in the database
  • Manually ran revision e79f8ece and failed .
    nothing changed in the database
  • Manually ran revision e79f8ece and completed successfully .
    nothing changed in the database
  • Manually ran revision c7ad73f8 and completed successfully .
    nothing changed in the database
  • Manually ran revision 8bf944b3 and completed successfully .
    nothing changed in the database
  • Manually ran revision b2061840 and completed successfully .
    nothing changed in the database
  • Manually ran revision 2d0f50ec and failed .
    nothing changed in the database
  • Auto ran revision b74ae1af and failed .
    nothing changed in the database
  • Auto ran revision 43825bca and completed successfully .
    nothing changed in the database
  • Manually ran revision 5a4bffaa and failed .
    nothing changed in the database
  • Manually ran revision 7d326bd5 and failed .
    nothing changed in the database
  • Manually ran revision f832fda0 and failed .
    nothing changed in the database
  • Manually ran revision e32bea37 and failed .
    nothing changed in the database
  • Manually ran revision ffa0c764 and failed .
    nothing changed in the database
  • Manually ran revision ffa0c764 and failed .
    nothing changed in the database
  • Manually ran revision 0c8dcaa2 and failed .
    nothing changed in the database
  • Manually ran revision 671e8f04 and failed .
    nothing changed in the database
  • Manually ran revision 6af33aca and failed .
    nothing changed in the database
  • Manually ran revision 1ba2e0f5 and failed .
    nothing changed in the database
  • Manually ran revision 85a14bb9 and failed .
    nothing changed in the database
  • Manually ran revision 6898df17 and failed .
    nothing changed in the database
  • Manually ran revision ff197dcf and failed .
    nothing changed in the database
  • Manually ran revision ff197dcf and failed .
  • Created on morph.io

Scraper code

Python

page_watcher_scraper / scraper.py