ErinClark / test_git

Scrapes www.b2bquote.co.uk

The most accurate Tender service in the UK. Access thousands of High Value OJEU and Low Value UK Tenders. Register Free to receive twice daily email alerts.


test_git

Contributors ErinClark

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling... -----> Python app detected -----> Stack changed, re-installing runtime -----> Installing runtime (python-2.7.6) -----> Installing dependencies with pip  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 1))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r requirements.txt (line 3))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Building lxml version 3.4.4.  Building without Cython.  Using build configuration of libxslt 1.1.28  /app/.heroku/python/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url'  warnings.warn(msg)  Collecting cssselect==0.9.1 (from -r requirements.txt (line 4))  Downloading cssselect-0.9.1.tar.gz  Collecting beautifulsoup4 (from -r requirements.txt (line 5))  Downloading beautifulsoup4-4.4.1-py2-none-any.whl (81kB)  Collecting python-dateutil (from -r requirements.txt (line 6))  Downloading python_dateutil-2.5.1-py2.py3-none-any.whl (200kB)  Collecting selenium (from -r requirements.txt (line 7))  Downloading selenium-2.53.1-py2-none-any.whl (884kB)  Collecting splinter>=0.7.3 (from -r requirements.txt (line 8))  Downloading splinter-0.7.3.tar.gz  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 1))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 1))  Downloading requests-2.9.1-py2.py3-none-any.whl (501kB)  Collecting six>=1.5 (from python-dateutil->-r requirements.txt (line 6))  Downloading six-1.10.0-py2.py3-none-any.whl  Installing collected packages: six, requests, dumptruck, splinter, selenium, python-dateutil, beautifulsoup4, cssselect, lxml, scraperwiki    Running setup.py install for dumptruck  Running setup.py install for splinter     Running setup.py install for cssselect  Running setup.py install for lxml  Building lxml version 3.4.4.  Building without Cython.  Using build configuration of libxslt 1.1.28  /app/.heroku/python/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url'  warnings.warn(msg)  building 'lxml.etree' extension  gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -I/tmp/pip-build-Qj9G30/lxml/src/lxml/includes -I/app/.heroku/python/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -w  gcc -pthread -shared build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -L/app/.heroku/python/lib -lxslt -lexslt -lxml2 -lz -lm -lpython2.7 -o build/lib.linux-x86_64-2.7/lxml/etree.so  building 'lxml.objectify' extension  gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -I/tmp/pip-build-Qj9G30/lxml/src/lxml/includes -I/app/.heroku/python/include/python2.7 -c src/lxml/lxml.objectify.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.objectify.o -w  gcc -pthread -shared build/temp.linux-x86_64-2.7/src/lxml/lxml.objectify.o -L/app/.heroku/python/lib -lxslt -lexslt -lxml2 -lz -lm -lpython2.7 -o build/lib.linux-x86_64-2.7/lxml/objectify.so  Running setup.py develop for scraperwiki  Creating /app/.heroku/python/lib/python2.7/site-packages/scraperwiki.egg-link (link to .)  Adding scraperwiki 0.3.7 to easy-install.pth file  Installed /app/.heroku/src/scraperwiki  Successfully installed beautifulsoup4-4.4.1 cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 python-dateutil-2.5.1 requests-2.9.1 scraperwiki selenium-2.53.1 six-1.10.0 splinter-0.7.3  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Statistics

Total run time: 23 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 18.5 KB

History

  • Manually ran revision 1f815e00 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 28d0b5ef and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

test_git / scraper.py