ErinClark / test_git

Scrapes www.b2bquote.co.uk

The most accurate Tender service in the UK. Access thousands of High Value OJEU and Low Value UK Tenders. Register Free to receive twice daily email alerts.


Contributors ErinClark randomgitman invalid-email-address

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling... [1G-----> Python app detected [1G-----> Stack changed, re-installing runtime [1G-----> Installing runtime (python-2.7.6) [1G-----> Installing dependencies with pip [1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 1)) [1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki [1G Collecting lxml==3.4.4 (from -r requirements.txt (line 3)) [1G Downloading lxml-3.4.4.tar.gz (3.5MB) [1G Building lxml version 3.4.4. [1G Building without Cython. [1G Using build configuration of libxslt 1.1.28 [1G /app/.heroku/python/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url' [1G warnings.warn(msg) [1G Collecting cssselect==0.9.1 (from -r requirements.txt (line 4)) [1G Downloading cssselect-0.9.1.tar.gz [1G Collecting beautifulsoup4 (from -r requirements.txt (line 5)) [1G Downloading beautifulsoup4-4.4.1-py2-none-any.whl (81kB) [1G Collecting python-dateutil (from -r requirements.txt (line 6)) [1G Downloading python_dateutil-2.5.1-py2.py3-none-any.whl (200kB) [1G Collecting selenium (from -r requirements.txt (line 7)) [1G Downloading selenium-2.53.1-py2-none-any.whl (884kB) [1G Collecting splinter>=0.7.3 (from -r requirements.txt (line 8)) [1G Downloading splinter-0.7.3.tar.gz [1G Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 1)) [1G Downloading dumptruck-0.1.6.tar.gz [1G Collecting requests (from scraperwiki->-r requirements.txt (line 1)) [1G Downloading requests-2.9.1-py2.py3-none-any.whl (501kB) [1G Collecting six>=1.5 (from python-dateutil->-r requirements.txt (line 6)) [1G Downloading six-1.10.0-py2.py3-none-any.whl [1G Installing collected packages: six, requests, dumptruck, splinter, selenium, python-dateutil, beautifulsoup4, cssselect, lxml, scraperwiki [1G [1G [1G Running setup.py install for dumptruck [1G Running setup.py install for splinter [1G [1G [1G [1G Running setup.py install for cssselect [1G Running setup.py install for lxml [1G Building lxml version 3.4.4. [1G Building without Cython. [1G Using build configuration of libxslt 1.1.28 [1G /app/.heroku/python/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url' [1G warnings.warn(msg) [1G building 'lxml.etree' extension [1G gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -I/tmp/pip-build-Qj9G30/lxml/src/lxml/includes -I/app/.heroku/python/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -w [1G gcc -pthread -shared build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -L/app/.heroku/python/lib -lxslt -lexslt -lxml2 -lz -lm -lpython2.7 -o build/lib.linux-x86_64-2.7/lxml/etree.so [1G building 'lxml.objectify' extension [1G gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -I/tmp/pip-build-Qj9G30/lxml/src/lxml/includes -I/app/.heroku/python/include/python2.7 -c src/lxml/lxml.objectify.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.objectify.o -w [1G gcc -pthread -shared build/temp.linux-x86_64-2.7/src/lxml/lxml.objectify.o -L/app/.heroku/python/lib -lxslt -lexslt -lxml2 -lz -lm -lpython2.7 -o build/lib.linux-x86_64-2.7/lxml/objectify.so [1G Running setup.py develop for scraperwiki [1G Creating /app/.heroku/python/lib/python2.7/site-packages/scraperwiki.egg-link (link to .) [1G Adding scraperwiki 0.3.7 to easy-install.pth file [1G Installed /app/.heroku/src/scraperwiki [1G Successfully installed beautifulsoup4-4.4.1 cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 python-dateutil-2.5.1 requests-2.9.1 scraperwiki selenium-2.53.1 six-1.10.0 splinter-0.7.3 [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running...

Statistics

Total run time: 23 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 63.7 KB

History

  • Manually ran revision 1f815e00 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 28d0b5ef and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

test_git