This is a scraper that runs on Morph. To get started see the documentation

Contributors AVD087

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Error removing intermediate container 0f974a757739: Driver aufs failed to remove root filesystem 0f974a757739321eac5709aade11720671fe9479d137b552a78cafc55121026b: rename /var/lib/docker/aufs/mnt/a97fe1a2d80e1751237ab68f802c8ee949d1050ae266e523cc3596c65522e02e /var/lib/docker/aufs/mnt/a97fe1a2d80e1751237ab68f802c8ee949d1050ae266e523cc3596c65522e02e-removing: device or resource busy  -----> Python app detected -----> Installing python-2.7.9  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting splinter (from -r requirements.txt (line 10))  Downloading splinter-0.7.4.tar.gz  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 6))  Downloading requests-2.11.1-py2.py3-none-any.whl (514kB)  Collecting selenium>=2.53.6 (from splinter->-r requirements.txt (line 10))  Downloading selenium-2.53.6-py2.py3-none-any.whl (884kB)  Installing collected packages: dumptruck, requests, scraperwiki, lxml, cssselect, selenium, splinter  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Running setup.py install for splinter: started  Running setup.py install for splinter: finished with status 'done'  Successfully installed cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 requests-2.11.1 scraperwiki selenium-2.53.6 splinter-0.7.4   -----> Discovering process types  Procfile declares types -> scraper Error removing intermediate container 0f974a757739: No such container: 0f974a757739321eac5709aade11720671fe9479d137b552a78cafc55121026b Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 13, in <module> browser.fill(search, "software") File "/app/.heroku/python/lib/python2.7/site-packages/splinter/driver/webdriver/__init__.py", line 414, in fill field = self.find_by_name(name).first File "/app/.heroku/python/lib/python2.7/site-packages/splinter/element_list.py", line 53, in first return self[0] File "/app/.heroku/python/lib/python2.7/site-packages/splinter/element_list.py", line 44, in __getitem__ self.find_by, self.query)) splinter.exceptions.ElementDoesNotExist: no elements could be found with name "[]"

Statistics

Total run time: 2 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 23.4 KB

History

  • Manually ran revision 9488b3b5 and failed .
    nothing changed in the database
    3 pages scraped
  • Manually ran revision 8edad0e0 and failed .
    nothing changed in the database
  • Manually ran revision 616fc745 and failed .
    nothing changed in the database
    3 pages scraped
  • Created on morph.io

Scraper code

Python

manta_data / scraper.py