td_afdb
Contributors
Last run failed
with status code 1.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Python app detected
[1G ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.6, which is unsupported).
[1G ! We recommend upgrading by specifying the latest version (python-2.7.14).
[1G Learn More: https://devcenter.heroku.com/articles/python-runtimes
[1G-----> Installing python-2.7.6
[1G-----> Installing pip
[1G-----> Installing requirements with pip
[1G DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.
[1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 1))
[1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki
[1G Switched to a new branch 'morph_defaults'
[1G Branch morph_defaults set up to track remote branch morph_defaults from origin.
[1G Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 3))
[1G /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:354: SNIMissingWarning: An HTTPS request has been made, but the SNI (Server Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
[1G SNIMissingWarning
[1G /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:150: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
[1G InsecurePlatformWarning
[1G /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:150: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
[1G InsecurePlatformWarning
[1G Downloading https://files.pythonhosted.org/packages/63/c7/4f2a2a4ad6c6fa99b14be6b3c1cece9142e2d915aa7c43c908677afc8fa4/lxml-3.4.4.tar.gz (3.5MB)
[1G Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 4))
[1G Downloading https://files.pythonhosted.org/packages/aa/e5/9ee1460d485b94a6d55732eb7ad5b6c084caf73dd6f9cb0bb7d2a78fafe8/cssselect-0.9.1.tar.gz
[1G Collecting beautifulsoup4 (from -r /tmp/build/requirements.txt (line 5))
[1G Downloading https://files.pythonhosted.org/packages/8b/0e/048a2f88bc4be5e3697df9dc1f7b9d5c9c75be62676feeeb91d2e896c5ea/beautifulsoup4-4.7.1-py2-none-any.whl (94kB)
[1G Collecting python-dateutil (from -r /tmp/build/requirements.txt (line 6))
[1G Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB)
[1G Collecting selenium (from -r /tmp/build/requirements.txt (line 7))
[1G Downloading https://files.pythonhosted.org/packages/80/d6/4294f0b4bce4de0abf13e17190289f9d0613b0a44e5dd6a7f5ca98459853/selenium-3.141.0-py2.py3-none-any.whl (904kB)
[1G Collecting splinter>=0.7.3 (from -r /tmp/build/requirements.txt (line 8))
[1G Downloading https://files.pythonhosted.org/packages/a8/f3/7e8ee6296ea7a6db2deb2355166a372bdc9f2e2de4527b1151c025ca8b62/splinter-0.10.0-py2-none-any.whl
[1G Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 1))
[1G Downloading https://files.pythonhosted.org/packages/15/27/3330a343de80d6849545b6c7723f8c9a08b4b104de964ac366e7e6b318df/dumptruck-0.1.6.tar.gz
[1G Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 1))
[1G Downloading https://files.pythonhosted.org/packages/7d/e3/20f3d364d6c8e5d2353c72a67778eb189176f08e873c9900e10c0287b84b/requests-2.21.0-py2.py3-none-any.whl (57kB)
[1G Collecting soupsieve>=1.2 (from beautifulsoup4->-r /tmp/build/requirements.txt (line 5))
[1G Downloading https://files.pythonhosted.org/packages/b9/a5/7ea40d0f8676bde6e464a6435a48bc5db09b1a8f4f06d41dd997b8f3c616/soupsieve-1.9.1-py2.py3-none-any.whl
[1G Collecting six>=1.5 (from python-dateutil->-r /tmp/build/requirements.txt (line 6))
[1G Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
[1G Collecting urllib3 (from selenium->-r /tmp/build/requirements.txt (line 7))
[1G Downloading https://files.pythonhosted.org/packages/df/1c/59cca3abf96f991f2ec3131a4ffe72ae3d9ea1f5894abe8a9c5e3c77cfee/urllib3-1.24.2-py2.py3-none-any.whl (131kB)
[1G Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))
[1G Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)
[1G Collecting idna<2.9,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))
[1G Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)
[1G Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))
[1G Downloading https://files.pythonhosted.org/packages/60/75/f692a584e85b7eaba0e03827b3d51f45f571c2e793dd731e598828d380aa/certifi-2019.3.9-py2.py3-none-any.whl (158kB)
[1G Collecting backports.functools-lru-cache; python_version < "3" (from soupsieve>=1.2->beautifulsoup4->-r /tmp/build/requirements.txt (line 5))
[1G Downloading https://files.pythonhosted.org/packages/03/8e/2424c0e65c4a066e28f539364deee49b6451f8fcd4f718fefa50cc3dcf48/backports.functools_lru_cache-1.5-py2.py3-none-any.whl
[1G Installing collected packages: dumptruck, chardet, idna, certifi, urllib3, requests, scraperwiki, lxml, cssselect, backports.functools-lru-cache, soupsieve, beautifulsoup4, six, python-dateutil, selenium, splinter
[1G Running setup.py install for dumptruck: started
[1G Running setup.py install for dumptruck: finished with status 'done'
[1G Running setup.py develop for scraperwiki
[1G Running setup.py install for lxml: started
[1G Running setup.py install for lxml: still running...
[1G Running setup.py install for lxml: finished with status 'done'
[1G Running setup.py install for cssselect: started
[1G Running setup.py install for cssselect: finished with status 'done'
[1G Successfully installed backports.functools-lru-cache-1.5 beautifulsoup4-4.7.1 certifi-2019.3.9 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 idna-2.8 lxml-3.4.4 python-dateutil-2.8.0 requests-2.21.0 scraperwiki selenium-3.141.0 six-1.12.0 soupsieve-1.9.1 splinter-0.10.0 urllib3-1.24.2
[1G
[1G ! Hello! It looks like your application is using an outdated version of Python.
[1G ! This caused the security warning you saw above during the 'pip install' step.
[1G ! We recommend 'python-3.6.2', which you can specify in a 'runtime.txt' file.
[1G ! -- Much Love, Heroku.
[91mDEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.
[0m
[91mDEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.
[0m[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Traceback (most recent call last):
File "scraper.py", line 84, in <module>
links = get_links(portal)
File "scraper.py", line 24, in get_links
all_links = soup.find('div', {"class":"documentList"})\
AttributeError: 'NoneType' object has no attribute 'find'
Data
Downloaded
4 times
by
To download data sign in with GitHub
rows 10 / 2134
| title | details_download | categories | publishing_date | date | tender_url |
|---|---|---|---|---|---|
|
Annual Procurement Plan 2016
|
|
08/03/2016
|
2016-05-01 20:28:12.296060
|
||
|
AOI - Cameroun - Fourniture d’équipements pour enlèvement des déchets solides - projet d’alimentation en eau potable et d’assainissement en milieu semi-urbain -PAEPA-MSU – 12 2014
|
Cameroon, Agriculture & Agro-industries, Water Supply & Sanitation
|
29/12/2014
|
2016-05-01 20:28:12.296060
|
||
|
IFB - Supply - Installation - Training and Maintenance of Simultaneous Interpretation for the AfDB conference Rooms in the Immeuble Zahrabed Tunis - AfDB/ICB/CGSP/2009/0135
|
|
15/01/2014
|
2016-05-01 20:28:12.296060
|
||
|
IFB - Supply Install and Configure a Storage Area Network (SAN) to Support a Multi-Vendor Dynamic Virtualized Data Centre
|
|
15/01/2014
|
2016-05-01 20:28:12.296060
|
||
|
IFB - Réparation de documents de scanning et numérisation de documents - ADB/RFP/CGSP/2010/0006
|
|
15/01/2014
|
2016-05-01 20:28:12.296060
|
||
|
IFB - The Supply, Installation, Configuration, Commissioning and Maintenance of a Storage Area Network (SAN) - ADB/ICBP/CGSP/2010/0021
|
|
15/01/2014
|
2016-05-01 20:28:12.296060
|
||
|
IFB - Supply, Install and Configure a Storage Area Network (SAN) to Support a Multi-Vendor Dynamic Virtualized Data Center - ADB/CGSP/ICBP/2010/0021
|
|
15/01/2014
|
2016-05-01 20:28:12.296060
|
||
|
IFB - Advertising Services - ADB/CGSP/ICBP/2010/0001
|
|
15/01/2014
|
2016-05-01 20:28:12.296060
|
||
|
IFB - Amendment N°1 - Advertising Services - ADB/CGSP/ICBP/2010/0001
|
Tunisia
|
15/01/2014
|
2016-05-01 20:28:12.296060
|
||
|
IFB - Prequalification Document - Provision of Advertising Services for the AfDB - ADB/CGSP/ICBP/2010/0001
|
|
15/01/2014
|
2016-05-01 20:28:12.296060
|
Statistics
Average successful run time: about 1 hour
Total run time: 3 months
Total cpu time used: 2 days
Total disk space used: 1.66 MB
History
-
Auto
ran
revision
333fbffe
and
failed
.
nothing changed in the database
-
Auto
ran
revision
333fbffe
and
failed
.
nothing changed in the database
-
Auto
ran
revision
333fbffe
and
failed
.
nothing changed in the database
-
Auto
ran
revision
333fbffe
and
failed
.
nothing changed in the database
-
Auto
ran
revision
333fbffe
and
failed
.
nothing changed in the database
- ...
- Created on morph.io