tdetendersni

Contributors ErinClark

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.6, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.6 -----> Installing pip -----> Installing requirements with pip  DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 1))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Switched to a new branch 'morph_defaults'  Branch morph_defaults set up to track remote branch morph_defaults from origin.  Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 3))  /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:354: SNIMissingWarning: An HTTPS request has been made, but the SNI (Server Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings  SNIMissingWarning  /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:150: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings  InsecurePlatformWarning  /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:150: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings  InsecurePlatformWarning  Downloading https://files.pythonhosted.org/packages/63/c7/4f2a2a4ad6c6fa99b14be6b3c1cece9142e2d915aa7c43c908677afc8fa4/lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 4))  Downloading https://files.pythonhosted.org/packages/aa/e5/9ee1460d485b94a6d55732eb7ad5b6c084caf73dd6f9cb0bb7d2a78fafe8/cssselect-0.9.1.tar.gz  Collecting beautifulsoup4 (from -r /tmp/build/requirements.txt (line 5))  Downloading https://files.pythonhosted.org/packages/8b/0e/048a2f88bc4be5e3697df9dc1f7b9d5c9c75be62676feeeb91d2e896c5ea/beautifulsoup4-4.7.1-py2-none-any.whl (94kB)  Collecting python-dateutil (from -r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB)  Collecting selenium (from -r /tmp/build/requirements.txt (line 7))  Downloading https://files.pythonhosted.org/packages/80/d6/4294f0b4bce4de0abf13e17190289f9d0613b0a44e5dd6a7f5ca98459853/selenium-3.141.0-py2.py3-none-any.whl (904kB)  Collecting splinter>=0.7.3 (from -r /tmp/build/requirements.txt (line 8))  Downloading https://files.pythonhosted.org/packages/a8/f3/7e8ee6296ea7a6db2deb2355166a372bdc9f2e2de4527b1151c025ca8b62/splinter-0.10.0-py2-none-any.whl  Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/15/27/3330a343de80d6849545b6c7723f8c9a08b4b104de964ac366e7e6b318df/dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/7d/e3/20f3d364d6c8e5d2353c72a67778eb189176f08e873c9900e10c0287b84b/requests-2.21.0-py2.py3-none-any.whl (57kB)  Collecting soupsieve>=1.2 (from beautifulsoup4->-r /tmp/build/requirements.txt (line 5))  Downloading https://files.pythonhosted.org/packages/b9/a5/7ea40d0f8676bde6e464a6435a48bc5db09b1a8f4f06d41dd997b8f3c616/soupsieve-1.9.1-py2.py3-none-any.whl  Collecting six>=1.5 (from python-dateutil->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl  Collecting urllib3 (from selenium->-r /tmp/build/requirements.txt (line 7))  Downloading https://files.pythonhosted.org/packages/df/1c/59cca3abf96f991f2ec3131a4ffe72ae3d9ea1f5894abe8a9c5e3c77cfee/urllib3-1.24.2-py2.py3-none-any.whl (131kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting idna<2.9,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/60/75/f692a584e85b7eaba0e03827b3d51f45f571c2e793dd731e598828d380aa/certifi-2019.3.9-py2.py3-none-any.whl (158kB)  Collecting backports.functools-lru-cache; python_version < "3" (from soupsieve>=1.2->beautifulsoup4->-r /tmp/build/requirements.txt (line 5))  Downloading https://files.pythonhosted.org/packages/03/8e/2424c0e65c4a066e28f539364deee49b6451f8fcd4f718fefa50cc3dcf48/backports.functools_lru_cache-1.5-py2.py3-none-any.whl  Installing collected packages: dumptruck, chardet, idna, certifi, urllib3, requests, scraperwiki, lxml, cssselect, backports.functools-lru-cache, soupsieve, beautifulsoup4, six, python-dateutil, selenium, splinter  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Successfully installed backports.functools-lru-cache-1.5 beautifulsoup4-4.7.1 certifi-2019.3.9 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 idna-2.8 lxml-3.4.4 python-dateutil-2.8.0 requests-2.21.0 scraperwiki selenium-3.141.0 six-1.12.0 soupsieve-1.9.1 splinter-0.10.0 urllib3-1.24.2   ! Hello! It looks like your application is using an outdated version of Python.  ! This caused the security warning you saw above during the 'pip install' step.  ! We recommend 'python-3.6.2', which you can specify in a 'runtime.txt' file.  ! -- Much Love, Heroku. DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.  DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 59, in <module> browser = Browser("phantomjs", service_args=['--ignore-ssl-errors=true', '--ssl-protocol=any']) File "/app/.heroku/python/lib/python2.7/site-packages/splinter/browser.py", line 63, in Browser raise DriverNotFoundError("No driver for %s" % driver_name) splinter.exceptions.DriverNotFoundError: No driver for phantomjs

Data

Downloaded 5 times by MikeRalphson ErinClark

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3.98 MB) Use the API

rows 10 / 3275

contract_award_date multiple_tenders_allowed invitations_deadline nuts_codes inclusion_of_e_auctions title online_eoi_allowed contract_awarded_in_lots evaluation_mechanism date_of_publication cft_ca_unique_id tender_url description deadline end_clarification_period procurement_type above_below_ojeu_threshold resource_id eu_funding award_per_item est_value participating_bodies publication_of_notice cpv_codes publish_on_behalf_of time_limit contract_duration contact_point date_accepted_by_contractor upload_docs_with_clarification procedure validity_of_tender tenders_opening_date buyer_organisation cpc_category cft_involves ojeu_link
No
05/02/2016 00:00
UKN0
No
24.25.0016 - Strangford House Newtownards Office Accommodation Works
Yes
No
Lowest Price
08/01/2016 11:48
NIHE-100
45210000-Building construction work 45262700-Building alteration work
29/01/2016 12:00
Works
Below
resourceId=230311
No
No
443,388
45210000-Building construction work 45262700-Building alteration work
29/01/2016 12:00
3 months
Procurement@nihe.gov.uk
Yes
Restricted
6 months
29/01/2016 12:30
Northern Ireland Housing Executive
A Public Contract
No
28/01/2016 00:00
UKN0
No
SE225760-E CCTV Installations at Ards Hospital
Yes
No
Lowest Price
07/01/2016 14:13
CPDHP-61
45215140-Hospital facilities construction work
21/01/2016 15:00
Works
Below
resourceId=225760
No
No
60,000
South Eastern Health and Social Care Trust
45215140-Hospital facilities construction work
Department of Health Social Services and Public Safety NI
21/01/2016 15:00
3 months
etendersni.healthprojects@dfpni.gov.uk
Yes
Restricted
90 days
21/01/2016 15:30
CPD - Construction Health Projects
A Public Contract
No
No
Refurbish ICU Kitchen and Redesign Dirty Utility Area – Antrim Area Hospital
Yes
No
Lowest Price
04/01/2016 17:09
CPDHP-58
71221000-Architectural services for buildings
11/01/2016 15:00
Services
Below
resourceId=224876
No
No
5,000
71221000-Architectural services for buildings
18/01/2016 15:00
7 months
Yes
Restricted
90 days
18/01/2016 15:30
CPD - Construction Health Projects
Architectural services; engineering services and integrated engineering services...
A Public Contract
No
04/02/2016 00:00
UKN0
No
SE240639B - Refurbishment of meeting room Ulster Hospital
Yes
No
Lowest Price
15/01/2016 14:03
CPDHP-69
45215140-Hospital facilities construction work
28/01/2016 15:00
Works
Below
resourceId=240639
No
No
60,000
South Eastern Health and Social Care Trust
45215140-Hospital facilities construction work
Department of Health Social Services and Public Safety NI
28/01/2016 15:00
1 months
etendersni.healthprojects@dfpni.gov.uk
Yes
Restricted
90 days
28/01/2016 15:30
CPD - Construction Health Projects
A Public Contract
No
UK
No
IF013 Compressor and Blower Framework
Yes
No
MEAT
11/10/2015 11:20
NIW-7
42996000-Machinery for the treatment of sewage
13/11/2015 12:00
Supplies
Above
resourceId=61130
No
No
42996000-Machinery for the treatment of sewage
13/11/2015 12:00
5 years
michael.mccarter1@niwater.com
Yes
Negotiated with advertisement
90 days
13/11/2015 12:30
NI Water
The establishment of a framework agreement
No
UKN
No
South Eastern HSC Trust - Refurbishment of lift cars at Peadiatric Block Ulster Hospital Dundonald
Yes
No
Lowest Price
13/01/2016 16:30
CPDHP-71
42416100-Lifts 45313000-Lift and escalator installation work 45313100-Lift installation work 50750000-Lift-maintenance services
28/01/2016 15:00
Works
Below
resourceId=238497
No
No
180,000
South Eastern Health and Social Care Trust
42416100-Lifts 45313000-Lift and escalator installation work 45313100-Lift installation work 50750000-Lift-maintenance services
Department of Health Social Services and Public Safety NI
28/01/2016 15:00
4 months
patrick.toal@setrust.hscni.net
Yes
Restricted
90 days
28/01/2016 15:30
CPD - Construction Health Projects
A Public Contract
No
UKN UKN0
No
SEHSCT MTC for Asbestos Removal and Encapsulation
Yes
No
Lowest Price
13/01/2016 16:30
CPDHP-70
45262660-Asbestos-removal work
27/01/2016 15:00
Works
Below
resourceId=238464
No
No
2,000,000
South Eastern Health and Social Care Trust
45262660-Asbestos-removal work
Department of Health Social Services and Public Safety NI
29/01/2016 15:00
48 months
Yes
Restricted
90 days
29/01/2016 15:30
CPD - Construction Health Projects
The establishment of a framework agreement
No
UKN
No
SE185446-MTC Framework for Building Maintenance and Minor Building Works For South Eastern Health and Social Care Trust
Yes
Yes
MEAT
04/12/2015 11:00
CPDHP-50
45215140-Hospital facilities construction work 45215100-Construction work for buildings relating to health
23/12/2015 15:00
Works
Above
resourceId=185446
No
Yes
4,500,000
South Eastern Health and Social Care Trust
45215140-Hospital facilities construction work 45215100-Construction work for buildings relating to health
Department of Health Social Services and Public Safety NI
22/01/2016 15:00
48 months
Yes
Restricted
180 days
22/01/2016 15:30
CPD - Construction Health Projects
The establishment of a framework agreement
No
No
Aids and Adaptations Minor Building Works within private dwellings
Yes
No
Lowest Price
21/01/2016 15:58
CPDHP-70
45421153-Installation of built-in furniture
29/01/2016 15:00
Works
Below
resourceId=242386
No
No
600,000
45421153-Installation of built-in furniture
05/02/2016 15:00
2 years
Yes
Restricted
90 days
05/02/2016 15:30
CPD - Construction Health Projects
The establishment of a framework agreement
No
28/01/2016 00:00
UKN0
No
WE212489-B - Development of Admin Space, Admin Building, Altnagelvin Hospital
Yes
No
Lowest Price
17/12/2015 11:52
CPDHP-56
45215140-Hospital facilities construction work
21/01/2016 15:00
Works
Below
resourceId=212489
No
No
140,000
Western Health and Social Care Trust
45215140-Hospital facilities construction work
Department of Health Social Services and Public Safety NI
21/01/2016 15:00
4 months
etendersni.healthprojects@dfpni.gov.uk
Yes
Restricted
90 days
21/01/2016 15:30
CPD - Construction Health Projects
A Public Contract

Statistics

Average successful run time: about 1 hour

Total run time: 2 months

Total cpu time used: 3 days

Total disk space used: 4.01 MB

History

  • Auto ran revision 934b8e29 and failed .
    nothing changed in the database
  • Auto ran revision 934b8e29 and failed .
    nothing changed in the database
  • Auto ran revision 934b8e29 and failed .
    nothing changed in the database
  • Auto ran revision 934b8e29 and failed .
    nothing changed in the database
  • Auto ran revision 934b8e29 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

td_etenders_ni / scraper.py