td_ehub

Contributors ErinClark

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.6, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.6 -----> Installing pip -----> Installing requirements with pip  DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 1))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Switched to a new branch 'morph_defaults'  Branch morph_defaults set up to track remote branch morph_defaults from origin.  Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 3))  /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:354: SNIMissingWarning: An HTTPS request has been made, but the SNI (Server Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings  SNIMissingWarning  /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:150: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings  InsecurePlatformWarning  /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:150: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings  InsecurePlatformWarning  Downloading https://files.pythonhosted.org/packages/63/c7/4f2a2a4ad6c6fa99b14be6b3c1cece9142e2d915aa7c43c908677afc8fa4/lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 4))  Downloading https://files.pythonhosted.org/packages/aa/e5/9ee1460d485b94a6d55732eb7ad5b6c084caf73dd6f9cb0bb7d2a78fafe8/cssselect-0.9.1.tar.gz  Collecting beautifulsoup4 (from -r /tmp/build/requirements.txt (line 5))  Downloading https://files.pythonhosted.org/packages/8b/0e/048a2f88bc4be5e3697df9dc1f7b9d5c9c75be62676feeeb91d2e896c5ea/beautifulsoup4-4.7.1-py2-none-any.whl (94kB)  Collecting python-dateutil (from -r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB)  Collecting selenium (from -r /tmp/build/requirements.txt (line 7))  Downloading https://files.pythonhosted.org/packages/80/d6/4294f0b4bce4de0abf13e17190289f9d0613b0a44e5dd6a7f5ca98459853/selenium-3.141.0-py2.py3-none-any.whl (904kB)  Collecting splinter>=0.7.3 (from -r /tmp/build/requirements.txt (line 8))  Downloading https://files.pythonhosted.org/packages/a8/f3/7e8ee6296ea7a6db2deb2355166a372bdc9f2e2de4527b1151c025ca8b62/splinter-0.10.0-py2-none-any.whl  Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/15/27/3330a343de80d6849545b6c7723f8c9a08b4b104de964ac366e7e6b318df/dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/7d/e3/20f3d364d6c8e5d2353c72a67778eb189176f08e873c9900e10c0287b84b/requests-2.21.0-py2.py3-none-any.whl (57kB)  Collecting soupsieve>=1.2 (from beautifulsoup4->-r /tmp/build/requirements.txt (line 5))  Downloading https://files.pythonhosted.org/packages/b9/a5/7ea40d0f8676bde6e464a6435a48bc5db09b1a8f4f06d41dd997b8f3c616/soupsieve-1.9.1-py2.py3-none-any.whl  Collecting six>=1.5 (from python-dateutil->-r /tmp/build/requirements.txt (line 6))  Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl  Collecting urllib3 (from selenium->-r /tmp/build/requirements.txt (line 7))  Downloading https://files.pythonhosted.org/packages/df/1c/59cca3abf96f991f2ec3131a4ffe72ae3d9ea1f5894abe8a9c5e3c77cfee/urllib3-1.24.2-py2.py3-none-any.whl (131kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting idna<2.9,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/60/75/f692a584e85b7eaba0e03827b3d51f45f571c2e793dd731e598828d380aa/certifi-2019.3.9-py2.py3-none-any.whl (158kB)  Collecting backports.functools-lru-cache; python_version < "3" (from soupsieve>=1.2->beautifulsoup4->-r /tmp/build/requirements.txt (line 5))  Downloading https://files.pythonhosted.org/packages/03/8e/2424c0e65c4a066e28f539364deee49b6451f8fcd4f718fefa50cc3dcf48/backports.functools_lru_cache-1.5-py2.py3-none-any.whl  Installing collected packages: dumptruck, chardet, idna, certifi, urllib3, requests, scraperwiki, lxml, cssselect, backports.functools-lru-cache, soupsieve, beautifulsoup4, six, python-dateutil, selenium, splinter  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Successfully installed backports.functools-lru-cache-1.5 beautifulsoup4-4.7.1 certifi-2019.3.9 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 idna-2.8 lxml-3.4.4 python-dateutil-2.8.0 requests-2.21.0 scraperwiki selenium-3.141.0 six-1.12.0 soupsieve-1.9.1 splinter-0.10.0 urllib3-1.24.2   ! Hello! It looks like your application is using an outdated version of Python.  ! This caused the security warning you saw above during the 'pip install' step.  ! We recommend 'python-3.6.2', which you can specify in a 'runtime.txt' file.  ! -- Much Love, Heroku. DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.  DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... https://www.e-hub.com/epublic/TenderResults.asp?id=143335&logo=17 Traceback (most recent call last): File "scraper.py", line 103, in <module> links = get_links(portal,base_url) File "scraper.py", line 19, in get_links tenders = soup.find('table', width="700").findNext('table', width="700").findAll('input', type="button") AttributeError: 'NoneType' object has no attribute 'findNext'

Data

Downloaded 4 times by MikeRalphson ErinClark

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1000 KB) Use the API

rows 10 / 733

closing_date entity date auth_town procedure_type category auth_postcode tender_url auth_country contact_attention_of auth_attention_of description contact_website contact_address auth_organisation issue_date notice_type contact_organisation title contact_town contact_email status auth_phone auth_address contact_postcode auth_email contact_phone contact_country auth_website
10 Oct 2017 [12 Noon]
Local Authority
2017-09-27 03:48:22.495372
Newry (contracting authority)
Open
Business & Consulting Services
BT34 2QU (contracting authority)
UK (contracting authority)
Clerk & Chief Executive (contact)
Clerk & Chief Executive (contracting authority)
Newry, Mourne and Down District Council invite quotation submissions from competent Suppliers to deliver a Civic Leadership Programme (Partnership Development Programme), under the ''''Building Positive Relations Theme''''. Submissions are to be based on the advised documentation/information available via the NM&DDC e-Portal under Buyer Attachments for this quotation request. (contracting authority)
www.newryandmourne.gov.uk (contact)
District Council Offices M. Row,O'Hagan House, Monaghan Row, (contact)
Newry, Mourne & Down DC (contracting authority)
26 Sep 2017
ServiceA
Newry, Mourne & Down DC (contact)
D22 Q1924 - Civic Leadership Programme (Partnership Development Programme).
Newry (contact)
david.barter@nmandd.org (contact)
Published
+44 (0)28 3031 3280 (contracting authority)
District Council Offices Greenbank,Central Stores, Unit 19 Rampart Road,Greenbank Industrial Estate (contracting authority)
BT35 8DJ (contact)
david.barter@nmandd.org (contracting authority)
+44 (0)28 3031 3280 (contact)
UK (contact)
www.newryandmourne.gov.uk (contracting authority)
5 Apr 2019 [12 Noon]
Local Authority
2019-03-27 08:10:32.423237
Newry (contracting authority)
Open
Services & Supplies
BT34 2QU (contracting authority)
UK (contracting authority)
Clerk & Chief Executive (contact)
Clerk & Chief Executive (contracting authority)
Newry, Mourne and Down District Council invite submissions for Q2067 - ''Supplier to Provide Creative Production Services for the Footsteps in the Forest Festival on Saturday 1st and Sunday 2nd June 2019''. Submissions are to be based on the advised documentation/information available via the NM&DDC e-Portal under Buyer Specification for this process request. (contracting authority)
www.newryandmourne.gov.uk (contact)
District Council Offices M. Row,O'Hagan House, Monaghan Row, (contact)
Newry, Mourne & Down DC (contracting authority)
25 Mar 2019
ServiceA
Newry, Mourne & Down DC (contact)
D23 Q2067 - Supplier to Provide Creative Production Services for the Footsteps in the Forest Festival on Saturday 1st and Sunday 2nd June 2019
Newry (contact)
david.barter@nmandd.org (contact)
Published
+44 (0)28 3031 3280 (contracting authority)
District Council Offices Greenbank,Central Stores, Unit 19 Rampart Road,Greenbank Industrial Estate (contracting authority)
BT35 8DJ (contact)
david.barter@nmandd.org (contracting authority)
+44 (0)28 3031 3280 (contact)
UK (contact)
www.newryandmourne.gov.uk (contracting authority)
5 Apr 2019 [12 Noon]
Local Authority
2019-03-27 08:10:32.423237
Newry (contracting authority)
Open
Services & Supplies
BT34 2QU (contracting authority)
UK (contracting authority)
Clerk & Chief Executive (contact)
Clerk & Chief Executive (contracting authority)
Newry, Mourne and Down District Council invite submissions for Tender 71/2018 - ''Provision of Internal Audit Services''. Submissions are to be based on the advised documentation/information available via the NM&DDC e-Portal under Buyer Specification for this process request. (contracting authority)
www.newryandmourne.gov.uk (contact)
District Council Offices M. Row,O'Hagan House, Monaghan Row, (contact)
Newry, Mourne & Down DC (contracting authority)
1 Mar 2019
ServiceA
Newry, Mourne & Down DC (contact)
Tender 71/2018 - Provision of Internal Audit Services
Newry (contact)
david.barter@nmandd.org (contact)
Published
+44 (0)28 3031 3280 (contracting authority)
District Council Offices Greenbank,Central Stores, Unit 19 Rampart Road,Greenbank Industrial Estate (contracting authority)
BT35 8DJ (contact)
david.barter@nmandd.org (contracting authority)
+44 (0)28 3031 3280 (contact)
UK (contact)
www.newryandmourne.gov.uk (contracting authority)
1 Apr 2019 [12 Noon]
Local Authority
2019-03-27 08:10:32.423237
Newry (contracting authority)
Open
Specialist Works
BT34 2QU (contracting authority)
UK (contracting authority)
Clerk & Chief Executive (contact)
Clerk & Chief Executive (contracting authority)
Newry, Mourne and Down District Council invite submissions for RFQ Q2062 - ''Supply, Installation & Commissioning of a New IP CCTV System in the New Downpatrick Household Recycling Centre, 44 Flying Horse Road, Downpatrick, BT30 6QW''. Submissions are to be based on the advised documentation/information available via the NM&DDC e-Portal under Buyer Specification for this process request. (contracting authority)
www.newryandmourne.gov.uk (contact)
District Council Offices M. Row,O'Hagan House, Monaghan Row, (contact)
Newry, Mourne & Down DC (contracting authority)
11 Mar 2019
Works
Newry, Mourne & Down DC (contact)
D23 Q2062 - Supply, Installation & Commissioning of a New IP CCTV System in the New Downpatrick Household Recycling Centre, 44 Flying Horse Road, Downpatrick, BT30 6QW
Newry (contact)
david.barter@nmandd.org (contact)
Published
+44 (0)28 3031 3280 (contracting authority)
District Council Offices Greenbank,Central Stores, Unit 19 Rampart Road,Greenbank Industrial Estate (contracting authority)
BT35 8DJ (contact)
david.barter@nmandd.org (contracting authority)
+44 (0)28 3031 3280 (contact)
UK (contact)
www.newryandmourne.gov.uk (contracting authority)
29 Mar 2019 [12 Noon]
Local Authority
2019-03-27 08:10:32.423237
Newry (contracting authority)
Open
Other Services & Supplies
BT34 2QU (contracting authority)
UK (contracting authority)
Clerk & Chief Executive (contact)
Clerk & Chief Executive (contracting authority)
Newry, Mourne and Down District Council invite Tender submissions for the Provision of Valuation Services. Submissions are to be based on the advised documentation/information available via the NM&DDC e-Portal under ‘Buyer Attachment/Specification’ for this process request. (contracting authority)
www.newryandmourne.gov.uk (contact)
District Council Offices M. Row,O'Hagan House, Monaghan Row, (contact)
Newry, Mourne & Down DC (contracting authority)
28 Feb 2019
ServiceA
Newry, Mourne & Down DC (contact)
Tender 67/2018 - Provision of Valuation Services
Newry (contact)
david.barter@nmandd.org (contact)
Published
+44 (0)28 3031 3280 (contracting authority)
District Council Offices Greenbank,Central Stores, Unit 19 Rampart Road,Greenbank Industrial Estate (contracting authority)
BT35 8DJ (contact)
david.barter@nmandd.org (contracting authority)
+44 (0)28 3031 3280 (contact)
UK (contact)
www.newryandmourne.gov.uk (contracting authority)
26 Mar 2019 [12 Noon]
Local Authority
2019-03-27 08:10:32.423237
Newry (contracting authority)
Open
Works
BT34 2QU (contracting authority)
UK (contracting authority)
Clerk & Chief Executive (contact)
Clerk & Chief Executive (contracting authority)
Newry, Mourne and Down District Council invite submissions for the supply and installation of a Kitchen, Kitchen Equipment and other Associated Services at Dan Rice Hall, Drumaness Road, Co Down. Submissions are to be based on the advised documentation/information available via the NM&DDC e-Portal under ‘Buyer Attachment/Specification’ for this process request. (contracting authority)
www.newryandmourne.gov.uk (contact)
District Council Offices M. Row,O'Hagan House, Monaghan Row, (contact)
Newry, Mourne & Down DC (contracting authority)
12 Mar 2019
Works
Newry, Mourne & Down DC (contact)
D23Q2065 (Retender) Kitchen, Dan Rice Hall, Drumaness Road, Co Down
Newry (contact)
david.barter@nmandd.org (contact)
Closed
+44 (0)28 3031 3280 (contracting authority)
District Council Offices Greenbank,Central Stores, Unit 19 Rampart Road,Greenbank Industrial Estate (contracting authority)
BT35 8DJ (contact)
david.barter@nmandd.org (contracting authority)
+44 (0)28 3031 3280 (contact)
UK (contact)
www.newryandmourne.gov.uk (contracting authority)
25 Mar 2019 [12 Noon]
Local Authority
2019-03-27 08:10:32.423237
Newry (contracting authority)
Open
Services & Supplies
BT34 2QU (contracting authority)
UK (contracting authority)
Clerk & Chief Executive (contact)
Clerk & Chief Executive (contracting authority)
Newry, Mourne and Down District Council invite submissions for ''Tender 77 - Commercial Cleaning of Council Buildings''. Submissions are to be based on the advised documentation/information available via the NM&DDC e-Portal under Buyer Specification for this process request. (contracting authority)
www.newryandmourne.gov.uk (contact)
District Council Offices M. Row,O'Hagan House, Monaghan Row, (contact)
Newry, Mourne & Down DC (contracting authority)
25 Mar 2019
ServiceA
Newry, Mourne & Down DC (contact)
Tender 77 - Commercial Cleaning of Council Buildings
Newry (contact)
david.barter@nmandd.org (contact)
Closed
+44 (0)28 3031 3280 (contracting authority)
District Council Offices Greenbank,Central Stores, Unit 19 Rampart Road,Greenbank Industrial Estate (contracting authority)
BT35 8DJ (contact)
david.barter@nmandd.org (contracting authority)
+44 (0)28 3031 3280 (contact)
UK (contact)
www.newryandmourne.gov.uk (contracting authority)
22 Mar 2019 [12 Noon]
Local Authority
2019-03-27 08:10:32.423237
Newry (contracting authority)
Open
Catering & Food
BT34 2QU (contracting authority)
UK (contracting authority)
Clerk & Chief Executive (contact)
Clerk & Chief Executive (contracting authority)
Newry, Mourne and Down District Council invite submissions for ''Tender 66/2018 - Operation of 1 No. Trading Pitch (Ice Cream Provision) at Slieve Gullion Forest Park''. Submissions are to be based on the advised documentation/information available via the NM&DDC e-Portal under Buyer Specification for this process request. (contracting authority)
www.newryandmourne.gov.uk (contact)
District Council Offices M. Row,O'Hagan House, Monaghan Row, (contact)
Newry, Mourne & Down DC (contracting authority)
1 Mar 2019
ServiceA
Newry, Mourne & Down DC (contact)
Tender 66/2018 - Operation of 1 No. Trading Pitch (Ice Cream Provision) at Slieve Gullion Forest Park
Newry (contact)
david.barter@nmandd.org (contact)
Closed
+44 (0)28 3031 3280 (contracting authority)
District Council Offices Greenbank,Central Stores, Unit 19 Rampart Road,Greenbank Industrial Estate (contracting authority)
BT35 8DJ (contact)
david.barter@nmandd.org (contracting authority)
+44 (0)28 3031 3280 (contact)
UK (contact)
www.newryandmourne.gov.uk (contracting authority)
15 Mar 2019 [6:00 PM]
Local Authority
2019-03-27 08:10:32.423237
Newry (contracting authority)
Open
Building
BT34 2QU (contracting authority)
UK (contracting authority)
Clerk & Chief Executive (contact)
Clerk & Chief Executive (contracting authority)
Are you interested in construction opportunities with Newry, Mourne and Down District Council? Why not come along and meet the Capital Projects Team at our ‘Meet the Buyer’ workshop on Wednesday 20th March (Breakfast Workshop 8-10am - Kings Inn 28-30 Lower Square Castlewellan BT31 9DW) (contracting authority)
www.newryandmourne.gov.uk (contact)
District Council Offices M. Row,O'Hagan House, Monaghan Row, (contact)
Newry, Mourne & Down DC (contracting authority)
5 Mar 2019
Works
Newry, Mourne & Down DC (contact)
INVITATION TO A CONSTRUCTION MEET THE BUYER EVENT 20TH MARCH 2019 (8-10am)
Newry (contact)
david.barter@nmandd.org (contact)
Closed
+44 (0)28 3031 3280 (contracting authority)
District Council Offices Greenbank,Central Stores, Unit 19 Rampart Road,Greenbank Industrial Estate (contracting authority)
BT35 8DJ (contact)
david.barter@nmandd.org (contracting authority)
+44 (0)28 3031 3280 (contact)
UK (contact)
www.newryandmourne.gov.uk (contracting authority)
15 Mar 2019 [12 Noon]
Local Authority
2019-03-27 08:10:32.423237
Newry (contracting authority)
Open
Building
BT34 2QU (contracting authority)
UK (contracting authority)
Clerk & Chief Executive (contact)
Clerk & Chief Executive (contracting authority)
Newry, Mourne and Down District Council invite submissions for ''Q2059 - Refurbishment of Cloughreagh & Bessbrook Community Centres''. Submissions are to be based on the advised documentation/information available via the NM&DDC e-Portal under Buyer Specification for this process request. (contracting authority)
www.newryandmourne.gov.uk (contact)
District Council Offices M. Row,O'Hagan House, Monaghan Row, (contact)
Newry, Mourne & Down DC (contracting authority)
1 Mar 2019
Works
Newry, Mourne & Down DC (contact)
D23 Q2059 - Refurbishment of Cloughreagh & Bessbrook Community Centres
Newry (contact)
david.barter@nmandd.org (contact)
Closed
+44 (0)28 3031 3280 (contracting authority)
District Council Offices Greenbank,Central Stores, Unit 19 Rampart Road,Greenbank Industrial Estate (contracting authority)
BT35 8DJ (contact)
david.barter@nmandd.org (contracting authority)
+44 (0)28 3031 3280 (contact)
UK (contact)
www.newryandmourne.gov.uk (contracting authority)

Statistics

Average successful run time: 17 minutes

Total run time: 16 days

Total cpu time used: 1 day

Total disk space used: 1.01 MB

History

  • Auto ran revision 65fbced8 and failed .
    nothing changed in the database
  • Auto ran revision 65fbced8 and failed .
    nothing changed in the database
  • Auto ran revision 65fbced8 and failed .
    nothing changed in the database
  • Auto ran revision 65fbced8 and failed .
    nothing changed in the database
  • Auto ran revision 65fbced8 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

td_ehub / scraper.py