Injecting configuration and compiling...
[1G [1G-----> Python app detected
[1G ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.6, which is unsupported).
[1G ! We recommend upgrading by specifying the latest version (python-2.7.14).
[1G Learn More: https://devcenter.heroku.com/articles/python-runtimes
[1G-----> Installing python-2.7.6
[1G-----> Installing pip
[1G-----> Installing requirements with pip
[1G DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
[1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 1))
[1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki
[1G Running command git clone -q http://github.com/openaustralia/scraperwiki-python.git /app/.heroku/src/scraperwiki
[1G Running command git checkout -b morph_defaults --track origin/morph_defaults
[1G Switched to a new branch 'morph_defaults'
[1G Branch morph_defaults set up to track remote branch morph_defaults from origin.
[1G /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:380: SNIMissingWarning: An HTTPS request has been made, but the SNI (Server Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
[1G SNIMissingWarning,
[1G /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:139: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
[1G InsecurePlatformWarning,
[1G Collecting python-dateutil==2.1
[1G /app/.heroku/python/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py:139: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
[1G InsecurePlatformWarning,
[1G Downloading https://files.pythonhosted.org/packages/65/52/9c18dac21f174ad31b65e22d24297864a954e6fe65876eba3f5773d2da43/python-dateutil-2.1.tar.gz (152kB)
[1G Collecting BeautifulSoup==3.2.1
[1G Downloading https://files.pythonhosted.org/packages/1e/ee/295988deca1a5a7accd783d0dfe14524867e31abb05b6c0eeceee49c759d/BeautifulSoup-3.2.1.tar.gz
[1G Collecting unidecode==0.4.16
[1G Downloading https://files.pythonhosted.org/packages/ec/d8/97c4c7ed5ad3cd2511d8896b2973b1f403110e07b38ea310f8703ba8485f/Unidecode-0.04.16.tar.gz (200kB)
[1G Collecting dumptruck>=0.1.2
[1G Downloading https://files.pythonhosted.org/packages/15/27/3330a343de80d6849545b6c7723f8c9a08b4b104de964ac366e7e6b318df/dumptruck-0.1.6.tar.gz
[1G Collecting requests
[1G Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB)
[1G Collecting six
[1G Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl
[1G Collecting chardet<3.1.0,>=3.0.2
[1G Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)
[1G Collecting idna<2.9,>=2.5
[1G Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)
[1G Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
[1G Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB)
[1G Collecting certifi>=2017.4.17
[1G Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB)
[1G Building wheels for collected packages: python-dateutil, BeautifulSoup, unidecode, dumptruck
[1G Building wheel for python-dateutil (setup.py): started
[1G Building wheel for python-dateutil (setup.py): finished with status 'done'
[1G Created wheel for python-dateutil: filename=python_dateutil-2.1-cp27-none-any.whl size=119902 sha256=ef5284e1ed51cf6d5f91fbaa71251835d5407ee2481525d173d8b5854e21db52
[1G Stored in directory: /tmp/pip-ephem-wheel-cache-M8HGf7/wheels/a3/b4/9e/be446328c3728631f286e9cc832b8b00ca99480eefa1a6db4e
[1G Building wheel for BeautifulSoup (setup.py): started
[1G Building wheel for BeautifulSoup (setup.py): finished with status 'done'
[1G Created wheel for BeautifulSoup: filename=BeautifulSoup-3.2.1-cp27-none-any.whl size=31960 sha256=c98eb3a589afc06ceb3b6da8bda8ef904c91de5fc9731e8031ad43d05f462a56
[1G Stored in directory: /tmp/pip-ephem-wheel-cache-M8HGf7/wheels/74/d2/0b/8ef02aab9e15c6e5158d7aee909adab931a9c54920e99f468e
[1G Building wheel for unidecode (setup.py): started
[1G Building wheel for unidecode (setup.py): finished with status 'done'
[1G Created wheel for unidecode: filename=Unidecode-0.4.16-cp27-none-any.whl size=228248 sha256=838e660aae04592e099cf1294803d32ab4156e0b80b114ed6a22e68c4ba75b70
[1G Stored in directory: /tmp/pip-ephem-wheel-cache-M8HGf7/wheels/11/39/a6/61c25c7caa30123280d52e1064a30253b9a909a741361dbd26
[1G Building wheel for dumptruck (setup.py): started
[1G Building wheel for dumptruck (setup.py): finished with status 'done'
[1G Created wheel for dumptruck: filename=dumptruck-0.1.6-cp27-none-any.whl size=11845 sha256=26ecf5f6b8d51e684721565062bdee39b90547e240719b0596aa2e696160d885
[1G Stored in directory: /tmp/pip-ephem-wheel-cache-M8HGf7/wheels/57/df/83/32654ae89119876c7a7db66829bbdb646caa151589dbaf226e
[1G Successfully built python-dateutil BeautifulSoup unidecode dumptruck
[1G Installing collected packages: dumptruck, chardet, idna, urllib3, certifi, requests, scraperwiki, six, python-dateutil, BeautifulSoup, unidecode
[1G Running setup.py develop for scraperwiki
[1G Successfully installed BeautifulSoup-3.2.1 certifi-2019.11.28 chardet-3.0.4 dumptruck-0.1.6 idna-2.8 python-dateutil-2.1 requests-2.22.0 scraperwiki six-1.13.0 unidecode-0.4.16 urllib3-1.25.7
[1G
[1G ! Hello! It looks like your application is using an outdated version of Python.
[1G ! This caused the security warning you saw above during the 'pip install' step.
[1G ! We recommend 'python-3.6.2', which you can specify in a 'runtime.txt' file.
[1G ! -- Much Love, Heroku.
[91mDEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
[0m
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
Loading previous entries...
Found 1863 urls
Starting at http://tinyletter.com/realfuture/letters/from-fuld-hall-to-olden-farm-witnessed-enviously
Currently have 1863 entries
Starting at http://tinyletter.com/realfuture/letters/from-fuld-hall-to-olden-farm-witnessed-enviously
http://tinyletter.com/realfuture/letters/from-fuld-hall-to-olden-farm-witnessed-enviously
Traceback (most recent call last):
File "scraper.py", line 144, in <module>
main()
File "scraper.py", line 141, in main
io(starturl, urls, inds)
File "scraper.py", line 106, in io
dt, ts, new_url = load(next_url)
File "scraper.py", line 76, in load
dt, contents, next_url = parse(read(url))
File "scraper.py", line 31, in read
response = urllib2.urlopen(url)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 127, in urlopen
return _opener.open(url, data, timeout)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open
response = meth(req, response)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response
'http', request, response, code, msg, hdrs)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 442, in error
result = self._call_chain(*args)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain
result = func(*args)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 629, in http_error_302
return self.parent.open(new, timeout=req.timeout)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open
response = meth(req, response)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response
'http', request, response, code, msg, hdrs)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 448, in error
return self._call_chain(*args)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain
result = func(*args)
File "/app/.heroku/python/lib/python2.7/urllib2.py", line 531, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
urllib2.HTTPError: HTTP Error 404: Not found