meashishsaini / indian_lok_sabha_all_party_list

All Parties of Indian Lok Sabha


Contributors meashishsaini

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.14 -----> Installing pip -----> Installing requirements with pip  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to /app/.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting scrapy==1.3.0 (from -r /tmp/build/requirements.txt (line 10))  Downloading Scrapy-1.3.0-py2.py3-none-any.whl (239kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting PyDispatcher>=2.0.5 (from scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading PyDispatcher-2.0.5.tar.gz  Collecting Twisted>=13.1.0 (from scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading Twisted-17.9.0.tar.bz2 (3.0MB)  Collecting pyOpenSSL (from scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading pyOpenSSL-17.5.0-py2.py3-none-any.whl (53kB)  Collecting queuelib (from scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading queuelib-1.4.2-py2.py3-none-any.whl  Collecting w3lib>=1.15.0 (from scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading w3lib-1.18.0-py2.py3-none-any.whl  Collecting parsel>=0.9.5 (from scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading parsel-1.3.1-py2.py3-none-any.whl  Collecting service-identity (from scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading service_identity-17.0.0-py2.py3-none-any.whl  Collecting six>=1.5.2 (from scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading six-1.11.0-py2.py3-none-any.whl  Collecting idna<2.7,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading idna-2.6-py2.py3-none-any.whl (56kB)  Collecting urllib3<1.23,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading certifi-2017.11.5-py2.py3-none-any.whl (330kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6))  Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting zope.interface>=3.6.0 (from Twisted>=13.1.0->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading zope.interface-4.4.3-cp27-cp27mu-manylinux1_x86_64.whl (170kB)  Collecting constantly>=15.1 (from Twisted>=13.1.0->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading constantly-15.1.0-py2.py3-none-any.whl  Collecting incremental>=16.10.1 (from Twisted>=13.1.0->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading incremental-17.5.0-py2.py3-none-any.whl  Collecting Automat>=0.3.0 (from Twisted>=13.1.0->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading Automat-0.6.0-py2.py3-none-any.whl  Collecting hyperlink>=17.1.1 (from Twisted>=13.1.0->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading hyperlink-17.3.1-py2.py3-none-any.whl (73kB)  Collecting cryptography>=2.1.4 (from pyOpenSSL->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading cryptography-2.1.4-cp27-cp27mu-manylinux1_x86_64.whl (2.2MB)  Collecting pyasn1 (from service-identity->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading pyasn1-0.4.2-py2.py3-none-any.whl (71kB)  Collecting pyasn1-modules (from service-identity->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading pyasn1_modules-0.2.1-py2.py3-none-any.whl (60kB)  Collecting attrs (from service-identity->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading attrs-17.4.0-py2.py3-none-any.whl  Collecting cffi>=1.7; platform_python_implementation != "PyPy" (from cryptography>=2.1.4->pyOpenSSL->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading cffi-1.11.2-cp27-cp27mu-manylinux1_x86_64.whl (405kB)  Collecting enum34; python_version < "3" (from cryptography>=2.1.4->pyOpenSSL->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading enum34-1.1.6-py2-none-any.whl  Collecting asn1crypto>=0.21.0 (from cryptography>=2.1.4->pyOpenSSL->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading asn1crypto-0.24.0-py2.py3-none-any.whl (101kB)  Collecting ipaddress; python_version < "3" (from cryptography>=2.1.4->pyOpenSSL->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading ipaddress-1.0.19.tar.gz  Collecting pycparser (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=2.1.4->pyOpenSSL->scrapy==1.3.0->-r /tmp/build/requirements.txt (line 10))  Downloading pycparser-2.18.tar.gz (245kB)  Installing collected packages: dumptruck, idna, urllib3, certifi, chardet, requests, scraperwiki, lxml, cssselect, PyDispatcher, zope.interface, constantly, incremental, six, attrs, Automat, hyperlink, Twisted, pycparser, cffi, enum34, asn1crypto, ipaddress, cryptography, pyOpenSSL, queuelib, w3lib, parsel, pyasn1, pyasn1-modules, service-identity, scrapy  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Running setup.py install for PyDispatcher: started  Running setup.py install for PyDispatcher: finished with status 'done'  Running setup.py install for Twisted: started  Running setup.py install for Twisted: finished with status 'done'  Running setup.py install for pycparser: started  Running setup.py install for pycparser: finished with status 'done'  Running setup.py install for ipaddress: started  Running setup.py install for ipaddress: finished with status 'done'  Successfully installed Automat-0.6.0 PyDispatcher-2.0.5 Twisted-17.9.0 asn1crypto-0.24.0 attrs-17.4.0 certifi-2017.11.5 cffi-1.11.2 chardet-3.0.4 constantly-15.1.0 cryptography-2.1.4 cssselect-0.9.1 dumptruck-0.1.6 enum34-1.1.6 hyperlink-17.3.1 idna-2.6 incremental-17.5.0 ipaddress-1.0.19 lxml-3.4.4 parsel-1.3.1 pyOpenSSL-17.5.0 pyasn1-0.4.2 pyasn1-modules-0.2.1 pycparser-2.18 queuelib-1.4.2 requests-2.18.4 scraperwiki scrapy-1.3.0 service-identity-17.0.0 six-1.11.0 urllib3-1.22 w3lib-1.18.0 zope.interface-4.4.3   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... 2018-01-01 16:35:51 [scrapy.utils.log] INFO: Scrapy 1.3.0 started (bot: scrapybot) 2018-01-01 16:35:51 [scrapy.utils.log] INFO: Overridden settings: {} 2018-01-01 16:35:51 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.logstats.LogStats'] 2018-01-01 16:35:51 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2018-01-01 16:35:51 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2018-01-01 16:35:51 [scrapy.middleware] INFO: Enabled item pipelines: [] 2018-01-01 16:35:51 [scrapy.core.engine] INFO: Spider opened 2018-01-01 16:35:51 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2018-01-01 16:35:51 [scrapy.extensions.telnet] DEBUG: Telnet console listening on 127.0.0.1:6023 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=1> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=2> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=3> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=4> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=5> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=6> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=7> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=8> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=9> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=10> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=11> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=12> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=13> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=14> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/partyar.aspx?lsno=15> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:51 [scrapy.core.scraper] ERROR: Error downloading <GET http://164.100.47.194/Loksabha/Members/PartywiseList.aspx> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/defer.py", line 1384, in _inlineCallbacks result = result.throwExceptionIntoGenerator(g) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/python/failure.py", line 408, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/middleware.py", line 43, in process_request defer.returnValue((yield download_func(request=request,spider=spider))) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 65, in download_request return handler.download_request(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 61, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 286, in download_request method, to_bytes(url, encoding='ascii'), headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1655, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1432, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1318, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1330, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2018-01-01 16:35:52 [scrapy.core.engine] INFO: Closing spider (finished) 2018-01-01 16:35:52 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/exception_count': 16, 'downloader/exception_type_count/exceptions.TypeError': 16, 'downloader/request_bytes': 3973, 'downloader/request_count': 16, 'downloader/request_method_count/GET': 16, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2018, 1, 1, 16, 35, 52, 93833), 'log_count/DEBUG': 1, 'log_count/ERROR': 16, 'log_count/INFO': 7, 'scheduler/dequeued': 16, 'scheduler/dequeued/memory': 16, 'scheduler/enqueued': 16, 'scheduler/enqueued/memory': 16, 'start_time': datetime.datetime(2018, 1, 1, 16, 35, 51, 674195)} 2018-01-01 16:35:52 [scrapy.core.engine] INFO: Spider closed (finished)

Statistics

Average successful run time: 3 minutes

Total run time: 7 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 66.2 KB

History

  • Manually ran revision 8326d909 and completed successfully .
    nothing changed in the database
  • Manually ran revision 3586d47d and completed successfully .
    153 records added in the database
    524 pages scraped
  • Created on morph.io