Contributors blablupcom

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.6  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 1))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to /app/.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 2))  /app/.heroku/python/lib/python2.7/site-packages/pip-9.0.1-py2.7.egg/pip/_vendor/requests/packages/urllib3/util/ssl_.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#snimissingwarning.  SNIMissingWarning  /app/.heroku/python/lib/python2.7/site-packages/pip-9.0.1-py2.7.egg/pip/_vendor/requests/packages/urllib3/util/ssl_.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning.  InsecurePlatformWarning  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 3))  Downloading cssselect-0.9.1.tar.gz  Collecting beautifulsoup4 (from -r /tmp/build/requirements.txt (line 4))  Downloading beautifulsoup4-4.6.0-py2-none-any.whl (86kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading requests-2.16.5-py2.py3-none-any.whl (87kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading chardet-3.0.3-py2.py3-none-any.whl (133kB)  Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading certifi-2017.4.17-py2.py3-none-any.whl (375kB)  Collecting idna<2.6,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading idna-2.5-py2.py3-none-any.whl (55kB)  Collecting urllib3<1.22,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 1))  Downloading urllib3-1.21.1-py2.py3-none-any.whl (131kB)  Installing collected packages: dumptruck, chardet, certifi, idna, urllib3, requests, scraperwiki, lxml, cssselect, beautifulsoup4  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Successfully installed beautifulsoup4-4.6.0 certifi-2017.4.17 chardet-3.0.3 cssselect-0.9.1 dumptruck-0.1.6 idna-2.5 lxml-3.4.4 requests-2.16.5 scraperwiki urllib3-1.21.1   ! Hello! It looks like your application is using an outdated version of Python.  ! This caused the security warning you saw above during the 'pip install' step.  ! We recommend 'python-2.7.13', which you can specify in a 'runtime.txt' file.  ! -- Much Love, Heroku.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 93, in <module> html = urllib2.urlopen(url) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 127, in urlopen return _opener.open(url, data, timeout) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 410, in open response = meth(req, response) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 523, in http_response 'http', request, response, code, msg, hdrs) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 448, in error return self._call_chain(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 382, in _call_chain result = func(*args) File "/app/.heroku/python/lib/python2.7/urllib2.py", line 531, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 403: Forbidden

Data

Downloaded 419 times by SimKennedy MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (22 KB) Use the API

rows 10 / 78

f l d
NHTRGDFT_LPNFT_gov_2017_02
2017-03-29 06:25:42.370446
NHTRGDFT_LPNFT_gov_2017_01
2017-03-29 06:25:42.676086
NHTRGDFT_LPNFT_gov_2016_12
2017-03-29 06:25:42.966849
NHTRGDFT_LPNFT_gov_2016_11
2017-03-29 06:25:43.255953
NHTRGDFT_LPNFT_gov_2016_10
2017-03-29 06:25:43.531374
NHTRGDFT_LPNFT_gov_2016_09
2017-03-29 06:25:43.857339
NHTRGDFT_LPNFT_gov_2016_08
2017-03-29 06:25:44.160978
NHTRGDFT_LPNFT_gov_2016_07
2017-03-29 06:25:44.458661
NHTRGDFT_LPNFT_gov_2016_06
2017-03-29 06:25:44.730691
NHTRGDFT_LPNFT_gov_2016_05
2017-03-29 06:25:45.006062

Statistics

Average successful run time: 3 minutes

Total run time: about 1 month

Total cpu time used: 5 minutes

Total disk space used: 78.8 KB

History

  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 78 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    78 records added, 77 records removed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    79 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    224 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    81 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 77 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    77 records added, 76 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    76 records added, 76 records removed in the database
    77 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    76 records added, 76 records removed in the database
    77 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    76 records added, 76 records removed in the database
    77 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    76 records added, 76 records removed in the database
    77 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    76 records added, 76 records removed in the database
    77 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    76 records added, 76 records removed in the database
    77 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    76 records added, 76 records removed in the database
    77 pages scraped
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    76 records added, 76 records removed in the database
    77 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    76 records added, 76 records removed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    76 records added, 75 records removed in the database
    77 pages scraped
  • Auto ran revision 9e080372 and failed .
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    152 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 75 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    75 records added, 74 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 74 records removed in the database
    151 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    74 records added, 73 records removed in the database
    75 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    78 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 73 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    73 records added, 72 records removed in the database
    74 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    76 pages scraped
  • Auto ran revision 9e080372 and failed .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 72 records removed in the database
    70 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    80 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    72 records added, 71 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    70 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    68 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    70 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    73 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    70 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 71 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    71 records added, 70 records removed in the database
    72 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
    71 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 70 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    70 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 69 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    69 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 68 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    68 records added, 67 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    67 records added, 67 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    67 records added, 67 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    67 records added, 67 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    67 records added, 67 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    67 records added, 67 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    67 records added, 67 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    67 records added, 67 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    67 records added, 67 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    67 records added, 67 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    67 records added, 66 records removed in the database
    42 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
  • Auto ran revision 9e080372 and failed .
    nothing changed in the database
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    64 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    58 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9e080372 and failed .
    64 records added, 64 records removed in the database
    65 pages scraped
  • Auto ran revision 9e080372 and failed .
    64 records added, 64 records removed in the database
    65 pages scraped
  • Auto ran revision 9e080372 and failed .
    64 records added, 64 records removed in the database
    65 pages scraped
  • Auto ran revision 9e080372 and failed .
    64 records added, 64 records removed in the database
    57 pages scraped
  • Auto ran revision 9e080372 and failed .
    64 records added, 64 records removed in the database
    65 pages scraped
  • Auto ran revision 9e080372 and failed .
    64 records added, 64 records removed in the database
    53 pages scraped
  • Auto ran revision 9e080372 and failed .
    64 records added, 64 records removed in the database
    65 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    70 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    69 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    68 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    64 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 66 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    66 records added, 65 records removed in the database
    67 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    65 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    58 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    63 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Auto ran revision 9e080372 and completed successfully .
    65 records added, 65 records removed in the database
    66 pages scraped
  • Manually ran revision 9e080372 and completed successfully .
    65 records added in the database
    69 pages scraped
  • Created on morph.io

Scraper code

Python

sp_NHTRGDFT_LPNFT_gov / scraper.py