tubaman / travis-uslakes-info

Get the level of Lake Travis


This is a scraper that runs on Morph. It reads the current water level of Lake Travis in Austin, TX USA

Contributors tubaman mlandauer

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.9, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.9 -----> Installing pip -----> Installing requirements with pip  DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Running command git clone -q http://github.com/openaustralia/scraperwiki-python.git /app/.heroku/src/scraperwiki  Running command git checkout -b morph_defaults --track origin/morph_defaults  Switched to a new branch 'morph_defaults'  Branch morph_defaults set up to track remote branch morph_defaults from origin.  Collecting lxml==3.4.4  Downloading https://files.pythonhosted.org/packages/63/c7/4f2a2a4ad6c6fa99b14be6b3c1cece9142e2d915aa7c43c908677afc8fa4/lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1  Downloading https://files.pythonhosted.org/packages/aa/e5/9ee1460d485b94a6d55732eb7ad5b6c084caf73dd6f9cb0bb7d2a78fafe8/cssselect-0.9.1.tar.gz  Collecting beautifulsoup4==4.3.2  Downloading https://files.pythonhosted.org/packages/30/bd/5405ba01391d06646de9ec90cadeb3893fa355a06438966afff44531219a/beautifulsoup4-4.3.2.tar.gz (143kB)  Collecting python-dateutil==2.2  Downloading https://files.pythonhosted.org/packages/75/c5/85d027471fa665f8c8b8eb0b925f9d84b4eee745a257b16de4957de99e81/python-dateutil-2.2.tar.gz (259kB)  Collecting dumptruck>=0.1.2  Downloading https://files.pythonhosted.org/packages/15/27/3330a343de80d6849545b6c7723f8c9a08b4b104de964ac366e7e6b318df/dumptruck-0.1.6.tar.gz  Collecting requests  Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB)  Collecting six  Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl  Collecting certifi>=2017.4.17  Downloading https://files.pythonhosted.org/packages/18/b0/8146a4f8dd402f60744fa380bc73ca47303cccf8b9190fd16a827281eac2/certifi-2019.9.11-py2.py3-none-any.whl (154kB)  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1  Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB)  Collecting idna<2.9,>=2.5  Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)  Collecting chardet<3.1.0,>=3.0.2  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Building wheels for collected packages: lxml, cssselect, beautifulsoup4, python-dateutil, dumptruck  Building wheel for lxml (setup.py): started  Building wheel for lxml (setup.py): still running...  Building wheel for lxml (setup.py): finished with status 'done'  Created wheel for lxml: filename=lxml-3.4.4-cp27-cp27m-linux_x86_64.whl size=2989834 sha256=6a1d79bc8dd85d23afc1cd0d84474d00cf1be4dc71580bde9958d4d0615fad31  Stored in directory: /tmp/pip-ephem-wheel-cache-DY9Pjk/wheels/f6/df/7b/af9cace9baf95a6e4a2b5790e30da55fc780ddee598314d1ed  Building wheel for cssselect (setup.py): started  Building wheel for cssselect (setup.py): finished with status 'done'  Created wheel for cssselect: filename=cssselect-0.9.1-cp27-none-any.whl size=26994 sha256=d48bd7a0a64f41c262b8880af5ca043f036fe3541f3f08771554fb70066094f6  Stored in directory: /tmp/pip-ephem-wheel-cache-DY9Pjk/wheels/45/25/d7/5a3b06d22b1ffb616f868a74729a5a002bcc04d45109b4f223  Building wheel for beautifulsoup4 (setup.py): started  Building wheel for beautifulsoup4 (setup.py): finished with status 'done'  Created wheel for beautifulsoup4: filename=beautifulsoup4-4.3.2-cp27-none-any.whl size=77540 sha256=2edd5b64017ac12622c4563032405fa86595d3c3ea54f5657025355f9b385d92  Stored in directory: /tmp/pip-ephem-wheel-cache-DY9Pjk/wheels/61/d6/e1/a38634975a2c7fa74a9d855734c9e4d3514b3790e0ed4752c5  Building wheel for python-dateutil (setup.py): started  Building wheel for python-dateutil (setup.py): finished with status 'done'  Created wheel for python-dateutil: filename=python_dateutil-2.2-cp27-none-any.whl size=226720 sha256=b9a3d6cd36e5d603859faf61a5bae7b3c701034196e4baf5c50250aa1621c37f  Stored in directory: /tmp/pip-ephem-wheel-cache-DY9Pjk/wheels/97/40/49/e02356db91efa7a5da28ec2e5c61f0fb2c0aa21bbd5da95805  Building wheel for dumptruck (setup.py): started  Building wheel for dumptruck (setup.py): finished with status 'done'  Created wheel for dumptruck: filename=dumptruck-0.1.6-cp27-none-any.whl size=11845 sha256=9160d617e815f63f93759bc4d65ee60c10cd1a527e232a76d185f88c1082e173  Stored in directory: /tmp/pip-ephem-wheel-cache-DY9Pjk/wheels/57/df/83/32654ae89119876c7a7db66829bbdb646caa151589dbaf226e  Successfully built lxml cssselect beautifulsoup4 python-dateutil dumptruck  Installing collected packages: dumptruck, certifi, urllib3, idna, chardet, requests, scraperwiki, lxml, cssselect, beautifulsoup4, six, python-dateutil  Running setup.py develop for scraperwiki  Successfully installed beautifulsoup4-4.3.2 certifi-2019.9.11 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 idna-2.8 lxml-3.4.4 python-dateutil-2.2 requests-2.22.0 scraperwiki six-1.13.0 urllib3-1.25.7 DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support    -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 69735 times by philipnye tubaman kyleledbetter MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (118 KB) Use the API

rows 10 / 1533

timestamp unit level
2014-07-18T14:00:00+00:00
FEET
628.61
2014-07-19T10:00:00+00:00
FEET
628.59
2014-07-20T12:00:00+00:00
FEET
628.57
2014-07-20T18:00:00+00:00
FEET
628.49
2014-07-22T12:00:00+00:00
FEET
628.42
2014-07-23T00:00:00+00:00
FEET
628.35
2014-07-24T02:00:00+00:00
FEET
628.31
2014-07-26T13:00:00+00:00
Feet MSL
628.16
2014-07-26T22:00:00+00:00
Feet MSL
628.07
2014-07-28T17:00:00+00:00
Feet MSL
627.92

Statistics

Average successful run time: 2 minutes

Total run time: about 2 months

Total cpu time used: 13 minutes

Total disk space used: 142 KB

History

  • Auto ran revision 0be3e388 and completed successfully .
    1 record added in the database
  • Auto ran revision 0be3e388 and completed successfully .
    1 record added in the database
  • Auto ran revision 0be3e388 and completed successfully .
    1 record added in the database
  • Auto ran revision 0be3e388 and completed successfully .
    1 record added in the database
  • Auto ran revision 0be3e388 and completed successfully .
    1 record added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

travis-uslakes-info / scraper.py