edrandall / outfall_locations

Outfall locations into river Thames and tributaries (London, UK)


Scrape CSO locations from spreadsheets at:

http://www.parliament.uk/deposits/depositedpapers/2009/DEP2009-2983.xls

http://www.cassilis.plus.com/TAC/Xl0000007.xls

http://www.cassilis.plus.com/TAC/crane-cso-locations.xls

view.html displays the CSO locations parsed by the “Thames CSO Locations” scraper.
Points are displayed in a different colour according to the original dataset.

Load the view against morph.io data with:
http://htmlpreview.github.io/?https://github.com/edrandall/thames_cso_locations/blob/master/view.html

Contributors edrandall

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping Outfall dataset: Crane-Outfall-Safari from: http://plus.epicollect.net/RiverCraneZSL/download Saved row: (Crane-Outfall-Safari,732871) Saved row: (Crane-Outfall-Safari,732655) Saved row: (Crane-Outfall-Safari,732595) Saved row: (Crane-Outfall-Safari,732873) Saved row: (Crane-Outfall-Safari,732656) Saved row: (Crane-Outfall-Safari,732657) Saved row: (Crane-Outfall-Safari,732874) Saved row: (Crane-Outfall-Safari,732658) Saved row: (Crane-Outfall-Safari,732875) Saved row: (Crane-Outfall-Safari,732659) Saved row: (Crane-Outfall-Safari,732876) Saved row: (Crane-Outfall-Safari,732660) Saved row: (Crane-Outfall-Safari,732661) Saved row: (Crane-Outfall-Safari,732662) Saved row: (Crane-Outfall-Safari,732877) Saved row: (Crane-Outfall-Safari,732663) Saved row: (Crane-Outfall-Safari,732664) Saved row: (Crane-Outfall-Safari,732878) Saved row: (Crane-Outfall-Safari,732879) Saved row: (Crane-Outfall-Safari,732665) Saved row: (Crane-Outfall-Safari,732666) Saved row: (Crane-Outfall-Safari,732880) Saved row: (Crane-Outfall-Safari,732667) Saved row: (Crane-Outfall-Safari,732881) Saved row: (Crane-Outfall-Safari,732882) Saved row: (Crane-Outfall-Safari,732668) Saved row: (Crane-Outfall-Safari,732883) Saved row: (Crane-Outfall-Safari,732884) Saved row: (Crane-Outfall-Safari,732959) Saved row: (Crane-Outfall-Safari,732960) Saved row: (Crane-Outfall-Safari,732961) Saved row: (Crane-Outfall-Safari,732962) Saved row: (Crane-Outfall-Safari,732963) Saved row: (Crane-Outfall-Safari,732964) Saved row: (Crane-Outfall-Safari,732965) Saved row: (Crane-Outfall-Safari,732894) Saved row: (Crane-Outfall-Safari,732895) Saved row: (Crane-Outfall-Safari,732896) Saved row: (Crane-Outfall-Safari,736642) Saved row: (Crane-Outfall-Safari,736643) Saved row: (Crane-Outfall-Safari,736644) Saved row: (Crane-Outfall-Safari,738862) Saved row: (Crane-Outfall-Safari,739576) Saved row: (Crane-Outfall-Safari,739577) Saved row: (Crane-Outfall-Safari,739578) Saved row: (Crane-Outfall-Safari,739579) Saved row: (Crane-Outfall-Safari,739580) Saved row: (Crane-Outfall-Safari,739581) Saved row: (Crane-Outfall-Safari,739582) Saved row: (Crane-Outfall-Safari,738863) Saved row: (Crane-Outfall-Safari,739583) Saved row: (Crane-Outfall-Safari,738864) Saved row: (Crane-Outfall-Safari,738865) Saved row: (Crane-Outfall-Safari,738866) Saved row: (Crane-Outfall-Safari,738867) Saved row: (Crane-Outfall-Safari,738868) Saved row: (Crane-Outfall-Safari,740589) Saved row: (Crane-Outfall-Safari,740590) Saved row: (Crane-Outfall-Safari,740591) Saved row: (Crane-Outfall-Safari,740592) Saved row: (Crane-Outfall-Safari,740593) Saved row: (Crane-Outfall-Safari,740595) Saved row: (Crane-Outfall-Safari,740596) Saved row: (Crane-Outfall-Safari,741683) Saved row: (Crane-Outfall-Safari,741684) Saved row: (Crane-Outfall-Safari,741685) Saved row: (Crane-Outfall-Safari,741686) Saved row: (Crane-Outfall-Safari,741687) Saved row: (Crane-Outfall-Safari,741688) Saved row: (Crane-Outfall-Safari,741689) Saved row: (Crane-Outfall-Safari,741690) Saved row: (Crane-Outfall-Safari,741691) Saved row: (Crane-Outfall-Safari,741692) Saved row: (Crane-Outfall-Safari,741693) Saved row: (Crane-Outfall-Safari,741694) Saved row: (Crane-Outfall-Safari,741695) Saved row: (Crane-Outfall-Safari,741696) Saved row: (Crane-Outfall-Safari,741697) Saved row: (Crane-Outfall-Safari,741698) Saved row: (Crane-Outfall-Safari,741699) Saved row: (Crane-Outfall-Safari,741700) Saved row: (Crane-Outfall-Safari,741701) Saved row: (Crane-Outfall-Safari,741702) Saved row: (Crane-Outfall-Safari,741703) Saved row: (Crane-Outfall-Safari,741704) Saved row: (Crane-Outfall-Safari,741705) Saved row: (Crane-Outfall-Safari,741706) Saved row: (Crane-Outfall-Safari,741707) Saved row: (Crane-Outfall-Safari,741708) Saved row: (Crane-Outfall-Safari,741709) Saved row: (Crane-Outfall-Safari,741710) Saved row: (Crane-Outfall-Safari,741711) Saved row: (Crane-Outfall-Safari,741712) Saved row: (Crane-Outfall-Safari,741713) Saved row: (Crane-Outfall-Safari,741714) Saved row: (Crane-Outfall-Safari,741715) Saved row: (Crane-Outfall-Safari,741716) Saved row: (Crane-Outfall-Safari,741717) Saved row: (Crane-Outfall-Safari,741718) Saved row: (Crane-Outfall-Safari,741719) Saved row: (Crane-Outfall-Safari,741720) Saved row: (Crane-Outfall-Safari,741721) Saved row: (Crane-Outfall-Safari,741722) Saved row: (Crane-Outfall-Safari,741723) Saved row: (Crane-Outfall-Safari,741724) Saved row: (Crane-Outfall-Safari,741725) Saved row: (Crane-Outfall-Safari,744018) Saved row: (Crane-Outfall-Safari,744019) Saved row: (Crane-Outfall-Safari,744020) Saved row: (Crane-Outfall-Safari,744021) Saved row: (Crane-Outfall-Safari,744022) Saved row: (Crane-Outfall-Safari,744023) Saved row: (Crane-Outfall-Safari,744024) Saved row: (Crane-Outfall-Safari,744025) Saved row: (Crane-Outfall-Safari,744026) Saved row: (Crane-Outfall-Safari,744027) Saved row: (Crane-Outfall-Safari,744028) Saved row: (Crane-Outfall-Safari,744029) Saved row: (Crane-Outfall-Safari,744030) Saved row: (Crane-Outfall-Safari,744031) Saved row: (Crane-Outfall-Safari,744032) Saved row: (Crane-Outfall-Safari,744033) Saved row: (Crane-Outfall-Safari,744034) Saved row: (Crane-Outfall-Safari,744035) Saved row: (Crane-Outfall-Safari,744036) Saved row: (Crane-Outfall-Safari,744037) Saved row: (Crane-Outfall-Safari,744038) Saved row: (Crane-Outfall-Safari,744039) Saved row: (Crane-Outfall-Safari,744040) Saved row: (Crane-Outfall-Safari,744041) Saved row: (Crane-Outfall-Safari,744042) Saved row: (Crane-Outfall-Safari,744043) Saved row: (Crane-Outfall-Safari,744044) Saved row: (Crane-Outfall-Safari,744045) Saved row: (Crane-Outfall-Safari,744046) Saved row: (Crane-Outfall-Safari,744047) Saved row: (Crane-Outfall-Safari,744048) Saved row: (Crane-Outfall-Safari,744049) Saved row: (Crane-Outfall-Safari,744050) Saved row: (Crane-Outfall-Safari,744051) Saved row: (Crane-Outfall-Safari,744811) Saved row: (Crane-Outfall-Safari,744812) Saved row: (Crane-Outfall-Safari,744813) Saved row: (Crane-Outfall-Safari,744814) Saved row: (Crane-Outfall-Safari,744815) Saved row: (Crane-Outfall-Safari,744816) Saved row: (Crane-Outfall-Safari,744817) Saved row: (Crane-Outfall-Safari,745157) Saved row: (Crane-Outfall-Safari,745158) Saved row: (Crane-Outfall-Safari,745159) Saved row: (Crane-Outfall-Safari,745160) Saved row: (Crane-Outfall-Safari,745161) Saved row: (Crane-Outfall-Safari,745162) Saved row: (Crane-Outfall-Safari,745163) Saved row: (Crane-Outfall-Safari,745164) Saved row: (Crane-Outfall-Safari,745165) Saved row: (Crane-Outfall-Safari,745166) Saved row: (Crane-Outfall-Safari,745167) Saved row: (Crane-Outfall-Safari,745168) Saved row: (Crane-Outfall-Safari,745169) Saved row: (Crane-Outfall-Safari,745170) Saved row: (Crane-Outfall-Safari,745171) Dataset: Crane-Outfall-Safari saved: 162/162 rows Saved 162 rows total to cso_locations

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (31 KB) Use the API

rows 4 / 4

receiving_water site_name lng site_id ndt datasetid discharge_type northings consent_reference eastings lat rownumber grid_ref
River Crane
Hospital bridge rd
-0.36433805
732871
Outfall
Crane-Outfall-Safari
Outfall
51.44152371
1
River Crane
Hospital bridge road. Ds left bank
-0.3645006
732655
Outfall
Crane-Outfall-Safari
Outfall
51.4415648
2
River Crane
Duke of Northumberlands River upstream of bridge into north Feltham trading estate
-0.4040806
732595
Outfall
Crane-Outfall-Safari
Outfall
51.4596535
3
River Crane
Left bank hospital bridge rd
-0.36513525
732873
Outfall
Crane-Outfall-Safari
Outfall
51.44146061
4

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (31 KB) Use the API

rows 10 / 162

lat ndt site_id rownumber discharge_type datasetid site_name lng receiving_water
51.44152371
Outfall
732871
732871
Outfall
Crane-Outfall-Safari
Hospital bridge rd
-0.36433805
River Crane
51.4415648
Outfall
732655
732655
Outfall
Crane-Outfall-Safari
Hospital bridge road. Ds left bank
-0.3645006
River Crane
51.4596535
Outfall
732595
732595
Outfall
Crane-Outfall-Safari
Duke of Northumberlands River upstream of bridge into north Feltham trading estate
-0.4040806
River Crane
51.44146061
Outfall
732873
732873
Outfall
Crane-Outfall-Safari
Left bank hospital bridge rd
-0.36513525
River Crane
51.4415024
Outfall
732656
732656
Outfall
Crane-Outfall-Safari
Hospital bridge road upstream of bridge. Left bank ds
-0.365206
River Crane
Outfall
732657
732657
Outfall
Crane-Outfall-Safari
Hospital bridge us. Right bank
River Crane
51.4414536
Outfall
732874
732874
Outfall
Crane-Outfall-Safari
Right bank hospital bridge rd
-0.36504458
River Crane
51.4415679
Outfall
732658
732658
Outfall
Crane-Outfall-Safari
Hospital bridge. Right bank
-0.3654588
River Crane
51.44154966
Outfall
732875
732875
Outfall
Crane-Outfall-Safari
Right bank hospital bridge rd
-0.36563588
River Crane
51.4418424
Outfall
732659
732659
Outfall
Crane-Outfall-Safari
A316 up steam right bank
-0.367327
River Crane

Statistics

Average successful run time: 2 minutes

Total run time: 4 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 128 KB

History

  • Manually ran revision 458e6cd6 and completed successfully .
    162 records added in the database
  • Manually ran revision 877b42df and completed successfully .
    4 records added in the database
  • Manually ran revision 06b2c71c and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

outfall_locations / scraper.py