edrandall / thames_cso_locations

Thames CSO locations


Scrape CSO locations from spreadsheets at:

http://www.parliament.uk/deposits/depositedpapers/2009/DEP2009-2983.xls

http://www.cassilis.plus.com/TAC/Xl0000007.xls

http://www.cassilis.plus.com/TAC/crane-cso-locations.xls

view.html displays the CSO locations parsed by the “Thames CSO Locations” scraper.
Points are displayed in a different colour according to the original dataset.

Load the view against morph.io data with:
http://htmlpreview.github.io/?https://github.com/edrandall/thames_cso_locations/blob/master/view.html

Forked from ScraperWiki

Contributors edrandall

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Scraping Outfall dataset: Crane-Outfall-Safari from: http://plus.epicollect.net/RiverCraneZSL/download Saved row: (Crane-Outfall-Safari,732871) Saved row: (Crane-Outfall-Safari,732655) Saved row: (Crane-Outfall-Safari,732656) Saved row: (Crane-Outfall-Safari,732874) Saved row: (Crane-Outfall-Safari,732875) Saved row: (Crane-Outfall-Safari,732876) Saved row: (Crane-Outfall-Safari,732660) Saved row: (Crane-Outfall-Safari,732661) Saved row: (Crane-Outfall-Safari,732662) Saved row: (Crane-Outfall-Safari,732663) Saved row: (Crane-Outfall-Safari,732878) Saved row: (Crane-Outfall-Safari,732665) Saved row: (Crane-Outfall-Safari,732880) Saved row: (Crane-Outfall-Safari,732881) Saved row: (Crane-Outfall-Safari,732882) Saved row: (Crane-Outfall-Safari,732883) Saved row: (Crane-Outfall-Safari,732884) Saved row: (Crane-Outfall-Safari,732959) Saved row: (Crane-Outfall-Safari,732960) Saved row: (Crane-Outfall-Safari,732961) Saved row: (Crane-Outfall-Safari,732962) Saved row: (Crane-Outfall-Safari,732963) Saved row: (Crane-Outfall-Safari,732964) Saved row: (Crane-Outfall-Safari,732965) Saved row: (Crane-Outfall-Safari,736642) Saved row: (Crane-Outfall-Safari,736643) Saved row: (Crane-Outfall-Safari,736644) Saved row: (Crane-Outfall-Safari,738862) Saved row: (Crane-Outfall-Safari,739576) Saved row: (Crane-Outfall-Safari,739577) Saved row: (Crane-Outfall-Safari,739578) Saved row: (Crane-Outfall-Safari,739579) Saved row: (Crane-Outfall-Safari,739580) Saved row: (Crane-Outfall-Safari,739581) Saved row: (Crane-Outfall-Safari,739582) Saved row: (Crane-Outfall-Safari,738863) Saved row: (Crane-Outfall-Safari,739583) Saved row: (Crane-Outfall-Safari,738864) Saved row: (Crane-Outfall-Safari,738865) Saved row: (Crane-Outfall-Safari,738866) Saved row: (Crane-Outfall-Safari,738867) Saved row: (Crane-Outfall-Safari,738868) Saved row: (Crane-Outfall-Safari,740589) Saved row: (Crane-Outfall-Safari,740590) Saved row: (Crane-Outfall-Safari,740591) Saved row: (Crane-Outfall-Safari,740592) Saved row: (Crane-Outfall-Safari,740593) Saved row: (Crane-Outfall-Safari,740595) Saved row: (Crane-Outfall-Safari,740596) Saved row: (Crane-Outfall-Safari,741684) Saved row: (Crane-Outfall-Safari,741685) Saved row: (Crane-Outfall-Safari,741686) Saved row: (Crane-Outfall-Safari,741687) Saved row: (Crane-Outfall-Safari,741688) Saved row: (Crane-Outfall-Safari,741689) Saved row: (Crane-Outfall-Safari,741690) Saved row: (Crane-Outfall-Safari,741691) Saved row: (Crane-Outfall-Safari,741692) Saved row: (Crane-Outfall-Safari,741693) Saved row: (Crane-Outfall-Safari,741694) Saved row: (Crane-Outfall-Safari,741695) Saved row: (Crane-Outfall-Safari,741696) Saved row: (Crane-Outfall-Safari,741697) Saved row: (Crane-Outfall-Safari,741698) Saved row: (Crane-Outfall-Safari,741699) Saved row: (Crane-Outfall-Safari,741700) Saved row: (Crane-Outfall-Safari,741701) Saved row: (Crane-Outfall-Safari,741702) Saved row: (Crane-Outfall-Safari,741703) Saved row: (Crane-Outfall-Safari,741704) Saved row: (Crane-Outfall-Safari,741705) Saved row: (Crane-Outfall-Safari,741706) Saved row: (Crane-Outfall-Safari,741707) Saved row: (Crane-Outfall-Safari,741708) Saved row: (Crane-Outfall-Safari,741709) Saved row: (Crane-Outfall-Safari,741710) Saved row: (Crane-Outfall-Safari,741711) Saved row: (Crane-Outfall-Safari,741712) Saved row: (Crane-Outfall-Safari,741713) Saved row: (Crane-Outfall-Safari,741714) Saved row: (Crane-Outfall-Safari,741715) Saved row: (Crane-Outfall-Safari,741716) Saved row: (Crane-Outfall-Safari,741717) Saved row: (Crane-Outfall-Safari,741718) Saved row: (Crane-Outfall-Safari,741719) Saved row: (Crane-Outfall-Safari,741720) Saved row: (Crane-Outfall-Safari,741721) Saved row: (Crane-Outfall-Safari,741722) Saved row: (Crane-Outfall-Safari,741723) Saved row: (Crane-Outfall-Safari,741724) Saved row: (Crane-Outfall-Safari,741725) Saved row: (Crane-Outfall-Safari,744019) Saved row: (Crane-Outfall-Safari,744020) Saved row: (Crane-Outfall-Safari,744021) Saved row: (Crane-Outfall-Safari,744022) Saved row: (Crane-Outfall-Safari,744023) Saved row: (Crane-Outfall-Safari,744024) Saved row: (Crane-Outfall-Safari,744025) Saved row: (Crane-Outfall-Safari,744026) Saved row: (Crane-Outfall-Safari,744027) Saved row: (Crane-Outfall-Safari,744028) Saved row: (Crane-Outfall-Safari,744029) Saved row: (Crane-Outfall-Safari,744030) Saved row: (Crane-Outfall-Safari,744031) Saved row: (Crane-Outfall-Safari,744032) Saved row: (Crane-Outfall-Safari,744033) Saved row: (Crane-Outfall-Safari,744034) Saved row: (Crane-Outfall-Safari,744035) Saved row: (Crane-Outfall-Safari,744036) Saved row: (Crane-Outfall-Safari,744037) Saved row: (Crane-Outfall-Safari,744038) Saved row: (Crane-Outfall-Safari,744039) Saved row: (Crane-Outfall-Safari,744040) Saved row: (Crane-Outfall-Safari,744041) Saved row: (Crane-Outfall-Safari,744042) Saved row: (Crane-Outfall-Safari,744043) Saved row: (Crane-Outfall-Safari,744044) Saved row: (Crane-Outfall-Safari,744045) Saved row: (Crane-Outfall-Safari,744046) Saved row: (Crane-Outfall-Safari,744047) Saved row: (Crane-Outfall-Safari,744048) Saved row: (Crane-Outfall-Safari,744049) Saved row: (Crane-Outfall-Safari,744050) Saved row: (Crane-Outfall-Safari,744051) Saved row: (Crane-Outfall-Safari,744811) Saved row: (Crane-Outfall-Safari,744812) Saved row: (Crane-Outfall-Safari,744813) Saved row: (Crane-Outfall-Safari,744814) Saved row: (Crane-Outfall-Safari,744815) Saved row: (Crane-Outfall-Safari,744816) Saved row: (Crane-Outfall-Safari,744817) Saved row: (Crane-Outfall-Safari,745157) Saved row: (Crane-Outfall-Safari,745158) Saved row: (Crane-Outfall-Safari,745159) Saved row: (Crane-Outfall-Safari,745160) Saved row: (Crane-Outfall-Safari,745161) Saved row: (Crane-Outfall-Safari,745162) Saved row: (Crane-Outfall-Safari,745163) Saved row: (Crane-Outfall-Safari,745164) Saved row: (Crane-Outfall-Safari,745165) Saved row: (Crane-Outfall-Safari,745166) Saved row: (Crane-Outfall-Safari,745167) Saved row: (Crane-Outfall-Safari,745168) Saved row: (Crane-Outfall-Safari,745169) Saved row: (Crane-Outfall-Safari,745170) Saved row: (Crane-Outfall-Safari,745171) Saved row: (Crane-Outfall-Safari,751283) Saved row: (Crane-Outfall-Safari,751284) Saved row: (Crane-Outfall-Safari,751285) Saved row: (Crane-Outfall-Safari,758117) Saved row: (Crane-Outfall-Safari,764705) Saved row: (Crane-Outfall-Safari,764706) Dataset: Crane-Outfall-Safari saved: 152/152 rows Saved 152 rows total to cso_locations

Data

Downloaded 102 times by edrandall MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (140 KB) Use the API

rows 10 / 639

datasetid rownumber site_name ndt discharge_type receiving_water receiving_watercourse site_id consent_reference lat lng eastings northings grid_ref grid_reference
DEP2009-2983
1
Angel Road Sewar Storm Overflow, He
Storm Sewer Overflow
Sewage Discharges - Sewer Storm Overflow - Water Company
Thames
51.53627483073747
-0.9013150863867272
476300.0
182502.0
DEP2009-2983
2
Anyand Park Road, Twickenham
Storm Sewer Overflow
Sewage Discharges - Sewer Storm Overflow - Water Company
Tidal Thames
51.45210752415704
-0.32477686129059263
516500.0
173900.0
DEP2009-2983
3
Ashton Keynes
Storm Sewer Overflow
Sewage Discharges - Sewer Storm Overflow - Water Company
Thames
51.63937772745485
-1.9089153210299095
406400.0
193401.0
DEP2009-2983
4
Aston Mead
Sewage Pumping Station
Sewage Discharges - Pumping Station - Water Company
Thames
51.48413493243494
-0.6462146393378736
494100.0
177000.0
DEP2009-2983
5
Baldwins Shore
Sewage Pumping Station
Sewage Discharges - Pumping Station - Water Company
Thames
51.490887956866246
-0.6085637076272631
496700.0
177800.0
DEP2009-2983
6
Barn Elms, Horne Way, Putney
Sewage Pumping Station
Sewage Discharges - Pumping Station - Water Company
Tidal Thames
51.46954218949539
-0.2262318736296985
523300.0
176000.0
DEP2009-2983
7
Barnes Storm
Storm Sewer Overflow
Sewage Discharges - Sewer Storm Overflow - Water Company
Tidal Thames
51.47372942742568
-0.2535723073840756
521390.0
176420.0
DEP2009-2983
8
Battle Bridge Relief Sewer, London
Storm Tank Overflow
Sewage Discharges - Stw Storm Overflow/storm Tank - Water Company
Tidal Thames
51.50633239474044
-0.0840195267620452
533070.0
180340.0
DEP2009-2983
9
Bell Lane Creek, Frogmore Lane, Lon
Storm Tank Overflow
Sewage Discharges - Stw Storm Overflow/storm Tank - Water Company
Tidal Thames
51.459984301532415
-0.1950771425625942
525490.0
174990.0
DEP2009-2983
10
Bell Wharf Outlet, London
Storm Tank Overflow
Sewage Discharges - Stw Storm Overflow/storm Tank - Water Company
Tidal Thames
51.509046860377666
-0.04686976046719572
535640.0
180710.0

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (140 KB) Use the API

rows 4 / 4

datasetid northings site_id ndt lat rownumber eastings grid_ref site_name lng consent_reference discharge_type receiving_water
Crane-Outfall-Safari
732871
Outfall
51.44152371
1
Hospital bridge rd
-0.36433805
Outfall
River Crane
Crane-Outfall-Safari
732655
Outfall
51.4415648
2
Hospital bridge road. Ds left bank
-0.3645006
Outfall
River Crane
Crane-Outfall-Safari
732595
Outfall
51.4596535
3
Duke of Northumberlands River upstream of bridge into north Feltham trading estate
-0.4040806
Outfall
River Crane
Crane-Outfall-Safari
732873
Outfall
51.44146061
4
Left bank hospital bridge rd
-0.36513525
Outfall
River Crane

Statistics

Average successful run time: 6 minutes

Total run time: about 3 hours

Total cpu time used: less than a minute

Total disk space used: 447 KB

History

  • Manually ran revision 458e6cd6 and completed successfully .
    152 records added, 150 records removed in the database
  • Manually ran revision 458e6cd6 and completed successfully .
    150 records added, 146 records removed in the database
  • Manually ran revision 458e6cd6 and completed successfully .
    162 records added, 162 records removed in the database
  • Manually ran revision 458e6cd6 and completed successfully .
    162 records added, 162 records removed in the database
  • Manually ran revision 92b5f0a6 and completed successfully .
    162 records updated in the database
  • Manually ran revision 0a67f7a2 and completed successfully .
    162 records added in the database
  • Manually ran revision aa62374f and completed successfully .
    4 records added in the database
  • Manually ran revision 6c8d26de and completed successfully .
    nothing changed in the database
  • Manually ran revision e8de3a8f and failed .
    nothing changed in the database
  • Manually ran revision f26654fa and completed successfully .
    nothing changed in the database
  • Manually ran revision e8072b56 and completed successfully .
    nothing changed in the database
  • Manually ran revision 562b5795 and completed successfully .
    nothing changed in the database
  • Manually ran revision 46031f0b and completed successfully .
    nothing changed in the database
  • Manually ran revision 6b07dcb1 and failed .
    nothing changed in the database
  • Manually ran revision ab5f2d20 and failed .
    nothing changed in the database
  • Manually ran revision 2ad8eef2 and failed .
    nothing changed in the database
  • Manually ran revision ddfd9030 and completed successfully .
    nothing changed in the database
  • Manually ran revision 81007406 and failed .
    nothing changed in the database
  • Manually ran revision b0ed5977 and completed successfully .
    nothing changed in the database
  • Manually ran revision f0c76cc4 and failed .
    nothing changed in the database
  • Manually ran revision a22fdccd and completed successfully .
    nothing changed in the database
  • Manually ran revision 35bbe4b3 and failed .
    nothing changed in the database
  • Manually ran revision 9a9935ca and failed .
    nothing changed in the database
  • Manually ran revision ab575772 and completed successfully .
    nothing changed in the database
  • Manually ran revision d4c8e166 and failed .
    nothing changed in the database
  • Manually ran revision 1a959480 and completed successfully .
    nothing changed in the database
  • Manually ran revision ccb0ad0e and completed successfully .
    nothing changed in the database
  • Manually ran revision 6ba87037 and completed successfully .
    nothing changed in the database
  • Manually ran revision 3cc71ead and failed .
    nothing changed in the database
  • Manually ran revision b13ef896 and failed .
    nothing changed in the database
  • Manually ran revision 4e7a5662 and failed .
    nothing changed in the database
  • Manually ran revision eecc5785 and failed .
    nothing changed in the database
  • Manually ran revision 1f83ddbe and failed .
    nothing changed in the database
  • Manually ran revision 6665a8cf and failed .
    nothing changed in the database
  • Manually ran revision f0f24a8d and completed successfully .
    nothing changed in the database
  • Manually ran revision bb62e256 and completed successfully .
    nothing changed in the database
  • Manually ran revision 860d30d3 and completed successfully .
    nothing changed in the database
  • Manually ran revision 685f423a and completed successfully .
    nothing changed in the database
  • Manually ran revision d4406a51 and failed .
    nothing changed in the database
  • Manually ran revision f3b05324 and failed .
    nothing changed in the database
  • Manually ran revision 21b837b5 and completed successfully .
    nothing changed in the database
  • Manually ran revision f3c0638e and failed .
    nothing changed in the database
  • Manually ran revision 54979b39 and failed .
    nothing changed in the database
  • Manually ran revision 54979b39 and failed .
    nothing changed in the database
  • Manually ran revision 85361428 and failed .
    nothing changed in the database
  • Manually ran revision ae4759bf and failed .
    nothing changed in the database
  • Manually ran revision b0ba6497 and failed .
    nothing changed in the database
  • Manually ran revision 1cdf50df and failed .
    nothing changed in the database
  • Manually ran revision 53bd0e3d and failed .
    nothing changed in the database
  • Forked from ScraperWiki

Scraper code

Python

thames_cso_locations / scraper.py