howawong / hong_kong_beach_water_quality

Hong Kong Beach Water Quality


This is a scraper that runs on Morph. To get started see the documentation

Contributors howawong

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.9  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting python-dateutil==2.2 (from -r requirements.txt (line 10))  Downloading python-dateutil-2.2.tar.gz (259kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 6))  Downloading requests-2.12.3-py2.py3-none-any.whl (575kB)  Collecting six (from python-dateutil==2.2->-r requirements.txt (line 10))  Downloading six-1.10.0-py2.py3-none-any.whl  Installing collected packages: dumptruck, requests, scraperwiki, lxml, cssselect, six, python-dateutil  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Running setup.py install for python-dateutil: started  Running setup.py install for python-dateutil: finished with status 'done'  Successfully installed cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 python-dateutil-2.2 requests-2.12.3 scraperwiki six-1.10.0   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Anglers' Beach Not graded in winter months 2016-12-01 Approach Beach Not graded in winter months 2016-12-01 Big Wave Bay Beach Not graded in winter months 2016-12-01 Butterfly Beach Not graded in winter months 2016-12-01 Cafeteria New Beach Not graded in winter months 2016-12-01 Cafeteria Old Beach Not graded in winter months 2016-12-01 Casam Beach Not graded in winter months 2016-12-01 Castle Peak Beach Not graded in winter months 2016-12-01 Cheung Chau Tung Wan Beach Not graded in winter months 2016-12-01 Chung Hom Kok Beach Not graded in winter months 2016-12-01 Clear Water Bay First Beach Not graded in winter months 2016-12-01 Clear Water Bay Second Beach Fair Grade 2 2016-12-01 Deep Water Bay Beach Good Grade 1 2016-12-01 Discovery Bay Good Not graded in winter months 2016-12-01 Golden Beach Good Grade 1 2016-12-01 Hap Mun Bay Beach Good Not graded in winter months 2016-12-01 Hoi Mei Wan Beach Good Not graded in winter months 2016-12-01 Hung Shing Yeh Beach Good Not graded in winter months 2016-12-01 Kadoorie Beach Good Not graded in winter months 2016-12-01 Kiu Tsui Beach Good Not graded in winter months 2016-12-01 Kwun Yam Beach Good Not graded in winter months 2016-12-01 Lido Beach Good Not graded in winter months 2016-12-01 Lo So Shing Beach Good Not graded in winter months 2016-12-01 Lower Cheung Sha Beach Good Not graded in winter months 2016-12-01 Ma Wan Tung Wan Beach Good Not graded in winter months 2016-12-01 Middle Bay Beach Good Not graded in winter months 2016-12-01 Pui O Beach Good Not graded in winter months 2016-12-01 Repulse Bay Beach Good Not graded in winter months 2016-12-01 Shek O Beach Good Not graded in winter months 2016-12-01 Silver Mine Bay Beach Good Not graded in winter months 2016-12-01 Silverstrand Beach Fair Grade 2 2016-12-01 South Bay Beach Fair Not graded in winter months 2016-12-01 St. Stephen's Beach Fair Not graded in winter months 2016-12-01 Stanley Main Beach Fair Not graded in winter months 2016-12-01 Ting Kau Beach Fair Not graded in winter months 2016-12-01 Tong Fuk Beach Fair Not graded in winter months 2016-12-01 Trio Beach Fair Not graded in winter months 2016-12-01 Turtle Cove Beach Fair Not graded in winter months 2016-12-01 Upper Cheung Sha Beach Fair Not graded in winter months 2016-12-01

Data

Downloaded 4 times by howawong

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (313 KB) Use the API

rows 10 / 3031

place date grade_detail grade
Anglers' Beach
2016-05-20
Grade 2
Fair
Approach Beach
2016-05-20
Grade 3
Poor
Big Wave Bay Beach
2016-05-20
Grade 2
Fair
Butterfly Beach
2016-05-20
Grade 2
Fair
Cafeteria New Beach
2016-05-20
Grade 2
Fair
Cafeteria Old Beach
2016-05-20
Grade 2
Fair
Casam Beach
2016-05-20
Grade 2
Fair
Castle Peak Beach
2016-05-20
Grade 2
Fair
Cheung Chau Tung Wan Beach
2016-05-20
Grade 1
Good
Chung Hom Kok Beach
2016-05-20
Grade 1
Good

Statistics

Average successful run time: 1 minute

Total run time: 1 day

Total cpu time used: 2 minutes

Total disk space used: 348 KB

History

  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Manually ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and failed .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added, 39 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    39 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
    6 pages scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    nothing changed in the database
  • Auto ran revision 6a755e75 and failed .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
    1 page scraped
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
    1 page scraped
  • Manually ran revision 6a755e75 and failed .
    nothing changed in the database
  • Auto ran revision 6a755e75 and failed .
    nothing changed in the database
  • Auto ran revision 6a755e75 and failed .
    nothing changed in the database
  • Auto ran revision 6a755e75 and failed .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and failed .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and failed .
    nothing changed in the database
  • Auto ran revision 6a755e75 and failed .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and failed .
    nothing changed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Manually ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Auto ran revision 6a755e75 and completed successfully .
    41 records added, 41 records removed in the database
  • Manually ran revision 6a755e75 and completed successfully .
    41 records added in the database
  • Manually ran revision a03b38c8 and completed successfully .
    41 records added, 41 records removed in the database
  • Manually ran revision a03b38c8 and completed successfully .
    41 records added in the database
  • Manually ran revision 5def0b82 and failed .
    nothing changed in the database
  • Created on morph.io