howawong / hong_kong_today_pig_supply_auction_prices

Hong Kong Today's live pig supply and auction prices


This is a scraper that runs on Morph. To get started see the documentation

Contributors howawong

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.9  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting python-dateutil==2.2 (from -r requirements.txt (line 10))  Downloading python-dateutil-2.2.tar.gz (259kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 6))  Downloading requests-2.12.3-py2.py3-none-any.whl (575kB)  Collecting six (from python-dateutil==2.2->-r requirements.txt (line 10))  Downloading six-1.10.0-py2.py3-none-any.whl  Installing collected packages: dumptruck, requests, scraperwiki, lxml, cssselect, six, python-dateutil  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Running setup.py install for python-dateutil: started  Running setup.py install for python-dateutil: finished with status 'done'  Successfully installed cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 python-dateutil-2.2 requests-2.12.3 scraperwiki six-1.10.0   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... http://www.fehd.gov.hk/tc_chi/sh/data/supply_tw.html {'tomorrow_local_admission': 100, 'today_highest_price': 1870, 'date': datetime.datetime(2016, 7, 12, 0, 0), 'tomorrow_total_admission': 4100, 'tomorrow_mainland_admission': 4000, 'today_local_admission': 193, 'today_total_admission': 4648, 'today_lowest_price': 1339, 'today_average_price': 1416, 'today_mainland_admission': 4455}

Data

Downloaded 4 times by howawong

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (15 KB) Use the API

rows 10 / 127

date today_local_admission tomorrow_total_admission today_highest_price tomorrow_mainland_admission today_lowest_price today_total_admission today_mainland_admission tomorrow_local_admission today_average_price
2016-05-27T00:00:00+00:00
269
4040
1969
3940
1639
4171
3902
100
1806
2016-05-28T00:00:00+00:00
245
4160
2290
4060
1720
3828
3583
100
1827
2016-05-29T00:00:00+00:00
315
4500
1960
4400
1746
4634
4319
100
1825
2016-05-30T00:00:00+00:00
245
4180
1930
4080
1700
4731
4486
100
1808
2016-05-31T00:00:00+00:00
244
4010
1969
3910
1689
4458
4214
100
1793
2016-02-06T00:00:00+00:00
238
4040
1969
3940
1700
3763
3525
100
1815
2016-03-06T00:00:00+00:00
277
4070
1921
3970
1699
4301
4024
100
1806
2016-05-06T00:00:00+00:00
336
4210
1969
4110
1780
4834
4498
100
1842
2016-06-06T00:00:00+00:00
253
4260
1944
4160
1780
4515
4262
100
1843
2016-07-06T00:00:00+00:00
297
4360
1989
4260
1709
4915
4618
100
1825

Statistics

Average successful run time: 1 minute

Total run time: about 4 hours

Total cpu time used: 1 minute

Total disk space used: 51.1 KB

History

  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and failed .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    3 pages scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    2 pages scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    8 pages scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
    80 pages scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 7c6b29cf and failed .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and failed .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and failed .
    nothing changed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Manually ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Manually ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Manually ran revision 7c6b29cf and completed successfully .
    1 record added, 1 record removed in the database
  • Manually ran revision 7c6b29cf and completed successfully .
    1 record added in the database
  • Manually ran revision 91e11edc and failed .
    nothing changed in the database
  • Manually ran revision 91e11edc and failed .
    nothing changed in the database
  • Manually ran revision c4355d03 and failed .
    nothing changed in the database
  • Created on morph.io