g0vhkio / legco-council-meeting-vote-bot

Bot for crawling https://www.legco.gov.hk/php/detect-votes.php?term=yr17-18&meeting=cm


Contributors g0vhkio howawong

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 3 is python-3.6.2 (you are using python-3.6.4, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-3.6.2).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-3.6.4 -----> Installing pip -----> Installing requirements with pip  Collecting requests==2.18.4  Downloading https://files.pythonhosted.org/packages/49/df/50aa1999ab9bde74656c2919d9c0c085fd2b3775fd3eca826012bef76d8c/requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting pytz==2017.3  Downloading https://files.pythonhosted.org/packages/a3/7f/e7d1acbd433b929168a4fb4182a2ff3c33653717195a26c1de099ad1ef29/pytz-2017.3-py2.py3-none-any.whl (511kB)  Collecting pillow==5.2.0  Downloading https://files.pythonhosted.org/packages/d1/24/f53ff6b61b3d728b90934bddb4f03f8ab584a7f49299bf3bde56e2952612/Pillow-5.2.0-cp36-cp36m-manylinux1_x86_64.whl (2.0MB)  Collecting slackclient==1.2.0  Downloading https://files.pythonhosted.org/packages/15/92/ad635dd1755c9943e989adbce84a554d2f9f4006aeba669f4b9286b71d91/slackclient-1.2.0.tar.gz  Collecting textwrap3==0.9.1  Downloading https://files.pythonhosted.org/packages/e8/78/3bb4b819ae7ab81ba0759788b28671d7ae13186544c333f973e6c91a6726/textwrap3-0.9.1-py2.py3-none-any.whl  Collecting lxml==4.1.1  Downloading https://files.pythonhosted.org/packages/81/da/4fabb01d59f3d2b256e75ffee9516ea849e23ddebea8235caad570fe7332/lxml-4.1.1-cp36-cp36m-manylinux1_x86_64.whl (5.6MB)  Collecting simplejson==3.16.0  Downloading https://files.pythonhosted.org/packages/e3/24/c35fb1c1c315fc0fffe61ea00d3f88e85469004713dab488dee4f35b0aff/simplejson-3.16.0.tar.gz (81kB)  Obtaining scraperwiki from git+http://github.com/andylolz/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 8))  Cloning http://github.com/andylolz/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Running command git clone -q http://github.com/andylolz/scraperwiki-python.git /app/.heroku/src/scraperwiki  Running command git checkout -b morph_defaults --track origin/morph_defaults  Switched to a new branch 'morph_defaults'  Branch morph_defaults set up to track remote branch morph_defaults from origin.  Collecting certifi>=2017.4.17  Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB)  Collecting idna<2.7,>=2.5  Downloading https://files.pythonhosted.org/packages/27/cc/6dd9a3869f15c2edfab863b992838277279ce92663d334df9ecf5106f5c6/idna-2.6-py2.py3-none-any.whl (56kB)  Collecting urllib3<1.23,>=1.21.1  Downloading https://files.pythonhosted.org/packages/63/cb/6965947c13a94236f6d4b8223e21beb4d576dc72e8130bd7880f600839b8/urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting chardet<3.1.0,>=3.0.2  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting websocket-client<1.0a0,>=0.35  Downloading https://files.pythonhosted.org/packages/29/19/44753eab1fdb50770ac69605527e8859468f3c0fd7dc5a76dd9c4dbd7906/websocket_client-0.56.0-py2.py3-none-any.whl (200kB)  Collecting six<2.0a0,>=1.10  Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl  Collecting sqlalchemy  Downloading https://files.pythonhosted.org/packages/34/5c/0e1d7ad0ca52544bb12f9cb8d5cc454af45821c92160ffedd38db0a317f6/SQLAlchemy-1.3.11.tar.gz (6.0MB)  Collecting alembic  Downloading https://files.pythonhosted.org/packages/84/64/493c45119dce700a4b9eeecc436ef9e8835ab67bae6414f040cdc7b58f4b/alembic-1.3.1.tar.gz (1.1MB)  Collecting Mako  Downloading https://files.pythonhosted.org/packages/b0/3c/8dcd6883d009f7cae0f3157fb53e9afb05a0d3d33b3db1268ec2e6f4a56b/Mako-1.1.0.tar.gz (463kB)  Collecting python-editor>=0.3  Downloading https://files.pythonhosted.org/packages/c6/d3/201fc3abe391bbae6606e6f1d598c15d367033332bd54352b12f35513717/python_editor-1.0.4-py3-none-any.whl  Collecting python-dateutil  Downloading https://files.pythonhosted.org/packages/d4/70/d60450c3dd48ef87586924207ae8907090de0b306af2bce5d134d78615cb/python_dateutil-2.8.1-py2.py3-none-any.whl (227kB)  Collecting MarkupSafe>=0.9.2  Downloading https://files.pythonhosted.org/packages/b2/5f/23e0023be6bb885d00ffbefad2942bc51a620328ee910f64abe5a8d18dd1/MarkupSafe-1.1.1-cp36-cp36m-manylinux1_x86_64.whl  Building wheels for collected packages: slackclient, simplejson, sqlalchemy, alembic, Mako  Building wheel for slackclient (setup.py): started  Building wheel for slackclient (setup.py): finished with status 'done'  Created wheel for slackclient: filename=slackclient-1.2.0-py2.py3-none-any.whl size=16925 sha256=e5f77a0ac8fd164dd3eb1ea5c6806c4a087230fdb41348d55bd7fa96d95d6ade  Stored in directory: /tmp/pip-ephem-wheel-cache-bxs0p5da/wheels/69/1e/ea/17ec4eebc19ec60e448a945c30ec07b6626b5669c1a1b477b7  Building wheel for simplejson (setup.py): started  Building wheel for simplejson (setup.py): finished with status 'done'  Created wheel for simplejson: filename=simplejson-3.16.0-cp36-cp36m-linux_x86_64.whl size=118870 sha256=4096daac0c2d28451d2c97462ffe0d6f2fd6b076fb92066969020556d5f73d1b  Stored in directory: /tmp/pip-ephem-wheel-cache-bxs0p5da/wheels/5d/1a/1e/0350bb3df3e74215cd91325344cc86c2c691f5306eb4d22c77  Building wheel for sqlalchemy (setup.py): started  Building wheel for sqlalchemy (setup.py): finished with status 'done'  Created wheel for sqlalchemy: filename=SQLAlchemy-1.3.11-cp36-cp36m-linux_x86_64.whl size=1197087 sha256=31d5631e4c46effbab57c40c1b01bca4b4913be222b4437cbf0adf6d001dfc6b  Stored in directory: /tmp/pip-ephem-wheel-cache-bxs0p5da/wheels/a3/67/7d/6c41104a1a08ff1a25e260d3edec3ac19203141d1aaa2f0975  Building wheel for alembic (setup.py): started  Building wheel for alembic (setup.py): finished with status 'done'  Created wheel for alembic: filename=alembic-1.3.1-py2.py3-none-any.whl size=144523 sha256=e3bb8a208092fbd28e14d995179054de5d9cfcb91049c6e91fcfdecfbd12e485  Stored in directory: /tmp/pip-ephem-wheel-cache-bxs0p5da/wheels/b2/d4/19/5ab879d30af7cbc79e6dcc1d421795b1aa9d78f455b0412ef7  Building wheel for Mako (setup.py): started  Building wheel for Mako (setup.py): finished with status 'done'  Created wheel for Mako: filename=Mako-1.1.0-cp36-none-any.whl size=75363 sha256=ace67a5e196c4a3f6a37c1ad45ee57d555b848cce5997782240fb77d91415404  Stored in directory: /tmp/pip-ephem-wheel-cache-bxs0p5da/wheels/98/32/7b/a291926643fc1d1e02593e0d9e247c5a866a366b8343b7aa27  Successfully built slackclient simplejson sqlalchemy alembic Mako  Installing collected packages: certifi, idna, urllib3, chardet, requests, pytz, pillow, six, websocket-client, slackclient, textwrap3, lxml, simplejson, sqlalchemy, MarkupSafe, Mako, python-editor, python-dateutil, alembic, scraperwiki  Running setup.py develop for scraperwiki  Successfully installed Mako-1.1.0 MarkupSafe-1.1.1 alembic-1.3.1 certifi-2019.11.28 chardet-3.0.4 idna-2.6 lxml-4.1.1 pillow-5.2.0 python-dateutil-2.8.1 python-editor-1.0.4 pytz-2017.3 requests-2.18.4 scraperwiki simplejson-3.16.0 six-1.13.0 slackclient-1.2.0 sqlalchemy-1.3.11 textwrap3-0.9.1 urllib3-1.22 websocket-client-0.56.0   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... http://www.legco.gov.hk/php/detect-votes.php?term=yr19-20&meeting=cm http://www.legco.gov.hk/yr19-20/chinese/counmtg/voting/cm_vote_20191023.xml already loaded to API server. http://www.legco.gov.hk/yr19-20/chinese/counmtg/voting/cm_vote_20191127.xml already loaded to API server. http://www.legco.gov.hk/yr19-20/chinese/counmtg/voting/cm_vote_20191204.xml already loaded to API server. http://www.legco.gov.hk/php/detect-votes.php?term=yr19-20&meeting=esc http://www.legco.gov.hk/php/detect-votes.php?term=yr19-20&meeting=pwsc http://www.legco.gov.hk/yr19-20/chinese/fc/pwsc/results/pwsc_vote_20191120.xml already loaded to API server. http://www.legco.gov.hk/yr19-20/chinese/fc/pwsc/results/pwsc_vote_20191106.xml already loaded to API server. http://www.legco.gov.hk/php/detect-votes.php?term=yr19-20&meeting=hc http://www.legco.gov.hk/yr19-20/chinese/hc/voting/hc_vote_20191122.xml already loaded to API server. http://www.legco.gov.hk/yr19-20/chinese/hc/voting/hc_vote_20191129.xml already loaded to API server. http://www.legco.gov.hk/php/detect-votes.php?term=yr19-20&meeting=fc http://www.legco.gov.hk/yr19-20/chinese/fc/fc/results/fc_vote_20191108.xml already loaded to API server. http://www.legco.gov.hk/yr19-20/chinese/fc/fc/results/fc_vote_20191206.xml already loaded to API server.

Statistics

Average successful run time: 1 minute

Total run time: 41 minutes

Total cpu time used: half a minute

Total disk space used: 93.8 KB

History

  • Auto ran revision 35da34ca and completed successfully .
    9 records added, 9 records removed in the database
  • Auto ran revision 35da34ca and completed successfully .
    9 records added, 9 records removed in the database
  • Auto ran revision 35da34ca and completed successfully .
    9 records added, 9 records removed in the database
  • Auto ran revision 35da34ca and completed successfully .
    9 records added, 9 records removed in the database
  • Auto ran revision 35da34ca and completed successfully .
    9 records added, 7 records removed in the database
  • ...
  • Created on morph.io

Show complete history