g0vhkio / legco-council-meeting-question-bot

Bot for crawling https://www.legco.gov.hk/yr16-17/chinese/counmtg/question/ques1617.htm

README.md

legco-council-meeting-question-bot

Bot for crawling https://www.legco.gov.hk/yr16-17/chinese/counmtg/question/ques1617.htm

Contributors

Last run failed 2020-01-28 with status code 1.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Python app detected [1G ! The latest version of Python 3 is python-3.6.2 (you are using python-3.6.4, which is unsupported). [1G ! We recommend upgrading by specifying the latest version (python-3.6.2). [1G Learn More: https://devcenter.heroku.com/articles/python-runtimes [1G-----> Installing python-3.6.4 [1G-----> Installing pip [1G-----> Installing requirements with pip [1G Collecting requests==2.18.4 [1G Downloading requests-2.18.4-py2.py3-none-any.whl (88 kB) [1G Collecting pytz==2017.3 [1G Downloading pytz-2017.3-py2.py3-none-any.whl (511 kB) [1G Collecting pillow==5.2.0 [1G Downloading Pillow-5.2.0-cp36-cp36m-manylinux1_x86_64.whl (2.0 MB) [1G Collecting slackclient==1.2.0 [1G Downloading slackclient-1.2.0.tar.gz (14 kB) [1G Collecting textwrap3==0.9.1 [1G Downloading textwrap3-0.9.1-py2.py3-none-any.whl (12 kB) [1G Collecting lxml==4.1.1 [1G Downloading lxml-4.1.1-cp36-cp36m-manylinux1_x86_64.whl (5.6 MB) [1G Collecting simplejson==3.16.0 [1G Downloading simplejson-3.16.0.tar.gz (81 kB) [1G Obtaining scraperwiki from git+http://github.com/andylolz/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 8)) [1G Cloning http://github.com/andylolz/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki [1G Running command git clone -q http://github.com/andylolz/scraperwiki-python.git /app/.heroku/src/scraperwiki [1G Running command git checkout -b morph_defaults --track origin/morph_defaults [1G Switched to a new branch 'morph_defaults' [1G Branch morph_defaults set up to track remote branch morph_defaults from origin. [1G Collecting certifi>=2017.4.17 [1G Downloading certifi-2019.11.28-py2.py3-none-any.whl (156 kB) [1G Collecting idna<2.7,>=2.5 [1G Downloading idna-2.6-py2.py3-none-any.whl (56 kB) [1G Collecting chardet<3.1.0,>=3.0.2 [1G Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB) [1G Collecting urllib3<1.23,>=1.21.1 [1G Downloading urllib3-1.22-py2.py3-none-any.whl (132 kB) [1G Collecting websocket-client<1.0a0,>=0.35 [1G Downloading websocket_client-0.57.0-py2.py3-none-any.whl (200 kB) [1G Collecting six<2.0a0,>=1.10 [1G Downloading six-1.14.0-py2.py3-none-any.whl (10 kB) [1G Collecting sqlalchemy [1G Downloading SQLAlchemy-1.3.13.tar.gz (6.0 MB) [1G Collecting alembic [1G Downloading alembic-1.3.3.tar.gz (1.1 MB) [1G Collecting Mako [1G Downloading Mako-1.1.1.tar.gz (468 kB) [1G Collecting python-editor>=0.3 [1G Downloading python_editor-1.0.4-py3-none-any.whl (4.9 kB) [1G Collecting python-dateutil [1G Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB) [1G Collecting MarkupSafe>=0.9.2 [1G Downloading MarkupSafe-1.1.1-cp36-cp36m-manylinux1_x86_64.whl (27 kB) [1G Building wheels for collected packages: slackclient, simplejson, sqlalchemy, alembic, Mako [1G Building wheel for slackclient (setup.py): started [1G Building wheel for slackclient (setup.py): finished with status 'done' [1G Created wheel for slackclient: filename=slackclient-1.2.0-py2.py3-none-any.whl size=16926 sha256=0d364f30a7be30dfd638925ff4beb05c78d9d991db97111402bf1b281cfe03a6 [1G Stored in directory: /tmp/pip-ephem-wheel-cache-srnqxu_x/wheels/98/3b/e0/34fc1e36412d56bfc3453032836897b02518e18dec9e071e3a [1G Building wheel for simplejson (setup.py): started [1G Building wheel for simplejson (setup.py): finished with status 'done' [1G Created wheel for simplejson: filename=simplejson-3.16.0-cp36-cp36m-linux_x86_64.whl size=118877 sha256=6b04d02d5249f9dfc5bc6467508ff0bf2fe4bbf671dd5c8e8eb39aa4063be2df [1G Stored in directory: /tmp/pip-ephem-wheel-cache-srnqxu_x/wheels/fc/f1/eb/61fc974e24fc8c2fca0b524ab400636baced588708d25b16b4 [1G Building wheel for sqlalchemy (setup.py): started [1G Building wheel for sqlalchemy (setup.py): finished with status 'done' [1G Created wheel for sqlalchemy: filename=SQLAlchemy-1.3.13-cp36-cp36m-linux_x86_64.whl size=1203906 sha256=ded638f80574405efdcbb4e74ca2a9869ab7c42d6ea3314ae90592225a3f989d [1G Stored in directory: /tmp/pip-ephem-wheel-cache-srnqxu_x/wheels/28/3e/f9/8eca04781258bb6956ffba37e4e6e6951e5b3a16d4494b91cb [1G Building wheel for alembic (setup.py): started [1G Building wheel for alembic (setup.py): finished with status 'done' [1G Created wheel for alembic: filename=alembic-1.3.3-py2.py3-none-any.whl size=155683 sha256=6b49cd75abab86fe452bd31e0fd12b4097fa650b24a725af375ccd4f9b49e3ef [1G Stored in directory: /tmp/pip-ephem-wheel-cache-srnqxu_x/wheels/43/98/73/9e9700cf8d058899cd54a465024e3c22176764690c6ec7b1e3 [1G Building wheel for Mako (setup.py): started [1G Building wheel for Mako (setup.py): finished with status 'done' [1G Created wheel for Mako: filename=Mako-1.1.1-py3-none-any.whl size=75408 sha256=f85486a20fcfb49cada4e502d9893fa0c7bdb7557d76db0ebb409b452e2448c2 [1G Stored in directory: /tmp/pip-ephem-wheel-cache-srnqxu_x/wheels/43/b1/7c/f14ef20f4683e5087ae684c6447194e09695315f20b9c45575 [1G Successfully built slackclient simplejson sqlalchemy alembic Mako [1G Installing collected packages: certifi, idna, chardet, urllib3, requests, pytz, pillow, six, websocket-client, slackclient, textwrap3, lxml, simplejson, sqlalchemy, MarkupSafe, Mako, python-editor, python-dateutil, alembic, scraperwiki [1G Running setup.py develop for scraperwiki [1G Successfully installed Mako-1.1.1 MarkupSafe-1.1.1 alembic-1.3.3 certifi-2019.11.28 chardet-3.0.4 idna-2.6 lxml-4.1.1 pillow-5.2.0 python-dateutil-2.8.1 python-editor-1.0.4 pytz-2017.3 requests-2.18.4 scraperwiki simplejson-3.16.0 six-1.14.0 slackclient-1.2.0 sqlalchemy-1.3.13 textwrap3-0.9.1 urllib3-1.22 websocket-client-0.57.0 [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... 19 https://www.legco.gov.hk/yr19-20/chinese/counmtg/question/ques1920.htm 2019-10-23 https://www.info.gov.hk/gia/general/201910/23/P2019102300359.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300393.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300530.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300579.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300519.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300435.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300357.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300457.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300218.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300246.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300380.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300350.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300303.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300267.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300504.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300616.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300628.htm https://www.info.gov.hk/gia/general/201910/23/P2019102200483.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300552.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300500.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300381.htm https://www.info.gov.hk/gia/general/201910/23/P2019102300300.htm 2019-10-30 https://www.info.gov.hk/gia/general/201910/30/P2019103000356.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000471.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000393.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000448.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000403.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000408.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000350.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000378.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000297.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000310.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000454.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000209.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000267.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000223.htm https://www.info.gov.hk/gia/general/201910/30/P2019102900497.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000449.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000367.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000354.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000458.htm https://www.info.gov.hk/gia/general/201910/30/P2019103000331.htm 2019-11-06 https://www.info.gov.hk/gia/general/201911/06/P2019110600364.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600511.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600506.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600538.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600443.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600446.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600522.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600580.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600228.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600480.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600393.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600308.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600249.htm https://www.info.gov.hk/gia/general/201911/06/P2019110500274.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600269.htm https://www.info.gov.hk/gia/general/201911/06/P2019110500360.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600806.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600336.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600362.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600496.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600373.htm https://www.info.gov.hk/gia/general/201911/06/P2019110600286.htm 2019-11-13 https://www.info.gov.hk/gia/general/201911/13/P2019111300648.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300524.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300538.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300546.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300526.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300529.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300585.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300570.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300356.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300448.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300400.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300429.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300476.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300660.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300650.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300474.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300482.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300541.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300484.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300375.htm?fontSize=1 https://www.info.gov.hk/gia/general/201911/13/P2019111300387.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300556.htm https://www.info.gov.hk/gia/general/201911/13/P2019111300319.htm 2019-11-20 https://www.info.gov.hk/gia/general/201911/20/P2019112000445.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000516.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000558.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000691.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000543.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000581.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000580.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000481.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000619.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000332.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000702.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000493.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000324.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000354.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000647.htm?fontSize=1 https://www.info.gov.hk/gia/general/201911/20/P2019112000535.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000672.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000352.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000383.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000232.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000327.htm https://www.info.gov.hk/gia/general/201911/20/P2019112000294.htm 2019-11-27 https://www.info.gov.hk/gia/general/201911/27/P2019112700332.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700465.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700427.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700445.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700446.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700559.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700421.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700309.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700229.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700438.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700395.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700259.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700382.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700598.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700594.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700542.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700398.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700384.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700387.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700343.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700340.htm https://www.info.gov.hk/gia/general/201911/27/P2019112700412.htm 2019-12-04 https://www.info.gov.hk/gia/general/201912/04/P2019120400475.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400459.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400395.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400408.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400404.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400505.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400441.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400309.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400438.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400297.htm https://www.info.gov.hk/gia/general/201912/04/P2019120300624.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400341.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400282.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400225.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400476.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400351.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400264.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400259.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400450.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400462.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400365.htm https://www.info.gov.hk/gia/general/201912/04/P2019120400488.htm 2019-12-11 https://www.info.gov.hk/gia/general/201912/11/P2019121100478.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100431.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100510.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100426.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100491.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100459.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100338.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100554.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100361.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100581.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100331.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100627.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100407.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100577.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100319.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100296.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100485.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100584.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100505.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100374.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100351.htm https://www.info.gov.hk/gia/general/201912/11/P2019121100466.htm 2019-12-18 https://www.info.gov.hk/gia/general/201912/18/P2019121800463.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800447.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800377.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800403.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800535.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800523.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800325.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800554.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800543.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800332.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800545.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800274.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800383.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800397.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800374.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800682.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800299.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800300.htm https://www.info.gov.hk/gia/general/201912/18/P2019121700604.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800341.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800354.htm https://www.info.gov.hk/gia/general/201912/18/P2019121800395.htm 2020-01-08 https://www.info.gov.hk/gia/general/202001/08/P2020010800472.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800378.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800419.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800634.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800576.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800568.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800625.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800639.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800627.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800348.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800270.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800459.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800373.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800486.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800256.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800293.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800360.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800259.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800311.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800414.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800320.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800488.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800365.htm https://www.info.gov.hk/gia/general/202001/08/P2020010800387.htm 2020-01-15 https://www.info.gov.hk/gia/general/202001/15/P2020011500500.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500337.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500391.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500496.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500473.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500481.htm https://www.info.gov.hk/gia/general/202001/15/P2020011400672.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500278.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500283.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500246.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500382.htm?fontSize=1 https://www.info.gov.hk/gia/general/202001/15/P2020011400585.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500323.htm https://www.info.gov.hk/gia/general/202001/15/P2020011400654.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500461.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500354.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500258.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500387.htm https://www.info.gov.hk/gia/general/202001/15/P2020011400564.htm https://www.info.gov.hk/gia/general/202001/15/P2020011500223.htm Traceback (most recent call last): File "scraper.py", line 139, in <module> crawl(TOKEN, CHANNEL, LEGCO_API_TOKEN, YEAR) File "scraper.py", line 72, in crawl raise Exception("Undefined Question Type", link, question_type_text) Exception: ('Undefined Question Type', 'https://www.info.gov.hk/gia/general/202001/15/P2020011500378.htm', 'Q. 21\r\n(書面質詢)')

Data

Downloaded 1 time by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (272 KB) Use the API

rows 10 / 1402

key	date	link	individual
784834a4eaf6c13013ba745701591bc6	2018-10-24	https://www.info.gov.hk/gia/general/201810/24/P2018102400399.htm	范國威議員
684b4e44ed0d9bb6d0dff411e5b4f763	2018-10-24	https://www.info.gov.hk/gia/general/201810/24/P2018102400505.htm	盧偉國議員
873b9633d02157d29845cfb5937e1c92	2018-10-24	https://www.info.gov.hk/gia/general/201810/24/P2018102400540.htm	陳恒鑌議員
bddea1da3eed2cd41a1be281aefd6407	2018-10-24	https://www.info.gov.hk/gia/general/201810/24/P2018102400528.htm	何啟明議員
160ef23abe14df2495a2ca47c8bd3621	2018-10-24	https://www.info.gov.hk/gia/general/201810/24/P2018102400637.htm	郭偉強
dca7711b2efa9226ff81931e661fd5c4	2018-10-24	https://www.info.gov.hk/gia/general/201810/24/P2018102400613.htm	葛珮帆議員
96eb6f987f06a47ec16125502b840eb2	2018-10-24	https://www.info.gov.hk/gia/general/201810/24/P2018102400442.htm	林卓廷議員
692eceecafcf09c33214443470e78eda	2018-10-24	https://www.info.gov.hk/gia/general/201810/24/P2018102400316.htm	謝偉銓議員
da08d32989187f53b3754d05c8fd8fb0	2018-10-24	https://www.info.gov.hk/gia/general/201810/24/P2018102400455.htm	吳永嘉議員
9829545820ffb420c75e0c2570a7bad5	2018-10-24	https://www.info.gov.hk/gia/general/201810/24/P2018102400639.htm	李國麟議員

Statistics

Average successful run time: 5 minutes

Total run time: about 8 hours

Total cpu time used: 16 minutes

Total disk space used: 312 KB

History

Auto ran revision 53d39072 and failed 2020-01-28.

run time 6 minutes

nothing changed in the database
Auto ran revision 53d39072 and failed 2020-01-27.

run time 7 minutes

nothing changed in the database
Auto ran revision 53d39072 and failed 2020-01-26.

run time 7 minutes

nothing changed in the database
Auto ran revision 53d39072 and failed 2020-01-25.

run time 7 minutes

nothing changed in the database
Auto ran revision 53d39072 and failed 2020-01-24.

run time 7 minutes

nothing changed in the database
...
Created on morph.io 2019-11-05

Show complete history

Scraper code

Python

legco-council-meeting-question-bot / scraper.py

git clone URL