howawong / hong_kong_current_consultation_pages

Current Consultation Papers from http://www.gov.hk/en/residents/government/publication/consultation/current.htm

README.md

This is a scraper that runs on Morph. To get started see the documentation

Contributors

Last run completed successfully 2017-08-23.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Python app detected [1G-----> Installing python-2.7.9 [1G $ pip install -r requirements.txt [1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6)) [1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to /app/.heroku/src/scraperwiki [1G Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 8)) [1G Downloading lxml-3.4.4.tar.gz (3.5MB) [1G Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 9)) [1G Downloading cssselect-0.9.1.tar.gz [1G Collecting Scrapy==1.0.3 (from -r /tmp/build/requirements.txt (line 10)) [1G Downloading Scrapy-1.0.3-py2-none-any.whl (290kB) [1G Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 6)) [1G Downloading dumptruck-0.1.6.tar.gz [1G Collecting requests (from scraperwiki->-r /tmp/build/requirements.txt (line 6)) [1G Downloading requests-2.18.4-py2.py3-none-any.whl (88kB) [1G Collecting service-identity (from Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading service_identity-17.0.0-py2.py3-none-any.whl [1G Collecting pyOpenSSL (from Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading pyOpenSSL-17.2.0-py2.py3-none-any.whl (52kB) [1G Collecting queuelib (from Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading queuelib-1.4.2-py2.py3-none-any.whl [1G Collecting six>=1.5.2 (from Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading six-1.10.0-py2.py3-none-any.whl [1G Collecting Twisted>=10.0.0 (from Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading Twisted-17.5.0.tar.bz2 (3.0MB) [1G Collecting w3lib>=1.8.0 (from Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading w3lib-1.18.0-py2.py3-none-any.whl [1G Collecting idna<2.7,>=2.5 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6)) [1G Downloading idna-2.6-py2.py3-none-any.whl (56kB) [1G Collecting urllib3<1.23,>=1.21.1 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6)) [1G Downloading urllib3-1.22-py2.py3-none-any.whl (132kB) [1G Collecting certifi>=2017.4.17 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6)) [1G Downloading certifi-2017.7.27.1-py2.py3-none-any.whl (349kB) [1G Collecting chardet<3.1.0,>=3.0.2 (from requests->scraperwiki->-r /tmp/build/requirements.txt (line 6)) [1G Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB) [1G Collecting pyasn1 (from service-identity->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading pyasn1-0.3.2-py2.py3-none-any.whl (63kB) [1G Collecting pyasn1-modules (from service-identity->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading pyasn1_modules-0.0.11-py2.py3-none-any.whl (60kB) [1G Collecting attrs (from service-identity->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading attrs-17.2.0-py2.py3-none-any.whl [1G Collecting cryptography>=1.9 (from pyOpenSSL->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading cryptography-2.0.3-cp27-cp27m-manylinux1_x86_64.whl (2.2MB) [1G Collecting zope.interface>=3.6.0 (from Twisted>=10.0.0->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading zope.interface-4.4.2-cp27-cp27m-manylinux1_x86_64.whl (170kB) [1G Collecting constantly>=15.1 (from Twisted>=10.0.0->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading constantly-15.1.0-py2.py3-none-any.whl [1G Collecting incremental>=16.10.1 (from Twisted>=10.0.0->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading incremental-17.5.0-py2.py3-none-any.whl [1G Collecting Automat>=0.3.0 (from Twisted>=10.0.0->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading Automat-0.6.0-py2.py3-none-any.whl [1G Collecting hyperlink>=17.1.1 (from Twisted>=10.0.0->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading hyperlink-17.3.1-py2.py3-none-any.whl (73kB) [1G Collecting ipaddress (from cryptography>=1.9->pyOpenSSL->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading ipaddress-1.0.18-py2-none-any.whl [1G Collecting asn1crypto>=0.21.0 (from cryptography>=1.9->pyOpenSSL->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading asn1crypto-0.22.0-py2.py3-none-any.whl (97kB) [1G Collecting enum34 (from cryptography>=1.9->pyOpenSSL->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading enum34-1.1.6-py2-none-any.whl [1G Collecting cffi>=1.7 (from cryptography>=1.9->pyOpenSSL->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading cffi-1.10.0-cp27-cp27m-manylinux1_x86_64.whl (394kB) [1G Collecting pycparser (from cffi>=1.7->cryptography>=1.9->pyOpenSSL->Scrapy==1.0.3->-r /tmp/build/requirements.txt (line 10)) [1G Downloading pycparser-2.18.tar.gz (245kB) [1G Installing collected packages: dumptruck, idna, urllib3, certifi, chardet, requests, scraperwiki, lxml, cssselect, pyasn1, pyasn1-modules, six, ipaddress, asn1crypto, enum34, pycparser, cffi, cryptography, pyOpenSSL, attrs, service-identity, queuelib, zope.interface, constantly, incremental, Automat, hyperlink, Twisted, w3lib, Scrapy [1G Running setup.py install for dumptruck: started [1G Running setup.py install for dumptruck: finished with status 'done' [1G Running setup.py develop for scraperwiki [1G Running setup.py install for lxml: started [1G Running setup.py install for lxml: still running... [1G Running setup.py install for lxml: finished with status 'done' [1G Running setup.py install for cssselect: started [1G Running setup.py install for cssselect: finished with status 'done' [1G Running setup.py install for pycparser: started [1G Running setup.py install for pycparser: finished with status 'done' [1G Running setup.py install for Twisted: started [1G Running setup.py install for Twisted: finished with status 'done' [1G Successfully installed Automat-0.6.0 Scrapy-1.0.3 Twisted-17.5.0 asn1crypto-0.22.0 attrs-17.2.0 certifi-2017.7.27.1 cffi-1.10.0 chardet-3.0.4 constantly-15.1.0 cryptography-2.0.3 cssselect-0.9.1 dumptruck-0.1.6 enum34-1.1.6 hyperlink-17.3.1 idna-2.6 incremental-17.5.0 ipaddress-1.0.18 lxml-3.4.4 pyOpenSSL-17.2.0 pyasn1-0.3.2 pyasn1-modules-0.0.11 pycparser-2.18 queuelib-1.4.2 requests-2.18.4 scraperwiki service-identity-17.0.0 six-1.10.0 urllib3-1.22 w3lib-1.18.0 zope.interface-4.4.2 [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... 2017-08-23 09:20:56 [scrapy] INFO: Scrapy 1.0.3 started (bot: scrapybot) 2017-08-23 09:20:56 [scrapy] INFO: Optional features available: http11, ssl 2017-08-23 09:20:56 [scrapy] INFO: Overridden settings: {} 2017-08-23 09:20:56 [scrapy] INFO: Enabled extensions: TelnetConsole, SpiderState, CoreStats, CloseSpider, LogStats 2017-08-23 09:20:56 [scrapy] INFO: Enabled downloader middlewares: HttpAuthMiddleware, DownloadTimeoutMiddleware, UserAgentMiddleware, RetryMiddleware, DefaultHeadersMiddleware, MetaRefreshMiddleware, HttpCompressionMiddleware, RedirectMiddleware, CookiesMiddleware, ChunkedTransferMiddleware, DownloaderStats 2017-08-23 09:20:56 [scrapy] INFO: Enabled spider middlewares: HttpErrorMiddleware, OffsiteMiddleware, RefererMiddleware, UrlLengthMiddleware, DepthMiddleware 2017-08-23 09:20:56 [scrapy] INFO: Enabled item pipelines: 2017-08-23 09:20:56 [scrapy] INFO: Spider opened 2017-08-23 09:20:56 [scrapy] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2017-08-23 09:20:56 [scrapy] DEBUG: Telnet console listening on 127.0.0.1:6023 2017-08-23 09:20:56 [scrapy] ERROR: Error downloading <GET http://www.gov.hk/en/residents/government/publication/consultation/current.htm> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 41, in download_request return handler(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 44, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 211, in download_request d = agent.request(method, url, headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1639, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1416, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1302, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1314, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2017-08-23 09:20:56 [scrapy] ERROR: Error downloading <GET http://www.gov.hk/tc/residents/government/publication/consultation/current.htm> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 41, in download_request return handler(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 44, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 211, in download_request d = agent.request(method, url, headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1639, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1416, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1302, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1314, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2017-08-23 09:20:56 [scrapy] ERROR: Error downloading <GET http://www.gov.hk/sc/residents/government/publication/consultation/current.htm> Traceback (most recent call last): File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/utils/defer.py", line 45, in mustbe_deferred result = f(*args, **kw) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/__init__.py", line 41, in download_request return handler(request, spider) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 44, in download_request return agent.download_request(request) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/core/downloader/handlers/http11.py", line 211, in download_request d = agent.request(method, url, headers, bodyproducer) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1639, in request parsedURI.originForm) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1416, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1302, in getConnection return self._newConnection(key, endpoint) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/web/client.py", line 1314, in _newConnection return endpoint.connect(factory) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/endpoints.py", line 903, in connect EndpointReceiver, self._hostText, portNumber=self._port File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/_resolver.py", line 189, in resolveHostName onAddress = self._simpleResolver.getHostByName(hostName) File "/app/.heroku/python/lib/python2.7/site-packages/scrapy/resolver.py", line 21, in getHostByName d = super(CachingThreadedResolver, self).getHostByName(name, timeout) File "/app/.heroku/python/lib/python2.7/site-packages/twisted/internet/base.py", line 276, in getHostByName timeoutDelay = sum(timeout) TypeError: 'float' object is not iterable 2017-08-23 09:20:56 [scrapy] INFO: Closing spider (finished) 2017-08-23 09:20:56 [scrapy] INFO: Dumping Scrapy stats: {'downloader/exception_count': 3, 'downloader/exception_type_count/exceptions.TypeError': 3, 'downloader/request_bytes': 804, 'downloader/request_count': 3, 'downloader/request_method_count/GET': 3, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2017, 8, 23, 9, 20, 56, 748463), 'log_count/DEBUG': 1, 'log_count/ERROR': 3, 'log_count/INFO': 7, 'scheduler/dequeued': 3, 'scheduler/dequeued/memory': 3, 'scheduler/enqueued': 3, 'scheduler/enqueued/memory': 3, 'start_time': datetime.datetime(2017, 8, 23, 9, 20, 56, 432753)} 2017-08-23 09:20:56 [scrapy] INFO: Spider closed (finished)

Data

Downloaded 142 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (25 KB) Use the API

rows 10 / 64

link	title	lang	date
http://www.mwc.org.hk/en/invite-views/invite-views.html	Review of Statutory Minimum Wage Rate Public Consultation	en	2016-05-22T00:00:00+00:00
http://www.mwc.org.hk/tc/invite-views/invite-views.html	法定最低工資水平檢討公眾諮詢	tc	2016-05-22T00:00:00+00:00
http://www.mwc.org.hk/sc/invite-views/invite-views.html	法定最低工资水平检讨公众咨询	sc	2016-05-22T00:00:00+00:00
http://www.eac.gov.hk/ch/ecse/2016ecse_proposed_guide.htm	選舉委員會界別分組選舉活動建議指引公眾諮詢	tc	2016-06-09T00:00:00+00:00
http://www.tid.gov.hk/tc_chi/aboutus/noticeboard/maldivesgeorgiafta.html	香港將與格魯吉亞和馬爾代夫談判自由貿易協定	tc	2016-06-06T00:00:00+00:00
http://www.eac.gov.hk/en/ecse/2016ecse_proposed_guide.htm	Public consultation on the Proposed Guidelines on Election-related Activities in respect of the Election Committee Subsector Elections	en	2016-06-09T00:00:00+00:00
http://www.tid.gov.hk/english/aboutus/noticeboard/maldivesgeorgiafta.html	Hong Kong to Negotiate Free Trade Agreements with Georgia and Maldives	en	2016-06-06T00:00:00+00:00
http://www.eac.gov.hk/sc/ecse/2016ecse_proposed_guide.htm	选举委员会界别分组选举活动建议指引公众咨询	sc	2016-06-09T00:00:00+00:00
http://www.tid.gov.hk/sc_chi/aboutus/noticeboard/maldivesgeorgiafta.html	香港将与格鲁吉亚和马尔代夫谈判自由贸易协定	sc	2016-06-06T00:00:00+00:00
http://www.labour.gov.hk/tc/copconsultation.htm	《職業介紹所實務守則》草擬本諮詢	tc	2016-06-17T00:00:00+00:00

Statistics

Average successful run time: 2 minutes

Total run time: 17 days

Total cpu time used: 6 minutes

Total disk space used: 100 KB

History

Auto ran revision 053233cb and completed successfully 2017-08-23.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-22.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-21.

run time 3 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-20.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-19.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-18.

run time 4 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-17.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-16.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and failed 2017-08-15.

run time 49 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-14.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-13.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-12.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-11.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-10.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-09.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-08.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-07.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-06.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-03.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-02.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-08-01.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-31.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-30.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-29.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-28.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-27.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-26.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-25.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-24.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-23.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-22.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-21.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-19.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-18.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-17.

run time 5 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-16.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-15.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-14.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-13.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-12.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-11.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-10.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-09.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-08.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-07.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-06.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-05.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-04.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-03.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-02.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-07-01.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-30.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-29.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-28.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-27.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-26.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-25.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-24.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-23.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-22.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-21.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-20.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-19.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-18.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-17.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-16.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-15.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-14.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-13.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-12.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-11.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-10.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-09.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-08.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-07.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-06.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-05.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-04.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-03.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-02.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-06-01.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-31.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-30.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-29.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-28.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-27.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-26.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-25.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-24.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-23.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-22.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-21.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-20.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-19.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-18.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-17.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-16.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-15.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-14.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-13.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-12.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-11.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-10.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-09.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-08.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-07.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-06.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-05.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-04.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-03.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-02.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-05-01.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-30.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-29.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-28.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-27.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-26.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-25.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-24.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-23.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-22.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-21.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-20.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-19.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-18.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-17.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-16.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-15.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-14.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-13.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-12.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-11.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-10.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-09.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-08.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-07.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-06.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-05.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-04.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-03.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-02.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-04-01.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-31.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-30.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-29.

run time 3 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-28.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-26.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-26.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-25.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-24.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-23.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-22.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-21.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-20.

run time 5 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-19.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-18.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-17.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-16.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-15.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-14.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-13.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-10.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-09.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-08.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-06.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-06.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-05.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-04.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-03.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-03.

run time 4 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-03-01.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and failed 2017-02-28.

run time 10 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-26.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-26.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-25.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-24.

run time 4 s

nothing changed in the database

1 page scraped
Auto ran revision 053233cb and completed successfully 2017-02-23.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-22.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-21.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-20.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-19.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-18.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-17.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-16.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-15.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-13.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-12.

run time 3 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-11.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-10.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-09.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-08.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-07.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2017-02-06.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-05.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-03.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2017-02-03.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-02.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-02-01.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-01-31.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2017-01-31.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2017-01-27.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and failed 2017-01-26.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-01-25.

run time 3 minutes

nothing changed in the database
Auto ran and failed 2017-01-25.

run time 0 s
Auto ran revision 053233cb and failed 2017-01-19.

run time 1 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2017-01-18.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2017-01-17.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2017-01-16.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and failed 2017-01-15.

run time 16 days
Auto ran revision 053233cb and completed successfully 2016-12-28.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-27.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-26.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and failed 2016-12-25.

run time 1 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-24.

run time 2 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-12-23.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-20.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-19.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-18.

run time 3 minutes

nothing changed in the database
Manually ran revision 053233cb and completed successfully 2016-12-18.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and failed 2016-12-16.

run time 1 minute

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-12.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-11.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-10.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-12-09.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-08.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-07.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-06.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-05.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-04.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-12-03.

run time 3 minutes

nothing changed in the database

2 pages scraped
Auto ran revision 053233cb and completed successfully 2016-12-02.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-11-25.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-11-24.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-11-23.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-11-22.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-11-21.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-11-20.

run time 5 s

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-11-19.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-11-18.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-11-17.

run time 2 minutes

nothing changed in the database

2 pages scraped
Auto ran revision 053233cb and completed successfully 2016-11-15.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-11-15.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-11-14.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-11-12.

run time 3 minutes

18 records added, 18 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-11-12.

run time 3 minutes

18 records added, 18 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-11-10.

run time 3 minutes

21 records added, 21 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-11-09.

run time 3 minutes

21 records added, 21 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-11-08.

run time 2 minutes

21 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-11-07.

run time 3 s

15 records added, 15 records removed in the database

5 pages scraped
Auto ran revision 053233cb and completed successfully 2016-11-06.

run time 3 minutes

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-11-05.

run time 2 minutes

15 records added, 15 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-11-04.

run time 3 minutes

21 records added, 21 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-11-03.

run time 2 minutes

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-11-02.

run time 3 minutes

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-11-01.

run time 3 minutes

24 records added, 21 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-31.

run time 2 minutes

21 records added, 21 records removed in the database

2 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-30.

run time 3 minutes

21 records added, 21 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-29.

run time 3 minutes

21 records added, 18 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-27.

run time 3 minutes

18 records added, 18 records removed in the database

2 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-27.

run time 3 minutes

18 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-26.

run time 3 minutes

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-25.

run time 2 minutes

15 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-24.

run time 5 s

nothing changed in the database

2769 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-23.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-10-20.

run time 2 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-19.

run time 2 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-18.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-10-17.

run time 3 minutes

9 records added, 9 records removed in the database

2 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-16.

run time 3 minutes

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-15.

run time 2 minutes

9 records added, 9 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-14.

run time 2 minutes

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-13.

run time 2 minutes

9 records added, 9 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-12.

run time 2 minutes

9 records added, 9 records removed in the database

2 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-11.

run time 2 minutes

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-10.

run time 2 minutes

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-09.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-10-08.

run time 2 minutes

9 records added, 9 records removed in the database

2 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-07.

run time 3 minutes

9 records added, 9 records removed in the database

2 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-06.

run time 2 minutes

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-04.

run time 2 minutes

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-10-04.

run time 2 minutes

9 records added, 9 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-02.

run time 2 minutes

9 records added, 9 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-10-01.

run time 2 minutes

9 records added, 9 records removed in the database

2 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-30.

run time 2 minutes

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-09-29.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-09-28.

run time 3 minutes

9 records added, 9 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-27.

run time 2 minutes

9 records added, 9 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-26.

run time 2 minutes

9 records added, 9 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-25.

run time 2 minutes

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-09-24.

run time 2 minutes

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-09-23.

run time 2 minutes

9 records added, 5 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-22.

run time 2 minutes

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-21.

run time 3 s

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-20.

run time 4 s

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-19.

run time 3 minutes

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-18.

run time 2 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-17.

run time 2 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-16.

run time 2 minutes

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-15.

run time 4 s

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-14.

run time 3 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-09-14.

run time 47 s

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-09-11.

run time 3 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-09-10.

run time 2 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-09-09.

run time 2 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-09-08.

run time 3 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-09-07.

run time 3 minutes

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-06.

run time 5 minutes

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-05.

run time 4 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-09-04.

run time 5 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-09-03.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-09-02.

run time 3 minutes

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-09-01.

run time 2 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-08-31.

run time 2 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-08-30.

run time 3 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-08-29.

run time 2 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-08-28.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-08-27.

run time 2 minutes

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-08-26.

run time 4 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-08-25.

run time 3 minutes

6 records added, 6 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-08-24.

run time 5 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-08-23.

run time 4 minutes

6 records added, 6 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-08-22.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-08-21.

run time 3 minutes

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-08-20.

run time 5 s

nothing changed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-08-19.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-08-18.

run time 3 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-08-17.

run time 3 minutes

12 records added, 12 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-08-16.

run time 3 minutes

12 records added, 12 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-08-15.

run time 3 minutes

12 records added, 12 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-08-14.

run time 4 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-08-13.

run time 4 s

12 records added, 12 records removed in the database

2 pages scraped
Auto ran revision 053233cb and completed successfully 2016-08-12.

run time 4 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-08-11.

run time 5 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-08-10.

run time 4 minutes

12 records added, 12 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-08-07.

run time 7 s

12 records added, 12 records removed in the database

3 pages scraped
Auto ran revision 053233cb and completed successfully 2016-08-06.

run time 4 minutes

12 records added, 9 records removed in the database

3 pages scraped
Manually ran revision 053233cb and failed 2016-08-06.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and failed 2016-08-05.

run time 2 minutes

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-08-03.

run time 3 s

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-08-01.

run time 20 s

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-31.

run time 22 s

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-30.

run time 22 s

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-29.

run time 17 s

9 records added, 9 records removed in the database
Manually ran revision 053233cb and completed successfully 2016-07-29.

run time 22 s

9 records added, 6 records removed in the database
Auto ran and failed 2016-07-29.

run time 0 s
Auto ran revision 053233cb and completed successfully 2016-07-22.

run time 3 minutes

9 records added, 9 records removed in the database
Auto ran revision 053233cb and failed 2016-07-21.

run time 1 minute

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-07-20.

run time 29 s

9 records added, 9 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-19.

run time 30 s

12 records added, 12 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-18.

run time 29 s

12 records added, 12 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-17.

run time 28 s

12 records added, 12 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-16.

run time 25 s

12 records added, 12 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-15.

run time 3 minutes

12 records added, 12 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-14.

run time 21 s

12 records added, 12 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-13.

run time 18 s

12 records added, 12 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-12.

run time 17 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-11.

run time 20 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-10.

run time 22 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-09.

run time 18 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-08.

run time 22 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-07.

run time 25 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-06.

run time 16 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-05.

run time 18 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-04.

run time 18 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-03.

run time 21 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-02.

run time 26 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-07-01.

run time 20 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-30.

run time 24 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-29.

run time 17 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-28.

run time 20 s

15 records added, 15 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-27.

run time about 1 hour

nothing changed in the database
Auto ran revision 053233cb and completed successfully 2016-06-24.

run time 20 s

18 records added, 18 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-23.

run time 23 s

18 records added, 18 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-22.

run time 23 s

18 records added, 18 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-21.

run time 29 s

21 records added, 21 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-20.

run time 20 s

21 records added, 21 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-19.

run time 22 s

21 records added, 21 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-18.

run time 27 s

21 records added, 21 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-17.

run time 24 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-16.

run time 22 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-15.

run time 18 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-14.

run time 20 s

24 records added, 21 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-13.

run time 16 s

21 records added, 18 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-12.

run time 26 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-11.

run time 21 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-10.

run time 24 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-09.

run time 26 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-08.

run time 28 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-07.

run time 24 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-06.

run time 26 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-05.

run time 22 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-04.

run time 28 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-03.

run time 7 minutes

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-02.

run time 23 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-06-01.

run time 31 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-05-31.

run time 24 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-05-30.

run time 36 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-05-29.

run time 3 minutes

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-05-28.

run time 3 minutes

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-05-27.

run time 32 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-05-26.

run time 26 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-05-25.

run time 27 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-05-24.

run time 27 s

24 records added, 24 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-05-23.

run time 19 s

24 records added, 21 records removed in the database
Auto ran revision 053233cb and completed successfully 2016-05-22.

run time 23 s

24 records added, 24 records removed in the database
Manually ran revision 053233cb and completed successfully 2016-05-21.

run time 24 s

24 records added in the database
Manually ran revision 87ed93f8 and completed successfully 2016-05-21.

run time 30 s

24 records added in the database
Manually ran revision 87ed93f8 and completed successfully 2016-05-21.

run time 37 s

24 records added in the database
Created on morph.io 2016-05-21

Scraper code

Python

hong_kong_current_consultation_pages / scraper.py

git clone URL