This is a scraper that runs on Morph. To get started see the documentation

Contributors duncanparkes

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.9, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.9 -----> Installing pip -----> Installing requirements with pip  DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Collecting lxml==3.4.4  Downloading lxml-3.4.4.tar.gz (3.5 MB)  Collecting cssselect==0.9.1  Downloading cssselect-0.9.1.tar.gz (32 kB)  Collecting PyExecJS==1.1.0  Downloading PyExecJS-1.1.0.tar.gz (11 kB)  Collecting awesome-slugify==1.6.4  Downloading awesome-slugify-1.6.4.tar.gz (8.4 kB)  Collecting dumptruck>=0.1.2  Downloading dumptruck-0.1.6.tar.gz (15 kB)  Collecting requests  Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB)  Collecting regex  Downloading regex-2020.7.14.tar.gz (690 kB)  Collecting Unidecode<0.05,>=0.04.14  Downloading Unidecode-0.04.21-py2.py3-none-any.whl (228 kB)  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1  Downloading urllib3-1.25.10-py2.py3-none-any.whl (127 kB)  Collecting certifi>=2017.4.17  Downloading certifi-2020.6.20-py2.py3-none-any.whl (156 kB)  Collecting chardet<4,>=3.0.2  Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB)  Collecting idna<3,>=2.5  Downloading idna-2.10-py2.py3-none-any.whl (58 kB)  Building wheels for collected packages: lxml, cssselect, PyExecJS, awesome-slugify, dumptruck, regex  Building wheel for lxml (setup.py): started  Building wheel for lxml (setup.py): still running...  Building wheel for lxml (setup.py): finished with status 'done'  Created wheel for lxml: filename=lxml-3.4.4-cp27-cp27m-linux_x86_64.whl size=2989820 sha256=417f61525eb88a65785f76a68d2f0f413d5abae649dce9c32fc286d3c23ef25f  Stored in directory: /tmp/pip-ephem-wheel-cache-5R4ncJ/wheels/d6/de/81/11ae6edd05c75aac677e67dd154c85da758ba6f3e8e80e962e  Building wheel for cssselect (setup.py): started  Building wheel for cssselect (setup.py): finished with status 'done'  Created wheel for cssselect: filename=cssselect-0.9.1-py2-none-any.whl size=26993 sha256=47c762762ffdacfe2f1a0a4a2774fbf14952a389253fb3da5b53dda830fba46b  Stored in directory: /tmp/pip-ephem-wheel-cache-5R4ncJ/wheels/85/fe/00/b94036d8583cec9791d8cda24c184f2d2ac1397822f7f0e8d4  Building wheel for PyExecJS (setup.py): started  Building wheel for PyExecJS (setup.py): finished with status 'done'  Created wheel for PyExecJS: filename=PyExecJS-1.1.0-py2-none-any.whl size=9432 sha256=b286ac71161f721932eb820328e9ba86ead14f54b6896e37789846d347129658  Stored in directory: /tmp/pip-ephem-wheel-cache-5R4ncJ/wheels/d3/5d/f1/9b4c3099891293ad4da409d1a49f60a89fce12605c54a8019a  Building wheel for awesome-slugify (setup.py): started  Building wheel for awesome-slugify (setup.py): finished with status 'done'  Created wheel for awesome-slugify: filename=awesome_slugify-1.6.4-py2-none-any.whl size=8335 sha256=b9ba5494347eb95986c6771d7c1bab88def41ff1723d9befcd88b4f4b9b97e98  Stored in directory: /tmp/pip-ephem-wheel-cache-5R4ncJ/wheels/cd/07/d3/77bf73ea75d022f81c5322df341df4cba0d92a09e268353254  Building wheel for dumptruck (setup.py): started  Building wheel for dumptruck (setup.py): finished with status 'done'  Created wheel for dumptruck: filename=dumptruck-0.1.6-py2-none-any.whl size=11842 sha256=e5847d26221d2a4f5d9750b6d2e00c34db69c0d38abdff89322450d75d5ad75a  Stored in directory: /tmp/pip-ephem-wheel-cache-5R4ncJ/wheels/dc/75/e9/1e61c4080c73e7bda99614549591f83b53bcc2d682f26fce62  Building wheel for regex (setup.py): started  Building wheel for regex (setup.py): finished with status 'done'  Created wheel for regex: filename=regex-2020.7.14-cp27-cp27m-linux_x86_64.whl size=603246 sha256=430dfab7177628f550ce3bf5a264c978ef0be5f86c9d808b62f39126dc82695c  Stored in directory: /tmp/pip-ephem-wheel-cache-5R4ncJ/wheels/c4/ce/1e/c2303bc9574c7641ea1d26060f8634e7964b5b5f6513f68d40  Successfully built lxml cssselect PyExecJS awesome-slugify dumptruck regex  Installing collected packages: dumptruck, urllib3, certifi, chardet, idna, requests, scraperwiki, lxml, cssselect, PyExecJS, regex, Unidecode, awesome-slugify  Running setup.py develop for scraperwiki  Successfully installed PyExecJS-1.1.0 Unidecode-0.4.21 awesome-slugify-1.6.4 certifi-2020.6.20 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 idna-2.10 lxml-3.4.4 regex-2020.7.14 requests-2.24.0 scraperwiki urllib3-1.25.10 DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support    -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Traceback (most recent call last): File "scraper.py", line 18, in <module> alire = root.get_element_by_id('alire') File "/app/.heroku/python/lib/python2.7/site-packages/lxml/html/__init__.py", line 275, in get_element_by_id raise KeyError(id) KeyError: 'alire'

Data

Downloaded 100 times by everypolitician duncanparkes tmtmtmtm

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (33 KB) Use the API

rows 10 / 88

term_id image area name details_url party id email
2013
Jean-Charles ALLAVENA
HM Horizon Monaco
Jean-Charles-ALLAVENA
jc.allavena@conseil-national.mc
2013
Christian BARILARO
HM Horizon Monaco
Christian-BARILARO
c.barilaro@conseil-national.mc
2013
Claude BOISSON
HM Horizon Monaco
Claude-BOISSON
c.boisson@conseil-national.mc
2013
Marc BURINI
HM Horizon Monaco
Marc-BURINI
m.burini@conseil-national.mc
2013
Philippe CLERISSI
HM Horizon Monaco
Philippe-CLERISSI
p.clerissi@conseil-national.mc
2013
Thierry CROVETTO
HM Horizon Monaco
Thierry-CROVETTO
t.crovetto@conseil-national.mc
2013
Jean-Michel CUCCHI
HM Horizon Monaco
Jean-Michel-CUCCHI
jm.cucchi@conseil-national.mc
2013
Alain FICINI
HM Horizon Monaco
Alain-FICINI
a.ficini@conseil-national.mc
2013
Sophie LAVAGNA
HM Horizon Monaco
Sophie-LAVAGNA
s.lavagna@conseil-national.mc
2013
Laurent NOUVION
HM Horizon Monaco
Laurent-NOUVION
lnp@conseil-national.mc

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (33 KB) Use the API

rows 3 / 3

start_date name id end_date
2013-02-21
2013
2013
2018
2008
2008-2013
2008
2013
2003
2003-2008
2003
2008

Statistics

Average successful run time: 3 minutes

Total run time: about 1 month

Total cpu time used: about 1 hour

Total disk space used: 65.7 KB

History

  • Auto ran revision 915510bf and failed .
    nothing changed in the database
  • Auto ran revision 915510bf and failed .
    nothing changed in the database
  • Auto ran revision 915510bf and failed .
    nothing changed in the database
  • Auto ran revision 915510bf and failed .
    nothing changed in the database
  • Auto ran revision 915510bf and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

monaco / scraper.py