This is a scraper that runs on Morph. To get started see the documentation

Contributors duncanparkes

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.9, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-2.7.14).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-2.7.9 -----> Installing pip -----> Installing requirements with pip  DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to revision morph_defaults) to /app/.heroku/src/scraperwiki  Running command git clone -q http://github.com/openaustralia/scraperwiki-python.git /app/.heroku/src/scraperwiki  Running command git checkout -b morph_defaults --track origin/morph_defaults  Switched to a new branch 'morph_defaults'  Branch morph_defaults set up to track remote branch morph_defaults from origin.  Collecting lxml==3.4.4  Downloading lxml-3.4.4.tar.gz (3.5 MB)  Collecting cssselect==0.9.1  Downloading cssselect-0.9.1.tar.gz (32 kB)  Collecting PyExecJS==1.1.0  Downloading PyExecJS-1.1.0.tar.gz (11 kB)  Collecting awesome-slugify==1.6.4  Downloading awesome-slugify-1.6.4.tar.gz (8.4 kB)  Collecting dumptruck>=0.1.2  Downloading dumptruck-0.1.6.tar.gz (15 kB)  Collecting requests  Downloading requests-2.22.0-py2.py3-none-any.whl (57 kB)  Collecting regex  Downloading regex-2020.1.8.tar.gz (681 kB)  Collecting Unidecode<0.05,>=0.04.14  Downloading Unidecode-0.04.21-py2.py3-none-any.whl (228 kB)  Collecting certifi>=2017.4.17  Downloading certifi-2019.11.28-py2.py3-none-any.whl (156 kB)  Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1  Downloading urllib3-1.25.8-py2.py3-none-any.whl (125 kB)  Collecting chardet<3.1.0,>=3.0.2  Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB)  Collecting idna<2.9,>=2.5  Downloading idna-2.8-py2.py3-none-any.whl (58 kB)  Building wheels for collected packages: lxml, cssselect, PyExecJS, awesome-slugify, dumptruck, regex  Building wheel for lxml (setup.py): started  Building wheel for lxml (setup.py): still running...  Building wheel for lxml (setup.py): finished with status 'done'  Created wheel for lxml: filename=lxml-3.4.4-cp27-cp27m-linux_x86_64.whl size=2989863 sha256=b4d59db23b1cfe9ea72cb5885a04fd45d2017f9bfd9075a3867ae65435a4b48e  Stored in directory: /tmp/pip-ephem-wheel-cache-CvSEwe/wheels/d6/de/81/11ae6edd05c75aac677e67dd154c85da758ba6f3e8e80e962e  Building wheel for cssselect (setup.py): started  Building wheel for cssselect (setup.py): finished with status 'done'  Created wheel for cssselect: filename=cssselect-0.9.1-py2-none-any.whl size=26992 sha256=8d7f689826674991c9f0135047069f5ffdc899c226b766427d0d255941906bb4  Stored in directory: /tmp/pip-ephem-wheel-cache-CvSEwe/wheels/85/fe/00/b94036d8583cec9791d8cda24c184f2d2ac1397822f7f0e8d4  Building wheel for PyExecJS (setup.py): started  Building wheel for PyExecJS (setup.py): finished with status 'done'  Created wheel for PyExecJS: filename=PyExecJS-1.1.0-py2-none-any.whl size=9430 sha256=fbe37b8b9d382a05603e351100ac573b5af9cff54a267707525bbba76424fbc9  Stored in directory: /tmp/pip-ephem-wheel-cache-CvSEwe/wheels/d3/5d/f1/9b4c3099891293ad4da409d1a49f60a89fce12605c54a8019a  Building wheel for awesome-slugify (setup.py): started  Building wheel for awesome-slugify (setup.py): finished with status 'done'  Created wheel for awesome-slugify: filename=awesome_slugify-1.6.4-py2-none-any.whl size=8332 sha256=a6a60fa85b75d36f1ca3bf63bcda44396fffbac2e38db53c35bdbcd88fc8ffe7  Stored in directory: /tmp/pip-ephem-wheel-cache-CvSEwe/wheels/cd/07/d3/77bf73ea75d022f81c5322df341df4cba0d92a09e268353254  Building wheel for dumptruck (setup.py): started  Building wheel for dumptruck (setup.py): finished with status 'done'  Created wheel for dumptruck: filename=dumptruck-0.1.6-py2-none-any.whl size=11844 sha256=8f6d25e52958829e71aa8ae34378e83314fe31b3f240e80435bc2ab1bf60084a  Stored in directory: /tmp/pip-ephem-wheel-cache-CvSEwe/wheels/dc/75/e9/1e61c4080c73e7bda99614549591f83b53bcc2d682f26fce62  Building wheel for regex (setup.py): started  Building wheel for regex (setup.py): finished with status 'done'  Created wheel for regex: filename=regex-2020.1.8-cp27-cp27m-linux_x86_64.whl size=627658 sha256=f31ec6078772cc2a450ea52e836b153bc76c70e066883ca3c06871b00ca7492a  Stored in directory: /tmp/pip-ephem-wheel-cache-CvSEwe/wheels/70/3f/c6/b4ee9f661fc9d09ac578b6f6c4e02341c3a4bd4347d0e53afe  Successfully built lxml cssselect PyExecJS awesome-slugify dumptruck regex  Installing collected packages: dumptruck, certifi, urllib3, chardet, idna, requests, scraperwiki, lxml, cssselect, PyExecJS, regex, Unidecode, awesome-slugify  Running setup.py develop for scraperwiki  Successfully installed PyExecJS-1.1.0 Unidecode-0.4.21 awesome-slugify-1.6.4 certifi-2019.11.28 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 idna-2.8 lxml-3.4.4 regex-2020.1.8 requests-2.22.0 scraperwiki urllib3-1.25.8 DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support    -----> Discovering process types  Procfile declares types -> scraper

Data

Downloaded 100 times by everypolitician duncanparkes tmtmtmtm

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (33 KB) Use the API

rows 10 / 88

term_id image area name details_url party id email
2013
Jean-Charles ALLAVENA
HM Horizon Monaco
Jean-Charles-ALLAVENA
jc.allavena@conseil-national.mc
2013
Christian BARILARO
HM Horizon Monaco
Christian-BARILARO
c.barilaro@conseil-national.mc
2013
Claude BOISSON
HM Horizon Monaco
Claude-BOISSON
c.boisson@conseil-national.mc
2013
Marc BURINI
HM Horizon Monaco
Marc-BURINI
m.burini@conseil-national.mc
2013
Philippe CLERISSI
HM Horizon Monaco
Philippe-CLERISSI
p.clerissi@conseil-national.mc
2013
Thierry CROVETTO
HM Horizon Monaco
Thierry-CROVETTO
t.crovetto@conseil-national.mc
2013
Jean-Michel CUCCHI
HM Horizon Monaco
Jean-Michel-CUCCHI
jm.cucchi@conseil-national.mc
2013
Alain FICINI
HM Horizon Monaco
Alain-FICINI
a.ficini@conseil-national.mc
2013
Sophie LAVAGNA
HM Horizon Monaco
Sophie-LAVAGNA
s.lavagna@conseil-national.mc
2013
Laurent NOUVION
HM Horizon Monaco
Laurent-NOUVION
lnp@conseil-national.mc

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (33 KB) Use the API

rows 3 / 3

start_date name id end_date
2013-02-21
2013
2013
2018
2008
2008-2013
2008
2013
2003
2003-2008
2003
2008

Statistics

Average successful run time: 3 minutes

Total run time: about 1 month

Total cpu time used: about 1 hour

Total disk space used: 65.7 KB

History

  • Auto ran revision 915510bf and failed .
    nothing changed in the database
  • Auto ran revision 915510bf and failed .
    nothing changed in the database
  • Auto ran revision 915510bf and failed .
    nothing changed in the database
  • Auto ran revision 915510bf and failed .
    nothing changed in the database
  • Auto ran revision 915510bf and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

monaco / scraper.py