Contributors
Last run failed
with status code 1.
Console output of last run
Injecting configuration and compiling...
[1G [1G-----> Python app detected
[1G ! The latest version of Python 2 is python-2.7.14 (you are using python-2.7.9, which is unsupported).
[1G ! We recommend upgrading by specifying the latest version (python-2.7.14).
[1G Learn More: https://devcenter.heroku.com/articles/python-runtimes
[1G-----> Installing python-2.7.9
[1G-----> Installing pip
[1G-----> Installing requirements with pip
[1G Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r /tmp/build/requirements.txt (line 6))
[1G Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to /app/.heroku/src/scraperwiki
[1G Collecting lxml==3.4.4 (from -r /tmp/build/requirements.txt (line 7))
[1G Downloading lxml-3.4.4.tar.gz (3.5MB)
[1G Collecting cssselect==0.9.1 (from -r /tmp/build/requirements.txt (line 8))
[1G Downloading cssselect-0.9.1.tar.gz
[1G Collecting beautifulsoup4==4.6.0 (from -r /tmp/build/requirements.txt (line 9))
[1G Downloading beautifulsoup4-4.6.0-py2-none-any.whl (86kB)
[1G Collecting requests==2.18.4 (from -r /tmp/build/requirements.txt (line 10))
[1G Downloading requests-2.18.4-py2.py3-none-any.whl (88kB)
[1G Collecting pytz==2017.3 (from -r /tmp/build/requirements.txt (line 11))
[1G Downloading pytz-2017.3-py2.py3-none-any.whl (511kB)
[1G Collecting dumptruck>=0.1.2 (from scraperwiki->-r /tmp/build/requirements.txt (line 6))
[1G Downloading dumptruck-0.1.6.tar.gz
[1G Collecting idna<2.7,>=2.5 (from requests==2.18.4->-r /tmp/build/requirements.txt (line 10))
[1G Downloading idna-2.6-py2.py3-none-any.whl (56kB)
[1G Collecting urllib3<1.23,>=1.21.1 (from requests==2.18.4->-r /tmp/build/requirements.txt (line 10))
[1G Downloading urllib3-1.22-py2.py3-none-any.whl (132kB)
[1G Collecting certifi>=2017.4.17 (from requests==2.18.4->-r /tmp/build/requirements.txt (line 10))
[1G Downloading certifi-2018.1.18-py2.py3-none-any.whl (151kB)
[1G Collecting chardet<3.1.0,>=3.0.2 (from requests==2.18.4->-r /tmp/build/requirements.txt (line 10))
[1G Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB)
[1G Installing collected packages: dumptruck, idna, urllib3, certifi, chardet, requests, scraperwiki, lxml, cssselect, beautifulsoup4, pytz
[1G Running setup.py install for dumptruck: started
[1G Running setup.py install for dumptruck: finished with status 'done'
[1G Running setup.py develop for scraperwiki
[1G Running setup.py install for lxml: started
[1G Running setup.py install for lxml: still running...
[1G Running setup.py install for lxml: finished with status 'done'
[1G Running setup.py install for cssselect: started
[1G Running setup.py install for cssselect: finished with status 'done'
[1G Successfully installed beautifulsoup4-4.6.0 certifi-2018.1.18 chardet-3.0.4 cssselect-0.9.1 dumptruck-0.1.6 idna-2.6 lxml-3.4.4 pytz-2017.3 requests-2.18.4 scraperwiki urllib3-1.22
[1G
[1G [1G-----> Discovering process types
[1G Procfile declares types -> scraper
Injecting scraper and running...
{u'Gentiloni Silveri-I': {'url': '/loc/link.asp?tipodoc=compgov&leg=17&id=75&versione=3', 'legislatura': '17', 'data_fine': '', 'data_inizio': '2016-12-12'}}
ministri governo Gentiloni Silveri-I
FINE
Traceback (most recent call last):
File "scraper.py", line 245, in <module>
scraperwiki.sqlite.save(unique_keys=['id'], data=output)
File "/app/.heroku/src/scraperwiki/scraperwiki/sqlite.py", line 34, in save
return dt.upsert(data, table_name = table_name)
File "/app/.heroku/python/lib/python2.7/site-packages/dumptruck/dumptruck.py", line 301, in upsert
self.insert(upsert=True, *args, **kwargs)
File "/app/.heroku/python/lib/python2.7/site-packages/dumptruck/dumptruck.py", line 284, in insert
self.execute(sql, values, commit=False)
File "/app/.heroku/python/lib/python2.7/site-packages/dumptruck/dumptruck.py", line 138, in execute
raise self.sqlite3.InterfaceError(unicode(msg) + '\nTry converting types or pickling.')
sqlite3.InterfaceError: Error binding parameter 0 - probably unsupported type.
Try converting types or pickling.
{u'Gentiloni Silveri-I': {'start_date': '2016-12-12', '9': {'start_date': '2016-12-12', 'role': u'Giustizia', 'senato_identifier': '23029', 'birth_date': '1969-02-08', 'given_name': u'Andrea', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'La Spezia', 'family_name': u'ORLANDO', 'image': '', 'gender': 'M', 'profession': ''}, '2': {'start_date': '2016-12-12', 'role': u'Ministro senza portafoglio per i rapporti con il Parlamento', 'senato_identifier': '991', 'birth_date': '1955-03-31', 'given_name': u'Anna', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Modica (Ragusa)', 'family_name': u'FINOCCHIARO', 'image': 'http://www.senato.it/leg/17/Immagini/Senatori/00000991.jpg', 'gender': 'F', 'profession': u'Magistrato'}, '3': {'start_date': '2016-12-12', 'role': u'Ministro senza portafoglio per la semplificazione e la pubblica amministrazione', 'senato_identifier': '25472', 'birth_date': '1980-09-05', 'given_name': u'Maria Anna', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Roma', 'family_name': u'MADIA', 'image': '', 'gender': 'F', 'profession': ''}, '1': {'start_date': '2016-12-12', 'role': u'Presidente del Consiglio dei ministri', 'senato_identifier': '17988', 'birth_date': '1954-11-22', 'given_name': u'Paolo', 'end_date': '', 'death_date': '', 'label': 'Presidente del Consiglio dei ministri', 'birth_location': u'Roma', 'family_name': u'GENTILONI SILVERI', 'image': '', 'gender': 'M', 'profession': ''}, '6': {'start_date': '2016-12-12', 'role': u'Ministro senza portafoglio per lo sport', 'senato_identifier': '29461', 'birth_date': '1982-06-20', 'given_name': u'Luca', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'EMPOLI (Firenze)', 'family_name': u'LOTTI', 'image': '', 'gender': 'M', 'profession': ''}, '7': {'start_date': '2016-12-12', 'role': u'Affari esteri e coop. inter.le', 'senato_identifier': '17671', 'birth_date': '1970-10-31', 'given_name': u'Angelino', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Agrigento', 'family_name': u'ALFANO', 'image': '', 'gender': 'M', 'profession': ''}, '4': {'start_date': '2016-12-12', 'role': u'Ministro senza portafoglio per gli affari regionali', 'senato_identifier': '22911', 'birth_date': '1969-11-29', 'given_name': u'Enrico', 'end_date': '2017-07-20', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Cuneo', 'family_name': u'COSTA', 'image': '', 'gender': 'M', 'profession': ''}, '5': {'start_date': '2016-12-12', 'role': u'Ministro senza portafoglio per la coesione territoriale e il Mezzogiorno', 'senato_identifier': '28576', 'birth_date': '1948-10-28', 'given_name': u'Claudio', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': '', 'family_name': u'DE VINCENTI', 'image': '', 'gender': 'M', 'profession': ''}, '20': {'start_date': '2016-12-12', 'role': u'Salute', 'senato_identifier': '25474', 'birth_date': '1971-10-14', 'given_name': u'Beatrice', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Roma', 'family_name': u'LORENZIN', 'image': '', 'gender': 'F', 'profession': ''}, 'end_date': '', 'legislatura': '17', '18': {'start_date': '2016-12-12', 'role': u'Istruzione, universit\xe0 e ricerca', 'senato_identifier': '26041', 'birth_date': '1949-07-29', 'given_name': u'Valeria', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Treviglio (Bergamo)', 'family_name': u'FEDELI', 'image': 'http://www.senato.it/leg/17/Immagini/Senatori/00026041.jpg', 'gender': 'F', 'profession': u'Sindacalista'}, '19': {'start_date': '2016-12-12', 'role': u'Beni e attivit\xe0 culturali e turismo', 'senato_identifier': '5799', 'birth_date': '1958-10-19', 'given_name': u'Dario', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Ferrara', 'family_name': u'FRANCESCHINI', 'image': '', 'gender': 'M', 'profession': ''}, '12': {'start_date': '2016-12-12', 'role': u'Sviluppo economico', 'senato_identifier': '30110', 'birth_date': '', 'given_name': u'Carlo', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': '', 'family_name': u'CALENDA', 'image': '', 'gender': '', 'profession': ''}, '13': {'start_date': '2016-12-12', 'role': u'Infrastrutture e trasporti', 'senato_identifier': '28670', 'birth_date': '1960-04-27', 'given_name': u'Graziano', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u"Reggio nell'Emilia", 'family_name': u'DELRIO', 'image': '', 'gender': 'M', 'profession': ''}, '10': {'start_date': '2016-12-12', 'role': u'Difesa', 'senato_identifier': '17750', 'birth_date': '1961-05-20', 'given_name': u'Roberta', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Genova', 'family_name': u'PINOTTI', 'image': 'http://www.senato.it/leg/17/Immagini/Senatori/00017750.jpg', 'gender': 'F', 'profession': u'Insegnante'}, '11': {'start_date': '2016-12-12', 'role': u'Economia e finanze', 'senato_identifier': '30744', 'birth_date': '1950-01-19', 'given_name': u'Pietro Carlo', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': '', 'family_name': u'PADOAN', 'image': '', 'gender': 'M', 'profession': ''}, '16': {'start_date': '2016-12-12', 'role': u'Ambiente e tutela del territorio e del mare', 'senato_identifier': '22961', 'birth_date': '1961-07-15', 'given_name': u'Gian Luca', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Bologna', 'family_name': u'GALLETTI', 'image': '', 'gender': 'M', 'profession': ''}, '17': {'start_date': '2016-12-12', 'role': u'Lavoro e politiche sociali', 'senato_identifier': '30743', 'birth_date': '1951-11-19', 'given_name': u'Giuliano', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Imola (Bologna)', 'family_name': u'POLETTI', 'image': '', 'gender': 'M', 'profession': ''}, '14': {'start_date': '2018-03-14', 'role': u'Politiche agricole alimentari e forestali', 'senato_identifier': '17988', 'birth_date': '1954-11-22', 'given_name': u'Paolo', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Roma', 'family_name': u'GENTILONI SILVERI', 'image': '', 'gender': 'M', 'profession': ''}, '15': {'start_date': '2016-12-12', 'role': u'Politiche agricole alimentari e forestali', 'senato_identifier': '30112', 'birth_date': '1978-09-09', 'given_name': u'Maurizio', 'end_date': '2018-03-14', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Calcinate (Bergamo)', 'family_name': u'MARTINA', 'image': '', 'gender': 'M', 'profession': ''}, '8': {'start_date': '2016-12-12', 'role': u'Interno', 'senato_identifier': '12379', 'birth_date': '1956-06-06', 'given_name': u'Marco', 'end_date': '', 'death_date': '', 'label': 'Ministro', 'birth_location': u'Reggio Di Calabria', 'family_name': u'MINNITI', 'image': 'http://www.senato.it/leg/17/Immagini/Senatori/00012379.jpg', 'gender': 'M', 'profession': u'Funzionario di partito'}}, 'id': '20180408'}
Data
Downloaded 0 times
Statistics
Average successful run time: less than 5 seconds
Total run time: 34 minutes
Total cpu time used: half a minute
Total disk space used: 129 KB
History
-
Manually
ran
revision
3f433a85
and
failed
.
nothing changed in the database
-
Manually
ran
revision
57e80531
and
failed
.
nothing changed in the database64 pages scraped
-
Manually
ran
revision
28fc2a4a
and
failed
.
nothing changed in the database64 pages scraped
-
Manually
ran
revision
f7c3051e
and
completed successfully
.
1 record added in the database
-
Manually
ran
revision
f7c3051e
and
completed successfully
.
1 record added, 1 record removed in the database
- ...
- Created on morph.io