wfdd / colombia-senado-scraper

A scraper for the members of the Colombian Senate.

Scrapes www.secretariasenado.gov.co

La Secretaría General del Senado cumple con el deber constitucional y legal de garantizar el trámite legislativo y constitucional, ser garante en los debates de control político y cumplir a cabalidad con los deberes establecidos en la ley 5 de 1992 para la función administrativa, control público, elecciones de altos funcionarios, protocolario y funcion judicial.


A morph.io scraper for the members of the Colombian Senate.

Contributors wfdd

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... extract_emails Couldn't find email in http://www.secretariasenado.gov.co/?Itemid=109&id=192%3Aaguilar-hurtado-nerthink-mauricio&option=com_content&view=article extract_emails Couldn't find email in http://www.secretariasenado.gov.co/?Itemid=109&id=1177%3Auribe-velez-alvaro&option=com_content&view=article extract_photo Discarding http://www.secretariasenado.gov.co/images/banners/Manuel%2520Antonio%2520Virguez%2520Piraquive.jpg in http://www.secretariasenado.gov.co/?Itemid=109&id=190%3Avirgueez-piraquive-manuel-antonio&option=com_content&view=article. Received error code 404 extract_photo Discarding http://www.secretariasenado.gov.co/images/banners/Carlos%2520Alberto%2520Baena%2520Lopez.jpg in http://www.secretariasenado.gov.co/?Itemid=109&id=197%3Abaena-glopez-carlos-alberto&option=com_content&view=article. Received error code 404 extract_photo Discarding http://www.secretariasenado.gov.co/images/senadores-2014-18/Diaz%2520Ortiz%2520Stela%2520Diaz.png in http://www.secretariasenado.gov.co/?Itemid=109&id=1399%3Adiaz-ortiz-gloria-stella&option=com_content&view=article. Received error code 404 extract_emails Couldn't find email in http://www.secretariasenado.gov.co/?Itemid=109&id=1399%3Adiaz-ortiz-gloria-stella&option=com_content&view=article extract_emails Couldn't find email in http://www.secretariasenado.gov.co/?Itemid=109&id=1400%3Arodriguez-rengifo-roosvelt&option=com_content&view=article extract_photo Discarding http://www.secretariasenado.gov.co/images/banners/Lidio%2520Arturo%2520Garcia%2520Turbay.jpg in http://www.secretariasenado.gov.co/?Itemid=109&id=117%3Agarcia-turbay-lidio-arturo&option=com_content&view=article. Received error code 404 extract_photo Discarding http://www.secretariasenado.gov.co/images/banners/Luis%2520Emilio%2520Sierra%2520Grajales.jpg in http://www.secretariasenado.gov.co/?Itemid=109&id=176%3Asierra-grajales-luis-emilio&option=com_content&view=article. Received error code 404 extract_emails Couldn't find email in http://www.secretariasenado.gov.co/?Itemid=109&id=1143%3Acorrea-borrero-susana&option=com_content&view=article extract_photo Discarding http://www.secretariasenado.gov.co/images/banners/Jaime%2520Enrique%2520Duran%2520Barrera.jpg in http://www.secretariasenado.gov.co/?Itemid=109&id=107%3Aduran-barrera-jaime-enrique&option=com_content&view=article. Received error code 404 extract_emails Couldn't find email in http://www.secretariasenado.gov.co/?Itemid=109&id=1130%3Aprieto-riveros-jorge&option=com_content&view=article extract_website Email found in http://www.secretariasenado.gov.co/?Itemid=109&id=1144%3Acristo-bustos-andres&option=com_content&view=article; skipping extract_website Email found in http://www.secretariasenado.gov.co/?Itemid=109&id=1173%3Aramos-maya-alfredo&option=com_content&view=article; skipping extract_photo Discarding http://www.secretariasenado.gov.co/images/banners/Jose%2520David%2520Name%2520Cardozo.jpg in http://www.secretariasenado.gov.co/?Itemid=109&id=141%3Aname-cardozo-jose-david&option=com_content&view=article. Received error code 404 extract_photo Discarding http://www.secretariasenado.gov.co/images/banners/CARLOS%2520EDUARDO%2520ENRRIQUEZ%2520MAYA.jpg in http://www.secretariasenado.gov.co/?Itemid=109&id=109%3Aenriquez-maya-carlos-eduardo&option=com_content&view=article. Received error code 404 extract_photo Discarding http://www.secretariasenado.gov.co/images/banners/Juan%2520Carlos%2520Restepo%2520Escobar.jpg in http://www.secretariasenado.gov.co/?Itemid=109&id=80%3Arestrepo-escobar-juan-carlos&option=com_content&view=article. Received error code 404 extract_photo Discarding http://www.secretariasenado.gov.co/images/banners/Carlos%2520Ramiro%2520Chavarro%2520Cuellar.jpg in http://www.secretariasenado.gov.co/?Itemid=109&id=99%3Achavarro-cuellar-carlos-ramiro&option=com_content&view=article. Received error code 404

Data

Downloaded 207 times by everypolitician wfdd

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (64 KB) Use the API

rows 10 / 107

id name image group term email website phone facebook twitter place_of_birth source
201:besaile-fayad-musa-1
BESAILE FAYAD MUSA
PARTIDO DE LA U.
2014
musa.besayle.fayad@senado.gov.co
3823000 EXT 4123-4124
Sahagún - Córdoba
1148:duque-marquez-ivan-2
IVAN DUQUE MARQUEZ
2014
ivan.duque@senado.gov.co;ndeisyma@gmail.com
3823000 EXT.3272 - 3273
108:elias-vidal-bernardo-miguel
MIGUEL BERNARDO ELÍAS VIDAL
PARTIDO DE LA U.
2014
Bermiguel@hotmail.com
3823000 EXT 4092-4093-3772
BernardoEliasV
Sahagún - Córdoba
116:garcia-romero-teresita
TERESITA GARCÍA ROMERO
PARTIDO OPCIÓN CIUDADANA
2014
teresita.garcia.romero@senado.gov.co
3823000 EXT 3355-3356
teregarsenado
Ovejas - Sucre
1166:morales-hoyos-viviane-aleyda
VIVIANE ALEYDA MORALES HOYOS
PARTIDO LIBERAL
2014
senado@vivianemorales.com
3823000 EXT 3674-3673
manuelgmoraj
Bogota Cundinamarca
177:soto-jaramillo-carlos-enrique
CARLOS ENRIQUE SOTO JARAMILLO
PARTIDO DE LA U.
2014
carlos.soto.jaramillo@senado.gov.co
3823000 EXT 3170-3172-3744
senadorsoto
Marinilla - Antioquia
180:tamayo-tamayo-fernando-eustacio
FERNANDO EUSTACIO TAMAYO TAMAYO
PARTIDO CONSERVADOR
2014
fernando.tamayo.tamayo@senado.gov.co
3823000 EXT 3547-3210-3546
Palermo - Boyacá
1331:acuna-diaz-laureano-augusto
ACUÑA DIAZ LAUREANO AUGUSTO
PARTIDO CONSERVADOR
2014
utl.laureanoacuna@senado.gov.co
3823262 - 3823263
Barranquilla, Atlantico
192:aguilar-hurtado-nerthink-mauricio
NERTHINK MAURICIO AGUILAR HURTADO
PARTIDO DE INTEGRACIÓN NACIONAL
2014
3823000 EXT 3335-3334-4398
SenadorAguilar
Bucaramanga - Santander
1127:alvarez-montenegro-javier-tato
ÁLVAREZ MONTENEGRO JAVIER TATO
PARTIDO LIBERAL
2014
tomachch@yahoo.es
3823000 EXT 3531-3032
Pasto - Nariño

Statistics

Average successful run time: 3 minutes

Total run time: 1 day

Total cpu time used: 13 minutes

Total disk space used: 105 KB

History

  • Auto ran revision 665fde6b and completed successfully .
    100 records added, 100 records removed in the database
    201 pages scraped
  • Auto ran revision 665fde6b and completed successfully .
    100 records added, 100 records removed in the database
  • Auto ran revision 665fde6b and completed successfully .
    100 records added, 100 records removed in the database
  • Auto ran revision 665fde6b and failed .
    nothing changed in the database
  • Auto ran revision 665fde6b and completed successfully .
    100 records added, 100 records removed in the database
    201 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

colombia-senado-scraper / scraper.py