TMMV / Parquimetros

Scrapes www.cm-porto.pt

O sítio oficial da Câmara Municipal do Porto pretende ser um canal de comunicação com o cidadão em geral e com os munícipes portuenses em particular. Disponibiliza informações genéricas sobre a autarquia portuense,a história, os diversos equipamentos culturais e desportivos, o turismo e a actividade da cidade. Permite ainda, de forma interactiva, facilitar o contacto com os cidadãos que tenham que recorrer aos diversos serviços municipais


A scrapper running on morph.io saving the streets with parking meters in Porto. The idea is to have an idea of how they have spread across the city in a couple of months.

Contributors TMMV

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.10  $ pip install -r requirements.txt  Collecting beautifulsoup4==4.5.1 (from -r requirements.txt (line 1))  Downloading beautifulsoup4-4.5.1-py2-none-any.whl (83kB)  Collecting ftfy==4.2.0 (from -r requirements.txt (line 2))  Downloading ftfy-4.2.0.tar.gz  Collecting requests==2.11.1 (from -r requirements.txt (line 3))  Downloading requests-2.11.1-py2.py3-none-any.whl (514kB)  Collecting wheel==0.26. (from -r requirements.txt (line 4))  Downloading wheel-0.26.0-py2.py3-none-any.whl (63kB)  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 5))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 5))  Downloading dumptruck-0.1.6.tar.gz  Installing collected packages: beautifulsoup4, ftfy, requests, wheel, dumptruck, scraperwiki  Running setup.py install for ftfy: started  Running setup.py install for ftfy: finished with status 'done'  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Successfully installed beautifulsoup4-4.5.1 dumptruck-0.1.6 ftfy-4.2.0 requests-2.11.1 scraperwiki wheel-0.26.0   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 14 times by TMMV

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (624 KB) Use the API

rows 10 / 4664

longitude latitude street date
-8.600393
41.146406
Rua Visconde de Bóbeda
01-10-2016
-8.615738
41.152722
Rua dos Bragas
01-10-2016
-8.604749
41.153478
Rua Santa Catarina
01-10-2016
-8.638357
41.162341
Rua de João de Deus
01-10-2016
-8.604775
41.145956
Rua de Campinho
01-10-2016
-8.628688
41.153318
Rua do Bom Sucesso
01-10-2016
-8.613438
41.14144
Rua de São João
01-10-2016
-8.608222
41.153516
Rua Gonçalo Cristóvão
01-10-2016
-8.620291
41.146615
Rua Alberto Aires de Gouveia
01-10-2016
-8.614138
41.145971
Rua de S. Filipe de Nery
01-10-2016

Statistics

Average successful run time: less than a minute

Total run time: 42 minutes

Total cpu time used: less than a minute

Total disk space used: 679 KB

History

  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9bdba6c0 and completed successfully .
    nothing changed in the database
    29 pages scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added, 106 records removed in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    4 pages scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9bdba6c0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 9bdba6c0 and completed successfully .
    106 records added, 106 records removed in the database
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    236 pages scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added, 106 records removed in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    4 pages scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    44 pages scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    2 pages scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    nothing changed in the database
  • Auto ran revision 9bdba6c0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added, 106 records removed in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 9bdba6c0 and completed successfully .
    106 records added, 106 records removed in the database
    1 page scraped
  • Manually ran revision 9bdba6c0 and completed successfully .
    106 records added in the database
    1 page scraped
  • Auto ran revision 0d587751 and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 0d587751 and completed successfully .
    106 records added in the database
    2 pages scraped
  • Auto ran revision d6f7306d and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision d6f7306d and completed successfully .
    106 records added in the database
    1 page scraped
  • Manually ran revision f14bd90d and completed successfully .
    106 records added in the database
    1 page scraped
  • Manually ran revision f14bd90d and completed successfully .
    106 records added, 106 records updated in the database
    1 page scraped
  • Manually ran revision f0bdc63b and completed successfully .
    106 records added in the database
    1 page scraped
  • Manually ran revision c3cfc5aa and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Python

Parquimetros / scraper.py