royopa / bcb_ifdata_scraper

Captura e faz o dowload de relatórios de IFs do BACEN - ifdata https://www3.bcb.gov.br/ifdata/index.html

Contributors royopa

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 3 is python-3.6.2 (you are using python-3.6.7, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-3.6.2).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-3.6.7 -----> Installing pip -----> Installing requirements with pip  Collecting SQLAlchemy==1.3.13  Downloading SQLAlchemy-1.3.13.tar.gz (6.0 MB)  Collecting pandas==0.25.3  Downloading pandas-0.25.3-cp36-cp36m-manylinux1_x86_64.whl (10.4 MB)  Collecting numpy==1.18.1  Downloading numpy-1.18.1-cp36-cp36m-manylinux1_x86_64.whl (20.1 MB)  Collecting selenium==3.141.0  Downloading selenium-3.141.0-py2.py3-none-any.whl (904 kB)  Collecting python-dotenv==0.12.0  Downloading python_dotenv-0.12.0-py2.py3-none-any.whl (17 kB)  Collecting python-dateutil>=2.6.1  Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)  Collecting pytz>=2017.2  Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB)  Collecting urllib3  Downloading urllib3-1.25.8-py2.py3-none-any.whl (125 kB)  Collecting six>=1.5  Downloading six-1.14.0-py2.py3-none-any.whl (10 kB)  Building wheels for collected packages: SQLAlchemy  Building wheel for SQLAlchemy (setup.py): started  Building wheel for SQLAlchemy (setup.py): finished with status 'done'  Created wheel for SQLAlchemy: filename=SQLAlchemy-1.3.13-cp36-cp36m-linux_x86_64.whl size=1203917 sha256=643cba9cdf5898106cb22893ac4ec1d162b6e21824a1a279f79f42be12ffa42a  Stored in directory: /tmp/pip-ephem-wheel-cache-7nshe_md/wheels/28/3e/f9/8eca04781258bb6956ffba37e4e6e6951e5b3a16d4494b91cb  Successfully built SQLAlchemy  Installing collected packages: SQLAlchemy, six, python-dateutil, numpy, pytz, pandas, urllib3, selenium, python-dotenv  Successfully installed SQLAlchemy-1.3.13 numpy-1.18.1 pandas-0.25.3 python-dateutil-2.8.1 python-dotenv-0.12.0 pytz-2019.3 selenium-3.141.0 six-1.14.0 urllib3-1.25.8   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ================================================================================ Consolidando arquivos - congl_financeiros_resumo.csv ================================================================================ /app/utils.py:135: FutureWarning: Sorting because non-concatenation axis is not aligned. A future version of pandas will change to not sort by default. To accept the future behavior, pass 'sort=False'. To retain the current behavior and silence the warning, pass 'sort=True'. df = pd.concat(dfs, axis=0, ignore_index=True) ================================================================================ Consolidando arquivos - congl_financeiros_ativo.csv ================================================================================ ================================================================================ Consolidando arquivos - congl_financeiros_passivo.csv ================================================================================ ================================================================================ Consolidando arquivos - congl_financeiros_demonstracao_resultado.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_resumo.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_segmentacao.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_ativo.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_passivo.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_informacoes_capital.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_demonstracao_resultado.csv ================================================================================ ================================================================================ Consolidando arquivos - inst_individuais_resumo.csv ================================================================================ ================================================================================ Consolidando arquivos - inst_individuais_ativo.csv ================================================================================ ================================================================================ Consolidando arquivos - inst_individuais_passivo.csv ================================================================================ ================================================================================ Consolidando arquivos - inst_individuais_demonstracao_resultado.csv ================================================================================ ================================================================================ Consolidando arquivos - inst_op_cambio_mov_trimestre.csv ================================================================================ Traceback (most recent call last): ================================================================================ Importando congl_financeiros_ativo para a base File "scraper.py", line 303, in <module> processa_import(nome_relatorio, a_excluir, a_renomear) ================================================================================ File "/app/utils.py", line 240, in processa_import engine = create_engine(os.environ.get('SQLALCHEMY_DATABASE_URI'), echo=False) File "/app/.heroku/python/lib/python3.6/site-packages/sqlalchemy/engine/__init__.py", line 479, in create_engine return strategy.create(*args, **kwargs) File "/app/.heroku/python/lib/python3.6/site-packages/sqlalchemy/engine/strategies.py", line 56, in create plugins = u._instantiate_plugins(kwargs) AttributeError: 'NoneType' object has no attribute '_instantiate_plugins'

Statistics

Total run time: 4 minutes

Total cpu time used: 1 minute

Total disk space used: 481 MB

History

  • Manually ran revision 6e7c9438 and failed .
  • Manually ran revision 14a4cbf9 and failed .
  • Manually ran revision 14a4cbf9 and failed .
  • Manually ran revision 05e2a6bc and failed .
  • Manually ran revision 05e2a6bc and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

bcb_ifdata_scraper