royopa / bcb_ifdata_scraper

Captura e faz o dowload de relatórios de IFs do BACEN - ifdata https://www3.bcb.gov.br/ifdata/index.html

Contributors royopa

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Python app detected [1G ! The latest version of Python 3 is python-3.6.2 (you are using python-3.6.7, which is unsupported). [1G ! We recommend upgrading by specifying the latest version (python-3.6.2). [1G Learn More: https://devcenter.heroku.com/articles/python-runtimes [1G-----> Installing python-3.6.7 [1G-----> Installing pip [1G-----> Installing requirements with pip [1G Collecting SQLAlchemy==1.3.13 [1G Downloading SQLAlchemy-1.3.13.tar.gz (6.0 MB) [1G Collecting pandas==0.25.3 [1G Downloading pandas-0.25.3-cp36-cp36m-manylinux1_x86_64.whl (10.4 MB) [1G Collecting numpy==1.18.1 [1G Downloading numpy-1.18.1-cp36-cp36m-manylinux1_x86_64.whl (20.1 MB) [1G Collecting selenium==3.141.0 [1G Downloading selenium-3.141.0-py2.py3-none-any.whl (904 kB) [1G Collecting python-dotenv==0.12.0 [1G Downloading python_dotenv-0.12.0-py2.py3-none-any.whl (17 kB) [1G Collecting python-dateutil>=2.6.1 [1G Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB) [1G Collecting pytz>=2017.2 [1G Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB) [1G Collecting urllib3 [1G Downloading urllib3-1.25.8-py2.py3-none-any.whl (125 kB) [1G Collecting six>=1.5 [1G Downloading six-1.14.0-py2.py3-none-any.whl (10 kB) [1G Building wheels for collected packages: SQLAlchemy [1G Building wheel for SQLAlchemy (setup.py): started [1G Building wheel for SQLAlchemy (setup.py): finished with status 'done' [1G Created wheel for SQLAlchemy: filename=SQLAlchemy-1.3.13-cp36-cp36m-linux_x86_64.whl size=1203917 sha256=643cba9cdf5898106cb22893ac4ec1d162b6e21824a1a279f79f42be12ffa42a [1G Stored in directory: /tmp/pip-ephem-wheel-cache-7nshe_md/wheels/28/3e/f9/8eca04781258bb6956ffba37e4e6e6951e5b3a16d4494b91cb [1G Successfully built SQLAlchemy [1G Installing collected packages: SQLAlchemy, six, python-dateutil, numpy, pytz, pandas, urllib3, selenium, python-dotenv [1G Successfully installed SQLAlchemy-1.3.13 numpy-1.18.1 pandas-0.25.3 python-dateutil-2.8.1 python-dotenv-0.12.0 pytz-2019.3 selenium-3.141.0 six-1.14.0 urllib3-1.25.8 [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... ================================================================================ Consolidando arquivos - congl_financeiros_resumo.csv ================================================================================ /app/utils.py:135: FutureWarning: Sorting because non-concatenation axis is not aligned. A future version of pandas will change to not sort by default. To accept the future behavior, pass 'sort=False'. To retain the current behavior and silence the warning, pass 'sort=True'. df = pd.concat(dfs, axis=0, ignore_index=True) ================================================================================ Consolidando arquivos - congl_financeiros_ativo.csv ================================================================================ ================================================================================ Consolidando arquivos - congl_financeiros_passivo.csv ================================================================================ ================================================================================ Consolidando arquivos - congl_financeiros_demonstracao_resultado.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_resumo.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_segmentacao.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_ativo.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_passivo.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_informacoes_capital.csv ================================================================================ ================================================================================ Consolidando arquivos - prud_demonstracao_resultado.csv ================================================================================ ================================================================================ Consolidando arquivos - inst_individuais_resumo.csv ================================================================================ ================================================================================ Consolidando arquivos - inst_individuais_ativo.csv ================================================================================ ================================================================================ Consolidando arquivos - inst_individuais_passivo.csv ================================================================================ ================================================================================ Consolidando arquivos - inst_individuais_demonstracao_resultado.csv ================================================================================ ================================================================================ Consolidando arquivos - inst_op_cambio_mov_trimestre.csv ================================================================================ Traceback (most recent call last): ================================================================================ Importando congl_financeiros_ativo para a base File "scraper.py", line 303, in <module> processa_import(nome_relatorio, a_excluir, a_renomear) ================================================================================ File "/app/utils.py", line 240, in processa_import engine = create_engine(os.environ.get('SQLALCHEMY_DATABASE_URI'), echo=False) File "/app/.heroku/python/lib/python3.6/site-packages/sqlalchemy/engine/__init__.py", line 479, in create_engine return strategy.create(*args, **kwargs) File "/app/.heroku/python/lib/python3.6/site-packages/sqlalchemy/engine/strategies.py", line 56, in create plugins = u._instantiate_plugins(kwargs) AttributeError: 'NoneType' object has no attribute '_instantiate_plugins'

Statistics

Total run time: 4 minutes

Total cpu time used: 1 minute

Total disk space used: 481 MB

History

  • Manually ran revision 6e7c9438 and failed .
  • Manually ran revision 14a4cbf9 and failed .
  • Manually ran revision 14a4cbf9 and failed .
  • Manually ran revision 05e2a6bc and failed .
  • Manually ran revision 05e2a6bc and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

bcb_ifdata_scraper