markbrough / exchangerates-scraper

Scraper to collect and provide API for historical exchangerates data on morph.io

README.md

Exchange rates scraper

Scraper to collect historical exchangerates data from OECD and U.S. Federal Reserve. This scraper runs nightly on Github Actions.

NOTE: this scraper is currently not being updated and is not currently maintained. Please see codeforiati/imf-exchangerates instead.

Data is stored in consolidated.csv file of the gh-pages branch.

You can also access the compiled dataset via:

https://codeforiati.org/exchangerates-scraper/consolidated.csv

This simple scraper uses the exchangerates pypi package to generate a rolling set of exchangerates data, sourced from FRED and the OECD. For more information, see the exchangerates repository.

Last run failed with status code 999.

Console output of last run

Please install the Morph Github App on markbrough so that Morph can access this repository on GitHub. Please go to https://github.com/apps/morph-io/installations/new/permissions?repository_ids%5B%5D=20888993&repository_ids%5B%5D=91818701&repository_ids%5B%5D=182771053&repository_ids%5B%5D=20227326&repository_ids%5B%5D=20227232&repository_ids%5B%5D=20227221&suggested_target_id=688113 Why? See https://morph.io/documentation/github_app

Data

Downloaded 8817 times by andylolz markbrough matmaxgeds siemvaessen xriss olivermcneil

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26 MB) Use the API

rows 10 / 881

started_at finished_at success
2019-04-24T00:24:50+00:00
false
2019-04-24T01:13:00+00:00
2019-04-24 01:35:48.378022
true
2019-04-25T12:23:10+00:00
2019-04-25 12:46:06.486504
true
2019-05-15T15:36:50+00:00
2019-05-15 15:59:41.450950
true
2019-07-12T18:20:44+00:00
2019-07-12 18:43:33.062638
true
2019-07-13T18:05:44+00:00
2019-07-13 18:28:39.063152
true
2019-07-14T03:44:05+00:00
2019-07-14 04:06:54.002352
true
2019-07-15T11:25:25+00:00
2019-07-15 11:48:05.282473
true
2019-07-16T13:55:44+00:00
2019-07-16 14:18:32.582658
true
2019-07-17T20:03:04+00:00
2019-07-17 20:25:44.737203
true

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26 MB) Use the API

rows 10 / 269714

Date Rate Currency Frequency Source RateFirstSeen
1995-01-02
0.8440
BRL
D
FRED
2019-04-24T00:25:04+00:00
1995-01-03
0.8450
BRL
D
FRED
2019-04-24T00:25:04+00:00
1995-01-04
0.8450
BRL
D
FRED
2019-04-24T00:25:04+00:00
1995-01-05
0.8430
BRL
D
FRED
2019-04-24T00:25:04+00:00
1995-01-06
0.8400
BRL
D
FRED
2019-04-24T00:25:04+00:00
1995-01-09
0.8440
BRL
D
FRED
2019-04-24T00:25:04+00:00
1995-01-10
0.8470
BRL
D
FRED
2019-04-24T00:25:04+00:00
1995-01-11
0.8510
BRL
D
FRED
2019-04-24T00:25:04+00:00
1995-01-12
0.8450
BRL
D
FRED
2019-04-24T00:25:04+00:00
1995-01-13
0.8470
BRL
D
FRED
2019-04-24T00:25:04+00:00

Statistics

Average successful run time: 35 minutes

Total run time: 19 days

Total cpu time used: 14 days

Total disk space used: 27.6 MB

History

  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • Auto ran and failed .
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

exchangerates-scraper / scraper.py