Br3nda / aotearoa_parliament_members

README.md

aotearoaparliamentmembers

A morph.io scraper for NZ Members of Parliament data, fetched straight from data.govt.nz's official open-data catalogue - not from Hansard at all, a completely separate source from the aotearoa_hansard/ aotearoahansardtranscripts scrapers.

Data lives on morph.io, not in this repo: https://morph.io/Br3nda/aotearoa_parliament_members

That page has the scraper's run history and a data.sqlite you can query directly (via the page itself, or morph.io's API) - this repo is just the code that produces it.

Three raw tables, matching the three CSVs the dataset publishes:

  • member_list - everyone who's ever been an MP, one row per person
  • member_terms - one row per parliamentary term served (most members have several)
  • member_contact_details - current MPs only, no shared ID with the other two tables, just a name to match on

Downstream, hotair is what actually turns this data into linked Member/MemberTerm records - it already has a working import for these same three CSVs (Members::Fetcher/Members::Importer), just reading from a local file cache rather than morph.io. This scraper only stores raw content, it doesn't parse or normalise anything.

Contributors Br3nda

Last run failed with status code 255.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Ruby app detected [91m/tmp/buildpacks/01_buildpack-ruby/bin/compile: line 35: Failed to download a Ruby executable for bootstrapping! This is most likely a temporary internal error. If the problem persists, make sure that you are not running a custom or forked version of the Heroku Ruby buildpack which may need updating. url: https://heroku-buildpack-ruby.s3.us-east-1.amazonaws.com/heroku-24/amd64/ruby-3.1.6.tgz /tmp/tmp.LyFsFJfOFn/bin/ruby: File name too long [0m

Statistics

Total run time: half a minute

Total cpu time used: less than 5 seconds

Total disk space used: 33.5 KB

History

  • Manually ran revision 86f0698d and failed .
  • Manually ran revision 86f0698d and failed .
  • Created on morph.io