ausmpcontact_details

A Morph scraper that grabs MP's details from APH.gov.au.

Contributors henare archoo

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Saving results from Representatives page Saving Hon Anthony Albanese MP Saving Mr John Alexander OAM, MP Saving Dr Katie Allen MP Saving Dr Anne Aly MP Saving Hon Karen Andrews MP Saving Hon Kevin Andrews MP Saving Mrs Bridget Archer MP Saving Mr Adam Bandt MP Saving Ms Angie Bell MP Saving Hon Sharon Bird MP Saving Hon Chris Bowen MP Saving Mr Russell Broadbent MP /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:304:in `fetch': 404 => Net::HTTPNotFound for https://www.aph.gov.au/Help/404?item=%2fsenators_and_members%2fparliamentarian_search_results%2fsenators_and_members%2fparliamentarian_search_results&user=extranet%5cAnonymous&site=website -- unhandled response (Mechanize::ResponseCodeError) from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:949:in `response_redirect' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:299:in `fetch' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:949:in `response_redirect' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:299:in `fetch' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize.rb:407:in `get' from scraper.rb:56:in `<main>'

Data

Downloaded 3987 times by openaustralia everypolitician anupam82 tmtmtmtm ondenman davewhiteland jamezpolley chrismytton otherchirps alisonkeen henare archoo m-mac dotnetnoobie maxious cofiem tp12121212 paullenz

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (181 KB) Use the API

rows 10 / 316

house aph_id full_name electorate party profile_page contact_page photo_url email facebook twitter website
senate
2L6
Senator Mark Bishop
Western Australia
Australian Labor Party
senator.bishop@aph.gov.au
senate
YE4
Senator the Hon Ronald Boswell
Queensland
The Nationals
senator.boswell@aph.gov.au
senate
H6V
Senator Sue Boyce
Queensland
Liberal Party of Australia
senate
4L6
Senator Alan Eggleston
Western Australia
Liberal Party of Australia
senator.eggleston@aph.gov.au
senate
I0P
Senator Mark Furner
Queensland
Australian Labor Party
senate
7L6
Senator the Hon John Hogg
Queensland
Australian Labor Party
senator.hogg@aph.gov.au
senate
G1N
Senator Helen Kroger
Victoria
Liberal Party of Australia
senate
00AOS
Senator the Hon Ursula Stephens
New South Wales
Australian Labor Party
senator.stephens@aph.gov.au
senate
183342
Senator the Hon Lin Thorp
Tasmania
Australian Labor Party
senator.thorp@aph.gov.au
senate
249499
Senator Mehmet Tillem
Victoria
Australian Labor Party

Statistics

Average successful run time: 5 minutes

Total run time: 5 days

Total cpu time used: about 3 hours

Total disk space used: 204 KB

History

  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

aus_mp_contact_details / scraper.rb