openaustralia / aus_mp_contact_details

Scrapes www.aph.gov.au

Home – Parliament of Australia


ausmpcontact_details

A Morph scraper that grabs MP's details from APH.gov.au.

Contributors henare archoo

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... Saving results from Representatives page Saving Hon Tony Abbott MP Saving Hon Anthony Albanese MP Saving Mr John Alexander OAM, MP Saving Dr Anne Aly MP Saving Hon Karen Andrews MP Saving Hon Kevin Andrews MP Saving Mr Adam Bandt MP Saving Ms Julia Banks MP Saving Hon Sharon Bird MP Saving Hon Julie Bishop MP Saving Hon Chris Bowen MP Saving Mr Andrew Broad MP /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:304:in `fetch': 404 => Net::HTTPNotFound for https://www.aph.gov.au/Help/404?item=%2fsenators_and_members%2fparliamentarian_search_results%2fsenators_and_members%2fparliamentarian_search_results&user=extranet%5cAnonymous&site=website -- unhandled response (Mechanize::ResponseCodeError) from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:949:in `response_redirect' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:299:in `fetch' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:949:in `response_redirect' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:299:in `fetch' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize.rb:407:in `get' from scraper.rb:56:in `<main>'

Data

Downloaded 2769 times by openaustralia everypolitician anupam82 ondenman davewhiteland tmtmtmtm jamezpolley chrismytton otherchirps alisonkeen henare archoo maxious cofiem paullenz dotnetnoobie

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (181 KB) Use the API

rows 10 / 313

house aph_id full_name electorate party profile_page contact_page photo_url email facebook twitter website
senate
2L6
Senator Mark Bishop
Western Australia
Australian Labor Party
senator.bishop@aph.gov.au
senate
YE4
Senator the Hon Ronald Boswell
Queensland
The Nationals
senator.boswell@aph.gov.au
senate
H6V
Senator Sue Boyce
Queensland
Liberal Party of Australia
senate
4L6
Senator Alan Eggleston
Western Australia
Liberal Party of Australia
senator.eggleston@aph.gov.au
senate
I0P
Senator Mark Furner
Queensland
Australian Labor Party
senate
7L6
Senator the Hon John Hogg
Queensland
Australian Labor Party
senator.hogg@aph.gov.au
senate
G1N
Senator Helen Kroger
Victoria
Liberal Party of Australia
senate
00AOS
Senator the Hon Ursula Stephens
New South Wales
Australian Labor Party
senator.stephens@aph.gov.au
senate
183342
Senator the Hon Lin Thorp
Tasmania
Australian Labor Party
senator.thorp@aph.gov.au
senate
249499
Senator Mehmet Tillem
Victoria
Australian Labor Party

Statistics

Average successful run time: 5 minutes

Total run time: 5 days

Total cpu time used: about 2 hours

Total disk space used: 204 KB

History

  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
    29 pages scraped
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
    29 pages scraped
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
    29 pages scraped
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
    29 pages scraped
  • Auto ran revision 38f22655 and failed .
    12 records added, 12 records removed in the database
    29 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

aus_mp_contact_details / scraper.rb