archoo / aph_members

Contact details of Members and Senators from the APH website

Scrapes www.aph.gov.au

Home – Parliament of Australia


This is a scraper that runs on Morph.

It scrapes contact details for all Members in both Senate and Reps from the updated APH website.

Contributors archoo

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-2.7.9  $ pip install -r requirements.txt  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Collecting cssselect==0.9.1 (from -r requirements.txt (line 9))  Downloading cssselect-0.9.1.tar.gz  Collecting beautifulsoup4==4.5.1 (from -r requirements.txt (line 10))  Downloading beautifulsoup4-4.5.1-py2-none-any.whl (83kB)  Collecting requests==2.9.1 (from -r requirements.txt (line 11))  Downloading requests-2.9.1-py2.py3-none-any.whl (501kB)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Installing collected packages: dumptruck, requests, scraperwiki, lxml, cssselect, beautifulsoup4  Running setup.py install for dumptruck: started  Running setup.py install for dumptruck: finished with status 'done'  Running setup.py develop for scraperwiki  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for cssselect: started  Running setup.py install for cssselect: finished with status 'done'  Successfully installed beautifulsoup4-4.5.1 cssselect-0.9.1 dumptruck-0.1.6 lxml-3.4.4 requests-2.9.1 scraperwiki   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... parsing members page 1 Hon Tony Abbott MP Hon Anthony Albanese MP Mr John Alexander OAM, MP Dr Anne Aly MP Hon Karen Andrews MP Hon Kevin Andrews MP Mr Adam Bandt MP Ms Julia Banks MP Hon Sharon Bird MP Hon Julie Bishop MP Hon Chris Bowen MP Mr Andrew Broad MP parsing members page 2 Mr Russell Broadbent MP Ms Gai Brodtmann MP Mr Scott Buchholz MP Hon Tony Burke MP Hon Linda Burney MP Hon Mark Butler MP Ms Terri Butler MP Hon Anthony Byrne MP Dr Jim Chalmers MP Mr Nick Champion MP Hon Darren Chester MP Ms Lisa Chesters MP parsing members page 3 Mr George Christensen MP Hon Steven Ciobo MP Hon Jason Clare MP Ms Sharon Claydon MP Mr David Coleman MP Hon Julie Collins MP Mr Pat Conroy MP Mr Mark Coulton MP Mr Chris Crewther MP Hon Michael Danby MP Mr Milton Dick MP Hon Mark Dreyfus QC, MP parsing members page 4 Mr Damian Drum MP Hon Peter Dutton MP Hon Justine Elliot MP Hon Kate Ellis MP Hon Warren Entsch MP Mr Trevor Evans MP Mr Jason Falinski MP Hon David Feeney MP Hon Joel Fitzgibbon MP Hon Paul Fletcher MP Ms Nicolle Flint MP Dr Mike Freelander MP parsing members page 5 Hon Josh Frydenberg MP Mr Andrew Gee MP Mr Steve Georganas MP Mr Andrew Giles MP Hon Dr David Gillespie MP Mr Ian Goodenough MP Mr Luke Gosling MP Mr Tim Hammond MP Mr Ross Hart MP Hon Luke Hartsuyker MP Mr Andrew Hastie MP Hon Alex Hawke MP parsing members page 6 Mr Chris Hayes MP Ms Sarah Henderson MP Mr Julian Hill MP Mr Kevin Hogan MP Mr Luke Howarth MP Hon Greg Hunt MP Ms Emma Husar MP Hon Ed Husic MP Mr Steve Irons MP Mr Stephen Jones MP Hon Barnaby Joyce MP Hon Bob Katter MP parsing members page 7 Ms Justine Keay MP Hon Michael Keenan MP Mr Craig Kelly MP Hon Dr Mike Kelly AM, MP Mr Matt Keogh MP Mr Peter Khalil MP Hon Catherine King MP Ms Madeleine King MP Ms Susan Lamb MP Mr Andrew Laming MP Ms Michelle Landry MP Hon Craig Laundy MP parsing members page 8 Mr Julian Leeser MP Hon Dr Andrew Leigh MP Hon Sussan Ley MP Mr David Littleproud MP Hon Jenny Macklin MP Ms Nola Marino MP Hon Richard Marles MP Ms Emma McBride MP Hon Michael McCormack MP Ms Cathy McGowan AO, MP Hon Dr John McVeigh MP Mr Brian Mitchell MP parsing members page 9 Mr Rob Mitchell MP Hon Scott Morrison MP Mr Ben Morton MP Hon Shayne Neumann MP Mr Llew O'Brien MP Mr Ted O'Brien MP Hon Brendan O'Connor MP Mr Ken O'Dowd MP Hon Kelly O'Dwyer MP Ms Clare O'Neil MP Ms Cathy O'Toole MP Ms Julie Owens MP parsing members page 10 Mr Tony Pasin MP Mr Graham Perrett MP Hon Keith Pitt MP Hon Tanya Plibersek MP Hon Christian Porter MP Hon Jane Prentice MP Ms Melissa Price MP Hon Christopher Pyne MP Mr Rowan Ramsey MP Hon Amanda Rishworth MP Hon Stuart Robert MP Ms Michelle Rowland MP parsing members page 11 Ms Joanne Ryan MP Ms Rebekha Sharkie MP Hon Bill Shorten MP Hon Tony Smith MP Hon Warren Snowdon MP Ms Anne Stanley MP Mrs Ann Sudmalis MP Mr Michael Sukkar MP Hon Wayne Swan MP Ms Meryl Swanson MP Hon Angus Taylor MP Hon Dan Tehan MP parsing members page 12 Ms Susan Templeman MP Hon Matt Thistlethwaite MP Hon Alan Tudge MP Hon Malcolm Turnbull MP Ms Maria Vamvakinou MP Mr Bert van Manen MP Mr Ross Vasta MP Mr Andrew Wallace MP Mr Tim Watts MP Mrs Lucy Wicks MP Mr Andrew Wilkie MP Mr Josh Wilson MP parsing members page 13 Mr Rick Wilson MP Mr Tim Wilson MP Mr Jason Wood MP Hon Ken Wyatt AM, MP Mr Tony Zappia MP Mr Trent Zimmerman MP parsing senators page 1 Senator the Hon Eric Abetz Senator Chris Back Senator Cory Bernardi Senator Catryna Bilyk Senator the Hon Simon Birmingham Senator the Hon George Brandis QC Senator Carol Brown Senator Brian Burston Senator David Bushby Senator the Hon Doug Cameron Senator the Hon Matthew Canavan Senator the Hon Kim Carr parsing senators page 2 Senator the Hon Michaelia Cash Senator Anthony Chisholm Senator the Hon Jacinta Collins Senator the Hon Stephen Conroy Senator the Hon Mathias Cormann Senator Rod Culleton Senator Sam Dastyari Senator Bob Day AO Senator Richard Di Natale Senator Patrick Dodson Senator Jonathon Duniam Senator the Hon Don Farrell parsing senators page 3 Senator David Fawcett Senator the Hon Concetta Fierravanti-Wells Senator the Hon Mitch Fifield Senator Alex Gallacher Senator Katy Gallagher Senator Stirling Griff Senator Pauline Hanson Senator Sarah Hanson-Young Senator Derryn Hinch Senator Jane Hume Senator Skye Kakoschke-Moore Senator Chris Ketter parsing senators page 4 Senator Jacqui Lambie Senator David Leyonhjelm Senator Sue Lines Senator Scott Ludlam Senator the Hon Ian Macdonald Senator Gavin Marshall Senator Jenny McAllister Senator Malarndirri McCarthy Senator the Hon James McGrath Senator Bridget McKenzie Senator Nick McKim Senator Claire Moore parsing senators page 5 Senator the Hon Fiona Nash Senator Deborah O'Neill Senator Barry O'Sullivan Senator the Hon Stephen Parry Senator James Paterson Senator the Hon Marise Payne Senator Helen Polley Senator Louise Pratt Senator Linda Reynolds CSC Senator Lee Rhiannon Senator Janet Rice Senator Malcolm Roberts parsing senators page 6 Senator the Hon Anne Ruston Senator the Hon Scott Ryan Senator the Hon Nigel Scullion Senator Zed Seselja Senator Rachel Siewert Senator the Hon Lisa Singh Senator the Hon Arthur Sinodinos AO Senator Dean Smith Senator Glenn Sterle Senator Anne Urquhart Senator Larissa Waters Senator Murray Watt parsing senators page 7 Senator Peter Whish-Wilson Senator John Williams Senator the Hon Penny Wong Senator Nick Xenophon

Statistics

Average successful run time: 10 minutes

Total run time: 10 minutes

Total cpu time used: less than 5 seconds

Total disk space used: 24.1 KB

History

  • Manually ran revision ce11bfa0 and completed successfully .
    nothing changed in the database
    246 pages scraped
  • Created on morph.io

Scraper code

Python

aph_members / scraper.py