cofiem / australia_parliament_attendance

The attendance record of senators and members for each sitting day.

README.md

Australian Parliament Attendance for Senators and Members

The attendance record of senators and members for each sitting day.

This is a scraper that runs on Morph. To get started see the documentation.

Contributors cofiem

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.6.2 -----> Installing pip -----> Installing requirements with pip  Collecting certifi==2021.10.8  Downloading certifi-2021.10.8-py2.py3-none-any.whl (149 kB)  Collecting charset-normalizer==2.0.11  Downloading charset_normalizer-2.0.11-py3-none-any.whl (39 kB)  Collecting cssselect==1.1.0  Downloading cssselect-1.1.0-py2.py3-none-any.whl (16 kB)  Collecting dataclasses==0.8  Downloading dataclasses-0.8-py3-none-any.whl (19 kB)  Collecting idna==3.3  Downloading idna-3.3-py3-none-any.whl (61 kB)  Collecting lxml==4.7.1  Downloading lxml-4.7.1-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (6.4 MB)  Collecting requests==2.27.1  Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB)  Collecting urllib3==1.26.8  Downloading urllib3-1.26.8-py2.py3-none-any.whl (138 kB)  Installing collected packages: urllib3, idna, charset-normalizer, certifi, requests, lxml, dataclasses, cssselect  Successfully installed certifi-2021.10.8 charset-normalizer-2.0.11 cssselect-1.1.0 dataclasses-0.8 idna-3.3 lxml-4.7.1 requests-2.27.1 urllib3-1.26.8   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Processing page 0. Building attendance url for 2022-06-22 00:41:52.981111 to 2022-06-29 00:41:52.981123 page 0 count 10. No content for url, stopping. Finished gathering attendance.

Data

Downloaded 2 times by cofiem

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (862 KB) Use the API

rows 10 / 2797

id url assembly sitting_date person_name is_leave retrieved_date
1
https://parlinfo.aph.gov.au:443/parlInfo/search/display/display.w3p;query=Id%3A%22chamber%2Fvotes%2F6b7c477a-df85-4ffa-a08a-116df8dbf17a%2F0032%22
House of Representatives
2021-05-13
Ms L. M. Chesters
1
2021-05-16 03:45:43
2
https://parlinfo.aph.gov.au:443/parlInfo/search/display/display.w3p;query=Id%3A%22chamber%2Fvotes%2F6b7c477a-df85-4ffa-a08a-116df8dbf17a%2F0032%22
House of Representatives
2021-05-13
Mr Ted O'Brien
0
2021-05-16 03:45:43
3
https://parlinfo.aph.gov.au:443/parlInfo/search/display/display.w3p;query=Id%3A%22chamber%2Fjournals%2F611ecda1-470b-4dd8-86d3-bfe03adef47b%2F0048%22
Senate
2021-05-13
Bilyk
1
2021-05-16 03:45:47
4
https://parlinfo.aph.gov.au:443/parlInfo/search/display/display.w3p;query=Id%3A%22chamber%2Fjournals%2F611ecda1-470b-4dd8-86d3-bfe03adef47b%2F0048%22
Senate
2021-05-13
Gallacher
1
2021-05-16 03:45:47
5
https://parlinfo.aph.gov.au:443/parlInfo/search/display/display.w3p;query=Id%3A%22chamber%2Fjournals%2F611ecda1-470b-4dd8-86d3-bfe03adef47b%2F0048%22
Senate
2021-05-13
Green
1
2021-05-16 03:45:47
6
https://parlinfo.aph.gov.au:443/parlInfo/search/display/display.w3p;query=Id%3A%22chamber%2Fjournals%2F611ecda1-470b-4dd8-86d3-bfe03adef47b%2F0048%22
Senate
2021-05-13
Griff
1
2021-05-16 03:45:47
7
https://parlinfo.aph.gov.au:443/parlInfo/search/display/display.w3p;query=Id%3A%22chamber%2Fjournals%2F611ecda1-470b-4dd8-86d3-bfe03adef47b%2F0048%22
Senate
2021-05-13
Molan
1
2021-05-16 03:45:47
8
https://parlinfo.aph.gov.au:443/parlInfo/search/display/display.w3p;query=Id%3A%22chamber%2Fjournals%2F611ecda1-470b-4dd8-86d3-bfe03adef47b%2F0048%22
Senate
2021-05-13
O'Neill
1
2021-05-16 03:45:47
9
https://parlinfo.aph.gov.au:443/parlInfo/search/display/display.w3p;query=Id%3A%22chamber%2Fjournals%2F611ecda1-470b-4dd8-86d3-bfe03adef47b%2F0048%22
Senate
2021-05-13
Payne
1
2021-05-16 03:45:47
10
https://parlinfo.aph.gov.au:443/parlInfo/search/display/display.w3p;query=Id%3A%22chamber%2Fjournals%2F611ecda1-470b-4dd8-86d3-bfe03adef47b%2F0048%22
Senate
2021-05-13
Scarr
1
2021-05-16 03:45:47

Statistics

Average successful run time: less than a minute

Total run time: about 6 hours

Total cpu time used: 4 minutes

Total disk space used: 8.99 MB

History

  • Auto ran revision 3a50b778 and completed successfully .
    nothing changed in the database
  • Auto ran revision 3a50b778 and completed successfully .
    nothing changed in the database
  • Auto ran revision 3a50b778 and completed successfully .
    nothing changed in the database
  • Auto ran revision 3a50b778 and completed successfully .
    nothing changed in the database
  • Auto ran revision 3a50b778 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history