kennib / australian_electoral_commission_federal_election_data

Various data from the Australian Federal Elections


This is a scraper that runs on Morph. To get started see the documentation

Contributors kennib

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... -----> Python app detected -----> Stack changed, re-installing runtime -----> Installing runtime (python-2.7.11) -----> Installing dependencies with pip  Obtaining scraperwiki from git+http://github.com/openaustralia/scraperwiki-python.git@morph_defaults#egg=scraperwiki (from -r requirements.txt (line 6))  Cloning http://github.com/openaustralia/scraperwiki-python.git (to morph_defaults) to ./.heroku/src/scraperwiki  Collecting lxml==3.4.4 (from -r requirements.txt (line 8))  Downloading lxml-3.4.4.tar.gz (3.5MB)  Building lxml version 3.4.4.  Building without Cython.  Using build configuration of libxslt 1.1.28  /app/.heroku/python/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url'  warnings.warn(msg)  Collecting dumptruck>=0.1.2 (from scraperwiki->-r requirements.txt (line 6))  Downloading dumptruck-0.1.6.tar.gz  Collecting requests (from scraperwiki->-r requirements.txt (line 6))  Downloading requests-2.10.0-py2.py3-none-any.whl (506kB)  Installing collected packages: requests, dumptruck, lxml, scraperwiki   Running setup.py install for dumptruck  Running setup.py install for lxml  Building lxml version 3.4.4.  Building without Cython.  Using build configuration of libxslt 1.1.28  /app/.heroku/python/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url'  warnings.warn(msg)  building 'lxml.etree' extension  gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -I/tmp/pip-build-ehmfBx/lxml/src/lxml/includes -I/app/.heroku/python/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -w  gcc -pthread -shared build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o -lxslt -lexslt -lxml2 -lz -lm -o build/lib.linux-x86_64-2.7/lxml/etree.so  building 'lxml.objectify' extension  gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -I/tmp/pip-build-ehmfBx/lxml/src/lxml/includes -I/app/.heroku/python/include/python2.7 -c src/lxml/lxml.objectify.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.objectify.o -w  gcc -pthread -shared build/temp.linux-x86_64-2.7/src/lxml/lxml.objectify.o -lxslt -lexslt -lxml2 -lz -lm -o build/lib.linux-x86_64-2.7/lxml/objectify.so  Running setup.py develop for scraperwiki  Creating /app/.heroku/python/lib/python2.7/site-packages/scraperwiki.egg-link (link to .)  Adding scraperwiki 0.3.7 to easy-install.pth file  Installed /app/.heroku/src/scraperwiki  Successfully installed dumptruck-0.1.6 lxml-3.4.4 requests-2.10.0 scraperwiki  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 203 times by auspol kennib MikeRalphson ldw77

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.19 MB) Use the API

rows 10 / 87

code name id
NDP
Nuclear Disarmament Party of Australia
1087
HOV
Hear Our Voice
1213
LP
Liberal
170
NP
The Nationals
173
PUA
Pauline
1190
ON
One Nation WA
1163
WWW
What Women Want (Australia)
1186
GRN
Australian Greens
1061
FPY
The Fishing Party
1164
CCC
CCC
1191

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.19 MB) Use the API

rows 10 / 4423

name id
BRESNAN, Amanda
17277
HOLDER, John
17310
COLBERT, Natalie
18175
ELLIS, Annette
17614
CHURCHILL, Darren
17431
ARNOLD, Jim
17311
IQBAL, Farida
18090
TARANTO, Kerri
18402
HUNTER, Meredith
17278
WILLIAMS, Troy
18176

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.19 MB) Use the API

rows 10 / 9535

updated elected votes incumbent candidate_id contest_id event_id party_id election_id
2007-12-12T15:44:09
false
1430
false
18248
103
13745
1181
H
2007-12-12T15:44:09
false
492
false
18213
103
13745
1166
H
2007-12-12T15:44:09
false
27728
false
17949
103
13745
188
H
2007-12-12T15:44:09
false
45059
false
18021
103
13745
194
H
2007-12-12T15:44:09
false
4612
false
17300
103
13745
37
H
2007-12-12T15:44:09
false
3180
false
18265
103
13745
1184
H
2007-12-13T13:29:46
false
6784
false
17454
104
13745
37
H
2007-12-13T13:29:46
false
2465
false
18254
104
13745
1184
H
2007-12-13T13:29:46
false
27425
false
17856
104
13745
188
H
2007-12-13T13:29:46
true
45292
true
18038
104
13745
194
H

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.19 MB) Use the API

rows 10 / 1102

updated elected votes incumbent candidate_id contest_id event_id party_id election_id
2007-12-12T15:44:09
false
32098
false
17949
103
13745
188
H
2007-12-12T15:44:09
false
50403
false
18021
103
13745
194
H
2007-12-13T13:29:46
false
31064
false
17856
104
13745
188
H
2007-12-13T13:29:46
true
50902
true
18038
104
13745
194
H
2007-12-13T15:25:19
false
24673
false
17802
107
13745
188
H
2007-12-13T15:25:19
true
52737
true
18160
107
13745
194
H
2007-12-13T16:18:47
false
23624
false
17799
111
13745
188
H
2007-12-13T16:18:47
false
56724
false
18042
111
13745
194
H
2007-12-14T08:46:43
false
37424
false
18034
112
13745
194
H
2007-12-14T08:46:43
true
48682
true
17914
112
13745
188
H

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.19 MB) Use the API

rows 10 / 483

enrolment event_id name id election_id
122401
13745
Canberra
101
H
116341
13745
Fraser
102
H
92726
13745
Banks
103
H
91393
13745
Barton
104
H
97573
13745
Bennelong
105
H
91685
13745
Berowra
106
H
91770
13745
Blaxland
107
H
93396
13745
Bradfield
108
H
89080
13745
Calare
109
H
91129
13745
Charlton
110
H

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.19 MB) Use the API

rows 10 / 15

category event_id name id
House
13745
House of Representatives Election
H
Senate
13745
Half Senate Election
S
ByElection
13813
House of Representatives By-election for the division of Gippsland
H
ByElection
13826
House of Representatives By-election for the division of Mayo
H
ByElection
13827
House of Representatives By-election for the division of Lyne
H
ByElection
14357
House of Representatives By-election for the division of Bradfield
H
ByElection
14358
House of Representatives By-election for the division of Higgins
H
House
15508
House of Representatives Election
H
Senate
15508
Half Senate Election
S
House
17496
House of Representatives Election
H

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.19 MB) Use the API

rows 10 / 12

name id
2007 Federal Election
13745
Gippsland By-election
13813
Mayo By-election
13826
Lyne By-election
13827
Bradfield By-election
14357
Higgins By-election
14358
2010 Federal Election
15508
2013 Federal Election
17496
Griffith By-election
17552
2014 WA Senate Election
17875

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (1.19 MB) Use the API

rows 10 / 58

file id
aec-mediafeed-Detailed-Verbose-13745-20071214111423.zip
13745
aec-mediafeed-Detailed-Verbose-13745-20071217151532.zip
13745
aec-mediafeed-Detailed-Verbose-13745-20071221113615.zip
13745
aec-mediafeed-Detailed-Verbose-13813-20080727201647.zip
13813
aec-mediafeed-Detailed-Verbose-13813-20080728164700.zip
13813
aec-mediafeed-Detailed-Verbose-13813-20080729131720.zip
13813
aec-mediafeed-Detailed-Verbose-13813-20080730094654.zip
13813
aec-mediafeed-Detailed-Verbose-13813-20080731061649.zip
13813
aec-mediafeed-Detailed-Verbose-13826-20081008090205.zip
13826
aec-mediafeed-Detailed-Verbose-13826-20081008131204.zip
13826

Statistics

Average successful run time: 4 minutes

Total run time: about 1 hour

Total cpu time used: 9 minutes

Total disk space used: 1.23 MB

History

  • Manually ran revision 56dfca84 and completed successfully .
    nothing changed in the database
  • Manually ran revision 56dfca84 and completed successfully .
    15715 records added in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added, 10389 records removed in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added, 10389 records removed in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added, 10389 records removed in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added, 10389 records removed in the database
  • Manually ran revision 382808b0 and failed .
    3326 records added, 3326 records removed in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added, 10389 records removed in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added, 10389 records removed in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added in the database
  • Manually ran revision 382808b0 and completed successfully .
    10389 records added in the database
  • Manually ran revision f56c9e84 and completed successfully .
    10389 records added in the database
  • Manually ran revision 5ed4b0a4 and failed .
    nothing changed in the database
  • Created on morph.io