5um1th / test_aec

AEC scraper


This is a scraper that runs on Morph. To get started see the documentation

Contributors 5um1th

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... aec-mediafeed-Detailed-Verbose-20499-20160624152218.zip Processing Data for H Canberra Processing Data for H Fenner Processing Data for H Banks Processing Data for H Barton Processing Data for H Bennelong Processing Data for H Berowra Processing Data for H Blaxland Processing Data for H Bradfield Processing Data for H Calare Processing Data for H Chifley Processing Data for H Cook Processing Data for H Cowper Processing Data for H Cunningham Processing Data for H Dobell Processing Data for H Eden-Monaro Processing Data for H Farrer Processing Data for H Fowler Processing Data for H Gilmore Processing Data for H Grayndler Processing Data for H Greenway Processing Data for H Hughes Processing Data for H Hume Processing Data for H Hunter Processing Data for H Kingsford Smith Processing Data for H Lindsay Processing Data for H Lyne Processing Data for H Macarthur Processing Data for H Mackellar Processing Data for H Macquarie Processing Data for H McMahon Processing Data for H Mitchell Processing Data for H New England Processing Data for H Newcastle Processing Data for H North Sydney Processing Data for H Page Processing Data for H Parkes Processing Data for H Parramatta Processing Data for H Paterson Processing Data for H Reid Processing Data for H Richmond Processing Data for H Riverina Processing Data for H Robertson Processing Data for H Shortland Processing Data for H Sydney Processing Data for H Warringah Processing Data for H Watson Processing Data for H Wentworth Processing Data for H Werriwa Processing Data for H Whitlam Processing Data for H Lingiari Processing Data for H Solomon Processing Data for H Blair Processing Data for H Bonner Processing Data for H Bowman Processing Data for H Brisbane Processing Data for H Capricornia Processing Data for H Dawson Processing Data for H Dickson Processing Data for H Fadden Processing Data for H Fairfax Processing Data for H Fisher Processing Data for H Flynn Processing Data for H Forde Processing Data for H Griffith Processing Data for H Groom Processing Data for H Herbert Processing Data for H Hinkler Processing Data for H Kennedy Processing Data for H Leichhardt Processing Data for H Lilley Processing Data for H Longman Processing Data for H Maranoa Processing Data for H Moncrieff Processing Data for H Moreton Processing Data for H Oxley Processing Data for H Petrie Processing Data for H Rankin Processing Data for H Ryan Processing Data for H Wide Bay Processing Data for H Wright Processing Data for H Adelaide Processing Data for H Barker Processing Data for H Boothby Processing Data for H Grey Processing Data for H Hindmarsh Processing Data for H Kingston Processing Data for H Makin Processing Data for H Mayo Processing Data for H Port Adelaide Processing Data for H Sturt Processing Data for H Wakefield Processing Data for H Bass Processing Data for H Braddon Processing Data for H Denison Processing Data for H Franklin Processing Data for H Lyons Processing Data for H Aston Processing Data for H Ballarat Processing Data for H Batman Processing Data for H Bendigo Processing Data for H Bruce Processing Data for H Calwell Processing Data for H Casey Processing Data for H Chisholm Processing Data for H Corangamite Processing Data for H Corio Processing Data for H Deakin Processing Data for H Dunkley Processing Data for H Flinders Processing Data for H Gellibrand Processing Data for H Gippsland Processing Data for H Goldstein Processing Data for H Gorton Processing Data for H Higgins Processing Data for H Holt Processing Data for H Hotham Processing Data for H Indi Processing Data for H Isaacs Processing Data for H Jagajaga Processing Data for H Kooyong Processing Data for H La Trobe Processing Data for H Lalor Processing Data for H Mallee Processing Data for H Maribyrnong Processing Data for H McEwen Processing Data for H McMillan Processing Data for H Melbourne Processing Data for H Melbourne Ports Processing Data for H Menzies Processing Data for H Murray Processing Data for H Scullin Processing Data for H Wannon Processing Data for H Wills Processing Data for H Brand Processing Data for H Burt Processing Data for H Canning Processing Data for H Cowan Processing Data for H Curtin Processing Data for H Durack Processing Data for H Forrest Processing Data for H Fremantle Processing Data for H Hasluck Processing Data for H Moore Processing Data for H O'Connor Processing Data for H Pearce Processing Data for H Perth Processing Data for H Stirling Processing Data for H Swan Processing Data for H Tangney Processing Data for S Australian Capital Territory Processing Data for S New South Wales Processing Data for S Victoria Processing Data for S Queensland Processing Data for S Western Australia Processing Data for S South Australia Processing Data for S Northern Territory Processing Data for S Tasmania

Data

Downloaded 5 times by 5um1th

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (17.4 MB) Use the API

rows 10 / 104

name code id
Australian Greens
GRN
1061
Nuclear Disarmament Party of Australia
NDP
1087
Hear Our Voice
HOV
1213
The Fishing Party
FPY
1164
Liberal
LP
170
The Nationals
NP
173
Pauline
PUA
1190
One Nation WA
ON
1163
Conservatives for Climate and Environment
CCE
1235
Climate Change Coalition
CCC
1191

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (17.4 MB) Use the API

rows 10 / 5950

name id
McKELVIE, Malcolm
18702
FITZGERALD, Rohan
18705
BUCKLEY, Ben
18701
McCUBBIN, Darren
18704
CHESTER, Darren
18703
BARONS, Rachael
18720
SPRAGG, Bill
18706
KEIZER, Mathew
18714
CASTRIQUE, Andrew
18716
KING, Malcolm Ronald
18719

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (17.4 MB) Use the API

rows 10 / 5999

election_id party_id elected candidate_id contest_id event_id incumbent votes
H
1061
false
18702
213
13813
false
5862
H
180
false
18705
213
13813
false
17249
H
1166
false
18701
213
13813
false
3518
H
195
false
18704
213
13813
false
23652
H
174
true
18703
213
13813
true
32971
H
37
false
18722
188
13826
false
15851
H
1235
false
18720
188
13826
false
725
H
false
18706
188
13826
false
1545
H
1133
false
18714
188
13826
false
503
H
false
17706
188
13826
false
1868

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (17.4 MB) Use the API

rows 10 / 916

election_id party_id elected candidate_id contest_id event_id incumbent votes
H
195
false
18704
213
13813
false
31641
H
174
true
18703
213
13813
true
51611
H
37
false
18722
188
13826
false
34879
H
184
true
18713
188
13826
true
39381
H
true
18721
130
13827
true
54770
H
172
false
18717
130
13827
false
19377
H
37
false
18894
108
14357
false
24831
H
188
true
18883
108
14357
true
45717
H
180
true
18887
215
14358
true
40203
H
37
false
18900
215
14358
false
26544

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (17.4 MB) Use the API

rows 10 / 641

election_id enrolment event_id name id
H
95580
13813
Gippsland
213
H
97550
13826
Mayo
188
H
87854
13827
Lyne
130
H
95083
14357
Bradfield
108
H
88130
14358
Higgins
215
H
97804
17552
Griffith
163
S
1480820
17875
Western Australia
WA
H
112824
18126
Canning
236
H
104294
19402
North Sydney
137
H
122447
13745
Canberra
101

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (17.4 MB) Use the API

rows 10 / 17

event_id name category id
13813
House of Representatives By-election for the division of Gippsland
ByElection
H
13826
House of Representatives By-election for the division of Mayo
ByElection
H
13827
House of Representatives By-election for the division of Lyne
ByElection
H
14357
House of Representatives By-election for the division of Bradfield
ByElection
H
14358
House of Representatives By-election for the division of Higgins
ByElection
H
17552
House of Representatives By-election for the division of Griffith
ByElection
H
17875
Half Senate Election
Senate
S
18126
House of Representatives By-election for the division of Canning
ByElection
H
19402
House of Representatives By-election for the division of North Sydney
ByElection
H
13745
House of Representatives Election
House
H

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (17.4 MB) Use the API

rows 10 / 13

name id
Gippsland By-election
13813
Mayo By-election
13826
Lyne By-election
13827
Bradfield By-election
14357
Higgins By-election
14358
Griffith By-election
17552
2014 WA Senate Election
17875
Canning By-election
18126
North Sydney By-election
19402
2007 Federal Election
13745

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (17.4 MB) Use the API

rows 10 / 238794

contest_id polling_place_id event_id election_id votes candidate_id
101
8829
13745
H
363
17277
101
8829
13745
H
778
18175
101
8829
13745
H
1026
17614
101
8829
13745
H
13
17310
101
11877
13745
H
235
17277
101
11877
13745
H
724
18175
101
11877
13745
H
1106
17614
101
11877
13745
H
24
17310
101
11452
13745
H
278
17277
101
11452
13745
H
1041
18175

Statistics

Average successful run time: about 3 hours

Total run time: about 16 hours

Total cpu time used: about 9 hours

Total disk space used: 17.5 MB

History

  • Manually ran revision 17838cdd and completed successfully .
    59109 records added, 74 records removed in the database
  • Manually ran revision c280978a and completed successfully .
    77195 records added, 3943 records removed in the database
  • Manually ran revision 6a3b5eec and completed successfully .
    54584 records added, 2860 records removed in the database
  • Manually ran revision ace6e94c and failed .
    61345 records added, 3311 records removed in the database
  • Manually ran revision c2e28d36 and completed successfully .
    10389 records added in the database
  • Created on morph.io

Scraper code

Python

test_aec / scraper.py