drzax / morph-seat-by-seat-polls-2016

Seat by seat polls scraper

Scrapes en.wikipedia.org and api.morph.io

Wikipedia, the free encyclopedia


Australian federal election individual seat polls 2016

According to the wikipedia.

Pull requests welcome.

This is a scraper that runs on Morph. To get started see the documentation.

Contributors drzax

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Node.js app detected  -----> Creating runtime environment   NPM_CONFIG_LOGLEVEL=error  NPM_CONFIG_PRODUCTION=true  NPM_CONFIG_CAFILE=/etc/ssl/certs/ca-certificates.crt  NODE_VERBOSE=false  NODE_ENV=production  NODE_TLS_REJECT_UNAUTHORIZED=0  NODE_MODULES_CACHE=true  -----> Installing binaries  engines.node (package.json): 5.8.0  engines.npm (package.json): 3.8.2   Resolving node version 5.8.0...  Downloading and installing node 5.8.0...  Bootstrapping npm 3.8.2 (replacing 3.7.3)...  npm 3.8.2 installed  -----> Restoring cache  Skipping cache restore (not-found)  -----> Building dependencies  Installing node modules (package.json)   > sqlite3@3.1.13 install /tmp/build/node_modules/sqlite3  > node-pre-gyp install --fallback-to-build   [sqlite3] Success: "/tmp/build/node_modules/sqlite3/lib/binding/node-v47-linux-x64/node_sqlite3.node" is installed via remote  morph-seat-by-seat-polls-2016@1.0.0 /tmp/build  +-- cheerio@1.0.0-rc.2  | +-- css-select@1.2.0  | | +-- boolbase@1.0.0  | | +-- css-what@2.1.0  | | +-- domutils@1.5.1  | | `-- nth-check@1.0.1  | +-- dom-serializer@0.1.0  | | `-- domelementtype@1.1.3  | +-- entities@1.1.1  | +-- htmlparser2@3.9.2  | | +-- domelementtype@1.3.0  | | +-- domhandler@2.4.1  | | +-- inherits@2.0.3  | | `-- readable-stream@2.3.6  | | +-- core-util-is@1.0.2  | | +-- isarray@1.0.0  | | +-- process-nextick-args@2.0.0  | | +-- string_decoder@1.1.1  | | `-- util-deprecate@1.0.2  | +-- lodash@4.17.5  | `-- parse5@3.0.3  | `-- @types/node@9.6.6  +-- moment@2.22.1  +-- request@2.85.0  | +-- aws-sign2@0.7.0  | +-- aws4@1.7.0  | +-- caseless@0.12.0  | +-- combined-stream@1.0.6  | | `-- delayed-stream@1.0.0  | +-- extend@3.0.1  | +-- forever-agent@0.6.1  | +-- form-data@2.3.2  | | `-- asynckit@0.4.0  | +-- har-validator@5.0.3  | | +-- ajv@5.5.2  | | | +-- co@4.6.0  | | | +-- fast-deep-equal@1.1.0  | | | +-- fast-json-stable-stringify@2.0.0  | | | `-- json-schema-traverse@0.3.1  | | `-- har-schema@2.0.0  | +-- hawk@6.0.2  | | +-- boom@4.3.1  | | +-- cryptiles@3.1.2  | | | `-- boom@5.2.0  | | +-- hoek@4.2.1  | | `-- sntp@2.1.0  | +-- http-signature@1.2.0  | | +-- assert-plus@1.0.0  | | +-- jsprim@1.4.1  | | | +-- extsprintf@1.3.0  | | | +-- json-schema@0.2.3  | | | `-- verror@1.10.0  | | `-- sshpk@1.14.1  | | +-- asn1@0.2.3  | | +-- bcrypt-pbkdf@1.0.1  | | +-- dashdash@1.14.1  | | +-- ecc-jsbn@0.1.1  | | +-- getpass@0.1.7  | | +-- jsbn@0.1.1  | | `-- tweetnacl@0.14.5  | +-- is-typedarray@1.0.0  | +-- isstream@0.1.2  | +-- json-stringify-safe@5.0.1  | +-- mime-types@2.1.18  | | `-- mime-db@1.33.0  | +-- oauth-sign@0.8.2  | +-- performance-now@2.1.0  | +-- qs@6.5.1  | +-- safe-buffer@5.1.1  | +-- stringstream@0.0.5  | +-- tough-cookie@2.3.4  | | `-- punycode@1.4.1  | +-- tunnel-agent@0.6.0  | `-- uuid@3.2.1  `-- sqlite3@3.1.13  +-- nan@2.7.0  `-- node-pre-gyp@0.6.38  +-- hawk@3.1.3  | +-- boom@2.10.1  | +-- cryptiles@2.0.5  | +-- hoek@2.16.3  | `-- sntp@1.0.9  +-- mkdirp@0.5.1  | `-- minimist@0.0.8  +-- nopt@4.0.1  | +-- abbrev@1.1.1  | `-- osenv@0.1.4  | +-- os-homedir@1.0.2  | `-- os-tmpdir@1.0.2  +-- npmlog@4.1.2  | +-- are-we-there-yet@1.1.4  | | `-- delegates@1.0.0  | +-- console-control-strings@1.1.0  | +-- gauge@2.7.4  | | +-- aproba@1.2.0  | | +-- has-unicode@2.0.1  | | +-- object-assign@4.1.1  | | +-- signal-exit@3.0.2  | | +-- string-width@1.0.2  | | | +-- code-point-at@1.1.0  | | | `-- is-fullwidth-code-point@1.0.0  | | | `-- number-is-nan@1.0.1  | | +-- strip-ansi@3.0.1  | | | `-- ansi-regex@2.1.1  | | `-- wide-align@1.1.2  | `-- set-blocking@2.0.0  +-- rc@1.2.1  | +-- deep-extend@0.4.2  | +-- ini@1.3.4  | +-- minimist@1.2.0  | `-- strip-json-comments@2.0.1  +-- request@2.81.0  | +-- aws-sign2@0.6.0  | +-- aws4@1.6.0  | +-- caseless@0.12.0  | +-- combined-stream@1.0.5  | | `-- delayed-stream@1.0.0  | +-- extend@3.0.1  | +-- forever-agent@0.6.1  | +-- form-data@2.1.4  | | `-- asynckit@0.4.0  | +-- har-validator@4.2.1  | | +-- ajv@4.11.8  | | | +-- co@4.6.0  | | | `-- json-stable-stringify@1.0.1  | | | `-- jsonify@0.0.0  | | `-- har-schema@1.0.5  | +-- http-signature@1.1.1  | | +-- assert-plus@0.2.0  | | +-- jsprim@1.4.1  | | | +-- assert-plus@1.0.0  | | | +-- extsprintf@1.3.0  | | | +-- json-schema@0.2.3  | | | `-- verror@1.10.0  | | | `-- assert-plus@1.0.0  | | `-- sshpk@1.13.1  | | +-- asn1@0.2.3  | | +-- assert-plus@1.0.0  | | +-- bcrypt-pbkdf@1.0.1  | | +-- dashdash@1.14.1  | | | `-- assert-plus@1.0.0  | | +-- ecc-jsbn@0.1.1  | | +-- getpass@0.1.7  | | | `-- assert-plus@1.0.0  | | +-- jsbn@0.1.1  | | `-- tweetnacl@0.14.5  | +-- is-typedarray@1.0.0  | +-- isstream@0.1.2  | +-- json-stringify-safe@5.0.1  | +-- mime-types@2.1.17  | | `-- mime-db@1.30.0  | +-- oauth-sign@0.8.2  | +-- performance-now@0.2.0  | +-- qs@6.4.0  | +-- safe-buffer@5.1.1  | +-- stringstream@0.0.5  | +-- tough-cookie@2.3.3  | | `-- punycode@1.4.1  | +-- tunnel-agent@0.6.0  | `-- uuid@3.1.0  +-- rimraf@2.6.2  | `-- glob@7.1.2  | +-- fs.realpath@1.0.0  | +-- inflight@1.0.6  | +-- minimatch@3.0.4  | | `-- brace-expansion@1.1.8  | | +-- balanced-match@1.0.0  | | `-- concat-map@0.0.1  | `-- path-is-absolute@1.0.1  +-- semver@5.4.1  +-- tar@2.2.1  | +-- block-stream@0.0.9  | +-- fstream@1.0.11  | | `-- graceful-fs@4.1.11  | `-- inherits@2.0.3  `-- tar-pack@3.4.0  +-- debug@2.6.9  | `-- ms@2.0.0  +-- fstream-ignore@1.0.5  +-- once@1.4.0  | `-- wrappy@1.0.2  +-- readable-stream@2.3.3  | +-- core-util-is@1.0.2  | +-- isarray@1.0.0  | +-- process-nextick-args@1.0.7  | +-- string_decoder@1.0.3  | `-- util-deprecate@1.0.2  `-- uid-number@0.0.6   -----> Caching build  Clearing previous node cache  Saving 2 cacheDirectories (default):  - node_modules  - bower_components (nothing to cache)  -----> Build succeeded!  -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 55 times by drzax pat

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (28 KB) Use the API

rows 10 / 87

electorateName electorateCode date party1code party1pct party2code party2pct reference
Macarthur
maca
2016-06-25T00:00:00.000Z
L/NP
50
ALP
50
Dobell
dobe
2016-06-25T00:00:00.000Z
L/NP
51
ALP
49
Banks
bank
2016-06-25T00:00:00.000Z
L/NP
52
ALP
48
Cowper
cowp
2016-06-24T00:00:00.000Z
L/NP
50
IND
50
Eden-Monaro
emon
2016-06-23T00:00:00.000Z
L/NP
45
ALP
55
Dobell
dobe
2016-06-23T00:00:00.000Z
L/NP
47
ALP
53
Gilmore
gilm
2016-06-23T00:00:00.000Z
L/NP
47
ALP
53
Lindsay
lind
2016-06-23T00:00:00.000Z
L/NP
46
ALP
54
Macquarie
macq
2016-06-23T00:00:00.000Z
L/NP
46
ALP
54
Page
page
2016-06-23T00:00:00.000Z
L/NP
46
ALP
54

Statistics

Average successful run time: less than a minute

Total run time: about 1 month

Total cpu time used: 31 minutes

Total disk space used: 56.9 KB

History

  • Auto ran revision 6f26f6f1 and completed successfully .
    12 records updated in the database
    2 pages scraped
  • Auto ran revision 6f26f6f1 and completed successfully .
    12 records updated in the database
    126 pages scraped
  • Auto ran revision 6f26f6f1 and completed successfully .
    7 records updated in the database
    2 pages scraped
  • Auto ran revision 6f26f6f1 and completed successfully .
    4 records updated in the database
    2 pages scraped
  • Auto ran revision 6f26f6f1 and completed successfully .
    4 records updated in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history