everypolitician-scrapers / australia-positions

Contributors tmtmtmtm

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:363:in `open_http': 403 Please identify your user agent, see https://meta.wikimedia.org/wiki/User-Agent_policy (OpenURI::HTTPError) from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:741:in `buffer_open' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:212:in `block in open_loop' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:210:in `catch' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:210:in `open_loop' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:151:in `open_uri' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:721:in `open' from /app/vendor/ruby-2.4.4/lib/ruby/2.4.0/open-uri.rb:35:in `open' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request/strategy/live_request.rb:10:in `response' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:29:in `block in first_successful_response' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `each' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `first' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:30:in `first_successful_response' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/request.rb:13:in `response' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/scraper.rb:15:in `scraper' from /app/vendor/bundle/ruby/2.4.0/bundler/gems/scraped-ecb23adeca95/lib/scraped/scraper.rb:8:in `store' from scraper.rb:8:in `<main>'

Data

Downloaded 1397 times by everypolitician davispg

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (243 KB) Use the API

rows 10 / 392

id name position_id position label start_date end_date ordinal
Q314016
Andrew Fisher
q314016-21D5C1BF-E45B-4D8C-A38A-C212F6BF3F05
Q319145
Prime Minister of Australia
1908-11-13
1909-06-02
5
Q51330
John Howard
q51330-6FCE74BA-8B02-4E39-8B8D-1E36101570D1
Q319145
Prime Minister of Australia
1996-03-11
2007-12-03
25
Q7614564
Steven Ciobo
Q7614564-EA5352C5-87E4-49DF-BFB9-6B8F4A1900A5
Q2660943
Minister for Foreign Affairs
2015-09-21
2016-02-18
0
Q269372
Bob Hawke
q269372-733DE9B5-6B8F-43FF-94C5-94A084565CA3
Q319145
Prime Minister of Australia
1983-03-11
1991-12-20
23
Q250087
Bill Hayden
Q250087-AE7837BF-F5AA-4890-8A74-DAE8628CE6FC
Q2390270
Treasurer of Australia
1975-06-06
1975-11-11
0
Q348577
Tony Abbott
q348577-74df9d79-4da7-c36f-f9bf-5e6bfc4684b8
Q319145
Prime Minister of Australia
2013-09-18
2015-09-15
28
Q23358
Stanley Bruce
Q23358-66DF1E60-6CAD-4698-9AD1-0AEC57B42927
Q2390270
Treasurer of Australia
1921-12-21
1923-02-08
0
Q214438
Robert Menzies
Q214438-fe602ac5-43d0-b83c-72fa-d52877ba7084
Q319145
Prime Minister of Australia
1939-04-26
1941-08-29
12
Q23342
Edmund Barton
q23342-3CBBC73A-407C-4A24-A98E-6B3CFB174ADC
Q319145
Prime Minister of Australia
1901-01-01
1903-09-24
1
Q23369
Arthur Fadden
q23369-EFDFDAEA-356A-4A90-BAC5-6EDC91843238
Q319145
Prime Minister of Australia
1941-08-29
1941-10-07
13

Statistics

Average successful run time: 1 minute

Total run time: about 18 hours

Total cpu time used: about 2 hours

Total disk space used: 278 KB

History

  • Auto ran revision 97e64629 and failed .
    nothing changed in the database
  • Auto ran revision 97e64629 and failed .
    nothing changed in the database
  • Auto ran revision 97e64629 and failed .
    nothing changed in the database
  • Auto ran revision 97e64629 and failed .
    nothing changed in the database
  • Auto ran revision 97e64629 and failed .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

australia-positions / scraper.rb