tmtmtmtm / publicwhip_policies

scrape Policy data from PublicWhip


This is a scraper that runs on Morph. To get started see the documentation

Contributors tmtmtmtm

Last run completed successfully .

Console output of last run

Skipping Policy 363 Skipping Policy 810 Skipping Policy 811 Skipping Policy 826 Skipping Policy 837 Skipping Policy 975 Skipping Policy 984 Skipping Policy 996 Skipping Policy 1027 Skipping Policy 1030 Skipping Policy 1049 Fetching Policy 1050 pw-2002-03-18-197 Hunting with Dogs: Self-Supervision Scheme pw-2002-03-18-198 Hunting with Dogs: Hunting Under Licence pw-2002-03-18-199 Hunting with Dogs: Ban pw-2003-06-30-259 Hunting Bill — New Clause 6 — Use of Dogs Below Ground (No. 2) pw-2003-06-30-260 Hunting Bill — New Clause 11 — Registration in Respect of Hunting of Foxes pw-2003-06-30-261 Hunting Bill — New Clause 14 — Registration in Respect of Hunting of Mink pw-2004-09-15-250 Hunting Bill Skipping Policy 1051 Skipping Policy 1052 Skipping Policy 1053 Skipping Policy 1065 Skipping Policy 1071 Skipping Policy 1074 Skipping Policy 1079 Skipping Policy 1084 Fetching Policy 1087 pw-2002-06-11-263 Nationality, Immigration and Asylum Bill — Only allow destitute asylum seekers and those under residence restrictions to live in accommodation centres for a maximum of 10 weeks — rejected pw-2002-06-11-264 Nationality, Immigration and Asylum Bill — Do not allow appeals against rejected asylum claims from within the UK if the claim is unfounded pw-2002-06-11-267 Nationality, Immigration and Asylum Bill — Allow earlier rights of appeal — rejected pw-2002-06-12-268 Nationality, Immigration and Asylum Bill — Allow the withdrawal of support from immigrants and asylum seekers in certain circumstances pw-2002-06-12-270 Nationality, Immigration and Asylum Bill — Do not penalise those who bring passengers to the UK without the necessary authority — rejected pw-2002-06-12-272 Nationality, Immigration and Asylum Bill — Third Reading pw-2002-11-05-347 Nationality, Immigration and Asylum Bill — Asylum seekers can be placed in accommodation centres even if there is no local school pace for dependent children pw-2002-11-05-350 Nationality, Immigration and Asylum Bill — Refuse support to asylum seekers who make a late claim pw-2003-03-17-116 Asylum (Designated States) Order 2003 pw-2003-07-16-292 Asylum (Designated States) (No. 2) Order 2003 pw-2003-12-17-16 Asylum and Immigration (Treatment of Claimants, etc.) Bill — Decline to give a Second Reading — rejected pw-2003-12-17-17 Asylum and Immigration (Treatment of Claimants, etc.) Bill — Second Reading pw-2003-12-17-18 Asylum and Immigration (Treatment of Claimants, Etc.) Bill — Timetable pw-2004-03-01-61 Asylum and Immigration (Treatment of Claimants, Etc.) Bill — Burden of proof on prosecution rather than defendant in cases where immigrants to not have travel documents — rejected pw-2004-03-01-62 Asylum and Immigration (Treatment of Claimants, Etc.) Bill — Give support to failed asylum seekers and their families — rejected pw-2004-03-01-63 Asylum and Immigration (Treatment of Claimants, Etc.) Bill — Asylum appeals should be referred to a higher court — rejected pw-2004-03-01-65 Asylum and Immigration (Treatment of Claimants, Etc.) Bill — Give support to asylum seekers even when they make a late claim — rejected pw-2004-03-01-67 Asylum and Immigration (Treatment of Claimants, Etc.) Bill — Third Reading pw-2005-07-05-29 Immigration, Asylum and Nationality Bill — Timetable pw-2005-11-16-99 Immigration, Asylum and Nationality Bill — Excuse employers who employed illegal immigrants but took reasonable steps to comply with the necessary requirements — rejected pw-2005-11-16-100 Immigration, Asylum and Nationality Bill — Prevent the government from interpreting the Geneva Convention so that terrorism can be used as grounds to dismiss asylum claims — rejected pw-2005-11-16-102 Immigration, Asylum and Nationality Bill — Third Reading pw-2006-03-29-204 Immigration, Asylum and Nationality Bill — Timetable pw-2006-03-29-205 Immigration, Asylum and Nationality Bill — Allow failed asylum seekers to be given cash rather than vouchers — rejected pw-2007-07-25-199 The Asylum (Designated States) Order 2007 Skipping Policy 1105 Skipping Policy 1109 Skipping Policy 1110 Skipping Policy 1113 Skipping Policy 1120 Skipping Policy 1124 Skipping Policy 1132 Skipping Policy 1136 Skipping Policy 6667 Skipping Policy 6670 Skipping Policy 6671 Skipping Policy 6672 Skipping Policy 6673 Skipping Policy 6674 Skipping Policy 6676 Skipping Policy 6677 Skipping Policy 6678 Skipping Policy 6679 Skipping Policy 6680 Skipping Policy 6681 Skipping Policy 6682 Skipping Policy 6683 Skipping Policy 6684 Skipping Policy 6685 Skipping Policy 6686 Skipping Policy 6687 Skipping Policy 6688 Skipping Policy 6690 Skipping Policy 6691 Skipping Policy 6692 Skipping Policy 6693 Skipping Policy 6694 Skipping Policy 6695 Skipping Policy 6696 Skipping Policy 6698 Skipping Policy 6699 Skipping Policy 6697 Skipping Policy 6702 Skipping Policy 6703 Skipping Policy 6704 Skipping Policy 6705 Skipping Policy 6706 Skipping Policy 6707 Skipping Policy 6708 Skipping Policy 6709 Skipping Policy 6710 Skipping Policy 6711 Skipping Policy 6715 Skipping Policy 6716 Skipping Policy 6718 Skipping Policy 6719 Skipping Policy 6720 Skipping Policy 6721

Data

Downloaded 858050 times by tmtmtmtm MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (195 MB) Use the API

rows 10 / 1181

id text date hansard result datetime direction policy shortdesc
pw-2003-01-08-42
Foundation Hospitals
2003-01-08
failed
2003-01-08T18:42:00+00:00
abstain
363
pw-2003-01-08-43
Foundation Hospitals
2003-01-08
passed
2003-01-08T18:59:00+00:00
abstain
363
pw-2003-05-07-177
Health and Social Care (Community Health and Standards) Bill
2003-05-07
failed
2003-05-07T18:45:00+00:00
Majority (strong)
363
pw-2003-05-07-178
Health and Social Care (Community Health and Standards) Bill
2003-05-07
passed
2003-05-07T18:59:00+00:00
Majority (strong)
363
pw-2003-07-08-280
Health and Social Care (Community Health and Standards) Bill — NHS Foundation Trusts
2003-07-08
failed
2003-07-08T16:15:00+00:00
Majority (strong)
363
pw-2003-07-08-281
Health and Social Care (Community Health and Standards) Bill — NHS Community Trusts
2003-07-08
failed
2003-07-08T16:19:00+00:00
abstain
363
pw-2003-07-08-282
Health and Social Care (Community Health and Standards) Bill — New Clause 9 — Foundation Patients' Fora
2003-07-08
failed
2003-07-08T16:36:00+00:00
abstain
363
pw-2003-11-19-381
Health and Social Care (Community Health and Standards) Bill — Clause 1 — NHS foundation trusts
2003-11-19
passed
2003-11-19T16:45:00+00:00
Majority (strong)
363
pw-2003-11-19-388
Health and Social Care (Community Health and Standards) Bill — Clause 1 — NHS Foundation Trusts
2003-11-19
passed
2003-11-20T02:00:00+00:00
Majority (strong)
363
pw-2004-11-01-296
Gambling Bill — reasoned amendment on 2nd reading
2004-11-01
failed
2004-11-01T21:46:00+00:00
minority (strong)
810

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (195 MB) Use the API

rows 10 / 564757

name url constituency party option motion role
Mr Peter Ainsworth
East Surrey
Con
yes
pw-2003-01-08-42
Mr David Amess
Southend West
Con
yes
pw-2003-01-08-42
Earl of Michael Ancram
Devizes
Con
yes
pw-2003-01-08-42
Mr James Arbuthnot
North East Hampshire
Con
yes
pw-2003-01-08-42
Mr David Atkinson
Bournemouth East
Con
yes
pw-2003-01-08-42
Mr Peter Atkinson
Hexham
Con
yes
pw-2003-01-08-42
Mr Richard Bacon
South Norfolk
Con
yes
pw-2003-01-08-42
Mr Tony Baldry
Banbury
Con
yes
pw-2003-01-08-42
Mr Gregory Barker
Bexhill and Battle
Con
yes
pw-2003-01-08-42
Mr John Baron
Billericay
Con
yes
pw-2003-01-08-42

Statistics

Average successful run time: 5 minutes

Total run time: about 1 hour

Total cpu time used: 21 minutes

Total disk space used: 195 MB

History

  • Manually ran revision 1e95bc10 and completed successfully .
    21024 records added, 21024 records removed in the database
  • Manually ran revision 1e95bc10 and completed successfully .
    565872 records added, 564571 records removed, 67 records updated in the database
  • Manually ran revision ad5ec5c1 and completed successfully .
    1 record added, 1 record removed in the database
  • Manually ran revision 4cb0e034 and completed successfully .
    3 records added, 3 records removed, 1247 records updated in the database
  • Manually ran revision 498d6c01 and completed successfully .
    1 record added, 1 record removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

publicwhip_policies / scraper.rb