wfdd / bahamas-parliament-scraper

A scraper for the members of the Bahamian House of Assembly.

Contributors wfdd

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... [1G [1G-----> Python app detected [1G ! The latest version of Python 3 is python-3.6.2 (you are using python-3.5.1, which is unsupported). [1G ! We recommend upgrading by specifying the latest version (python-3.6.2). [1G Learn More: https://devcenter.heroku.com/articles/python-runtimes [1G-----> Installing python-3.5.1 [1G-----> Installing pip [1G-----> Installing requirements with pip [1G Collecting lxml==3.6.0 (from -r /tmp/build/requirements.txt (line 1)) [1G Downloading https://files.pythonhosted.org/packages/11/1b/fe6904151b37a0d6da6e60c13583945f8ce3eae8ebd0ec763ce546358947/lxml-3.6.0.tar.gz (3.7MB) [1G Collecting selenium==2.53.4 (from -r /tmp/build/requirements.txt (line 2)) [1G Downloading https://files.pythonhosted.org/packages/31/55/98b2a3091bb5dedff7ab22651af033be00173df5568a55bd109492cc270c/selenium-2.53.4-py2.py3-none-any.whl (1.1MB) [1G Collecting splinter==0.7.3 (from -r /tmp/build/requirements.txt (line 3)) [1G Downloading https://files.pythonhosted.org/packages/40/b9/7cac56d0f1f419b11ccf0ce9dcd924abe4b7dd17e2be1eb49862568550b4/splinter-0.7.3.tar.gz [1G Installing collected packages: lxml, selenium, splinter [1G Running setup.py install for lxml: started [1G Running setup.py install for lxml: still running... [1G Running setup.py install for lxml: finished with status 'done' [1G Running setup.py install for splinter: started [1G Running setup.py install for splinter: finished with status 'done' [1G Successfully installed lxml-3.6.0 selenium-2.53.4 splinter-0.7.3 [1G [1G [1G-----> Discovering process types [1G Procfile declares types -> scraper Injecting scraper and running... Unable to extract birth date from 'born to Wilmore and Shirley Dames (nee Beneby) on the' Traceback (most recent call last): File "scraper.py", line 104, in <module> main() File "scraper.py", line 95, in main ))(dt.date.today().isoformat())) File "scraper.py", line 92, in <genexpr> (lambda date: ((*p, date) File "scraper.py", line 94, in <genexpr> for r in tuple(collect_rows(session))) File "scraper.py", line 49, in scrape_row honorifics, name).split(',')) ValueError: not enough values to unpack (expected 2, got 1)

Data

Downloaded 1006 times by everypolitician wfdd chrismytton

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (40 KB) Use the API

rows 10 / 35

name sort_name family_name given_name birth_date image group constituency island source as_of
name
Hope Strachan
sort_name
Strachan, Hope
family_name
Strachan
given_name
Hope
birth_date
1960-12-01
image
http://www.bahamas.gov.bs/wps/wcm/connect/fc4e9d67-1b31-466c-9887-3430e8b552e3/Hope+Strachan-Seabreezew.jpg?MOD=AJPERES&CACHEID=fc4e9d67-1b31-466c-9887-3430e8b552e3
group
PLP
constituency
Seabreeze
island
New Providence
source
http://www.bahamas.gov.bs/wps/portal/public/?1dmy&urile=wcm%3apath%3a/mof_content/internet/all+contacts/directory+of+contacts/listed+alphabetically/directory/the+hon.+hope+strachan
as_of
2016-08-23
name
Philip E. Brave Davis
sort_name
Davis, Philip E. Brave
family_name
Davis
given_name
Philip E. Brave
birth_date
1951-06-07
image
http://www.bahamas.gov.bs/wps/wcm/connect/38ff4404-b920-4856-a6db-92686895c640/Brave+davis.jpg?MOD=AJPERES&CACHEID=38ff4404-b920-4856-a6db-92686895c640
group
PLP
constituency
Cat Island, Rum Cay & San Salvador
island
Cat Island
source
http://www.bahamas.gov.bs/wps/portal/public/?1dmy&urile=wcm%3apath%3a/mof_content/internet/all+contacts/directory+of+contacts/listed+alphabetically/directory/the+hon.+philip+e.+brave+davis
as_of
2017-03-22
name
Arnold Forbes
sort_name
Forbes, Arnold
family_name
Forbes
given_name
Arnold
birth_date
1964-09-05
image
http://www.bahamas.gov.bs/wps/wcm/connect/e4dbca38-5634-4203-ace3-0427e919381c/Arnold+Forbes-Mount+Moriah4.jpg?MOD=AJPERES&CACHEID=e4dbca38-5634-4203-ace3-0427e919381c
group
PLP
constituency
island
(None)
source
http://www.bahamas.gov.bs/wps/portal/public/?1dmy&urile=wcm%3apath%3a/mof_content/internet/all+contacts/directory+of+contacts/listed+alphabetically/directory/arnold+forbes
as_of
2017-03-22
name
Michael Darville
sort_name
Darville, Michael
family_name
Darville
given_name
Michael
birth_date
image
http://www.bahamas.gov.bs/wps/wcm/connect/b7ae8878-d2b1-4941-86f2-bad8f0473e15/Dr.+Michael+Darville-+Pineridge.jpg?MOD=AJPERES&CACHEID=b7ae8878-d2b1-4941-86f2-bad8f0473e15
group
PLP
constituency
Pineridge
island
Grand Bahama
source
http://www.bahamas.gov.bs/wps/portal/public/?1dmy&urile=wcm%3apath%3a/mof_content/internet/all+contacts/directory+of+contacts/listed+alphabetically/directory/the+hon.+dr.+michael%2C+darville
as_of
2017-03-22
name
Kenred Dorsett
sort_name
Dorsett, Kenred
family_name
Dorsett
given_name
Kenred
birth_date
1971-02-16
image
http://www.bahamas.gov.bs/wps/wcm/connect/c07a0e95-aaa3-4352-b4e7-71e3c70fd55b/Kenred+Michael.jpg?MOD=AJPERES&CACHEID=c07a0e95-aaa3-4352-b4e7-71e3c70fd55b
group
PLP
constituency
Southern Shores
island
New Providence
source
http://www.bahamas.gov.bs/wps/portal/public/?1dmy&urile=wcm%3apath%3a/mof_content/internet/all+contacts/directory+of+contacts/listed+alphabetically/directory/the+hon.+kenred%2C+dorsett
as_of
2017-03-22
name
Jerome Fitzgerald
sort_name
Fitzgerald, Jerome
family_name
Fitzgerald
given_name
Jerome
birth_date
1966-04-03
image
http://www.bahamas.gov.bs/wps/wcm/connect/5d4f9e02-faf7-4210-8e89-b7b7656fe875/Jerome+Fitzgerald-Marathon.jpg?MOD=AJPERES&CACHEID=5d4f9e02-faf7-4210-8e89-b7b7656fe875
group
PLP
constituency
Marathon
island
New Providence
source
http://www.bahamas.gov.bs/wps/portal/public/?1dmy&urile=wcm%3apath%3a/mof_content/internet/all+contacts/directory+of+contacts/listed+alphabetically/directory/the+hon.+jerome%2C+fitzgerald
as_of
2017-03-22
name
Jerome Fitzgerald
sort_name
Fitzgerald, Jerome
family_name
Fitzgerald
given_name
Jerome
birth_date
1966-04-03
image
http://www.bahamas.gov.bs/wps/wcm/connect/352d7e24-5fa5-4e57-aacb-951b8720d8a4/Jerome+Fitzgerald-Marathon.jpg?MOD=AJPERES&CACHEID=352d7e24-5fa5-4e57-aacb-951b8720d8a4
group
PLP
constituency
Marathon
island
New Providence
source
http://www.bahamas.gov.bs/wps/portal/public/?1dmy&urile=wcm%3apath%3a/mof_content/internet/ministry+of+education+science+and+technology/government/about+us/minister+of+education+science+and+technology/the+hon.+jerome%2C+fitzgerald
as_of
2017-03-22
name
Arnold Forbes
sort_name
Forbes, Arnold
family_name
Forbes
given_name
Arnold
birth_date
1964-09-05
image
http://www.bahamas.gov.bs/wps/wcm/connect/2e917237-ca64-4bb5-9da3-af786f7e062c/Arnold+Forbes-Mount+Moriah4.jpg?MOD=AJPERES&CACHEID=2e917237-ca64-4bb5-9da3-af786f7e062c
group
PLP
constituency
Mount Moriah
island
New Providence
source
http://www.bahamas.gov.bs/wps/portal/public/?1dmy&urile=wcm%3apath%3a/mof_content/internet/all+contacts/directory+of+contacts/listed+alphabetically/directory/arnold++forbes
as_of
2017-03-22
name
Picewell Forbes
sort_name
Forbes, Picewell
family_name
Forbes
given_name
Picewell
birth_date
1961-08-01
image
http://www.bahamas.gov.bs/wps/wcm/connect/7ea047d1-0acc-4fd6-9e62-523738030a16/PICEWELL+FORBES-+Central+%26+South+Andros4.jpg?MOD=AJPERES&CACHEID=7ea047d1-0acc-4fd6-9e62-523738030a16
group
PLP
constituency
Andros
island
New Providence
source
http://www.bahamas.gov.bs/wps/portal/public/?1dmy&urile=wcm%3apath%3a/mof_content/internet/all+contacts/directory+of+contacts/listed+alphabetically/directory/picewell+forbes
as_of
2017-03-22
name
D. Shane Gibson
sort_name
Gibson, D. Shane
family_name
Gibson
given_name
D. Shane
birth_date
1961-09-07
image
http://www.bahamas.gov.bs/wps/wcm/connect/31e37831-93a3-45de-8497-6d5034ac77bc/Shane+Gibson-Golden+Gates4.jpg?MOD=AJPERES&CACHEID=31e37831-93a3-45de-8497-6d5034ac77bc
group
PLP
constituency
Golden Gates
island
New Providence
source
http://www.bahamas.gov.bs/wps/portal/public/?1dmy&urile=wcm%3apath%3a/mof_content/internet/all+contacts/directory+of+contacts/listed+alphabetically/directory/the+hon.+d.+shane+gibson
as_of
2017-03-22

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (40 KB) Use the API

rows 10 / 39

name area group term
name
Bernard Johnathan Nottage
area
Bains Town and Grants Town
group
PLP
term
2012
name
Renward R. Wells
area
Bamboo Town
group
PLP
term
2012
name
Daniel Mackey D. Johnson
area
Carmichael
group
PLP
term
2012
name
Perry Gladstone Christie
area
Centreville
group
PLP
term
2012
name
Leo Ryan Pinder
area
Elizabeth
group
PLP
term
2012
name
Glenys Margaret Hanna-Martin
area
Englerston
group
PLP
term
2012
name
Sylvester Andre Rollins
area
Fort Charlotte
group
PLP
term
2012
name
Frederick Audley Mitchell
area
Fox Hill
group
PLP
term
2012
name
Kendal Versil O. Major
area
Garden Hills
group
PLP
term
2012
name
David Shane Gibson
area
Golden Gates
group
PLP
term
2012

Statistics

Average successful run time: 4 minutes

Total run time: 3 days

Total cpu time used: 8 minutes

Total disk space used: 69.6 KB

History

  • Manually ran revision 50019840 and failed .
    nothing changed in the database
  • Manually ran revision 50019840 and completed successfully .
    39 records added, 39 records removed in the database
  • Manually ran revision 50019840 and completed successfully .
    73 records added, 73 records removed in the database
  • Manually ran revision 50019840 and completed successfully .
    nothing changed in the database
  • Manually ran revision 50019840 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history