wfdd / bahamas-parliament-scraper

A scraper for the members of the Bahamian House of Assembly.


A morph.io scraper for the members of the Bahamian House of Assembly.

Contributors wfdd

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling...  -----> Python app detected  ! The latest version of Python 3 is python-3.6.2 (you are using python-3.5.1, which is unsupported).  ! We recommend upgrading by specifying the latest version (python-3.6.2).  Learn More: https://devcenter.heroku.com/articles/python-runtimes -----> Installing python-3.5.1 -----> Installing pip -----> Installing requirements with pip  Collecting lxml==3.6.0 (from -r /tmp/build/requirements.txt (line 1))  Downloading https://files.pythonhosted.org/packages/11/1b/fe6904151b37a0d6da6e60c13583945f8ce3eae8ebd0ec763ce546358947/lxml-3.6.0.tar.gz (3.7MB)  Collecting selenium==2.53.4 (from -r /tmp/build/requirements.txt (line 2))  Downloading https://files.pythonhosted.org/packages/31/55/98b2a3091bb5dedff7ab22651af033be00173df5568a55bd109492cc270c/selenium-2.53.4-py2.py3-none-any.whl (1.1MB)  Collecting splinter==0.7.3 (from -r /tmp/build/requirements.txt (line 3))  Downloading https://files.pythonhosted.org/packages/40/b9/7cac56d0f1f419b11ccf0ce9dcd924abe4b7dd17e2be1eb49862568550b4/splinter-0.7.3.tar.gz  Installing collected packages: lxml, selenium, splinter  Running setup.py install for lxml: started  Running setup.py install for lxml: still running...  Running setup.py install for lxml: finished with status 'done'  Running setup.py install for splinter: started  Running setup.py install for splinter: finished with status 'done'  Successfully installed lxml-3.6.0 selenium-2.53.4 splinter-0.7.3   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Unable to extract birth date from 'born to Wilmore and Shirley Dames (nee Beneby) on the' Traceback (most recent call last): File "scraper.py", line 104, in <module> main() File "scraper.py", line 95, in main ))(dt.date.today().isoformat())) File "scraper.py", line 92, in <genexpr> (lambda date: ((*p, date) File "scraper.py", line 94, in <genexpr> for r in tuple(collect_rows(session))) File "scraper.py", line 49, in scrape_row honorifics, name).split(',')) ValueError: not enough values to unpack (expected 2, got 1)

Data

Downloaded 979 times by everypolitician wfdd chrismytton

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (40 KB) Use the API

rows 10 / 35

name sort_name family_name given_name birth_date image group constituency island source as_of
Hope Strachan
Strachan, Hope
Strachan
Hope
1960-12-01
PLP
Seabreeze
New Providence
2016-08-23
Philip E. Brave Davis
Davis, Philip E. Brave
Davis
Philip E. Brave
1951-06-07
PLP
Cat Island, Rum Cay & San Salvador
Cat Island
2017-03-22
Arnold Forbes
Forbes, Arnold
Forbes
Arnold
1964-09-05
PLP
(None)
2017-03-22
Michael Darville
Darville, Michael
Darville
Michael
PLP
Pineridge
Grand Bahama
2017-03-22
Kenred Dorsett
Dorsett, Kenred
Dorsett
Kenred
1971-02-16
PLP
Southern Shores
New Providence
2017-03-22
Jerome Fitzgerald
Fitzgerald, Jerome
Fitzgerald
Jerome
1966-04-03
PLP
Marathon
New Providence
2017-03-22
Jerome Fitzgerald
Fitzgerald, Jerome
Fitzgerald
Jerome
1966-04-03
PLP
Marathon
New Providence
2017-03-22
Arnold Forbes
Forbes, Arnold
Forbes
Arnold
1964-09-05
PLP
Mount Moriah
New Providence
2017-03-22
Picewell Forbes
Forbes, Picewell
Forbes
Picewell
1961-08-01
PLP
Andros
New Providence
2017-03-22
D. Shane Gibson
Gibson, D. Shane
Gibson
D. Shane
1961-09-07
PLP
Golden Gates
New Providence
2017-03-22

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (40 KB) Use the API

rows 10 / 39

name area group term
Bernard Johnathan Nottage
Bains Town and Grants Town
PLP
2012
Renward R. Wells
Bamboo Town
PLP
2012
Daniel Mackey D. Johnson
Carmichael
PLP
2012
Perry Gladstone Christie
Centreville
PLP
2012
Leo Ryan Pinder
Elizabeth
PLP
2012
Glenys Margaret Hanna-Martin
Englerston
PLP
2012
Sylvester Andre Rollins
Fort Charlotte
PLP
2012
Frederick Audley Mitchell
Fox Hill
PLP
2012
Kendal Versil O. Major
Garden Hills
PLP
2012
David Shane Gibson
Golden Gates
PLP
2012

Statistics

Average successful run time: 4 minutes

Total run time: 3 days

Total cpu time used: 8 minutes

Total disk space used: 69.6 KB

History

  • Manually ran revision 50019840 and failed .
    nothing changed in the database
  • Manually ran revision 50019840 and completed successfully .
    39 records added, 39 records removed in the database
  • Manually ran revision 50019840 and completed successfully .
    73 records added, 73 records removed in the database
  • Manually ran revision 50019840 and completed successfully .
    nothing changed in the database
  • Manually ran revision 50019840 and completed successfully .
    nothing changed in the database
  • ...
  • Created on morph.io

Show complete history