DemocracyClub / womblr

Underground, overground, wombling free


Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.4.3  $ pip install -r requirements.txt  Collecting git+https://github.com/polling-bot-4000/polling-bot.git (from -r /tmp/build/requirements.txt (line 4))  Cloning https://github.com/polling-bot-4000/polling-bot.git to /tmp/pip-plr9dikc-build  Collecting python-dateutil (from -r /tmp/build/requirements.txt (line 1))  Downloading python_dateutil-2.6.1-py2.py3-none-any.whl (194kB)  Collecting requests (from -r /tmp/build/requirements.txt (line 2))  Downloading requests-2.18.4-py2.py3-none-any.whl (88kB)  Collecting scraperwiki==0.5.1 (from -r /tmp/build/requirements.txt (line 3))  Downloading scraperwiki-0.5.1.tar.gz  Collecting six>=1.5 (from python-dateutil->-r /tmp/build/requirements.txt (line 1))  Downloading six-1.11.0-py2.py3-none-any.whl  Collecting urllib3<1.23,>=1.21.1 (from requests->-r /tmp/build/requirements.txt (line 2))  Downloading urllib3-1.22-py2.py3-none-any.whl (132kB)  Collecting idna<2.7,>=2.5 (from requests->-r /tmp/build/requirements.txt (line 2))  Downloading idna-2.6-py2.py3-none-any.whl (56kB)  Collecting certifi>=2017.4.17 (from requests->-r /tmp/build/requirements.txt (line 2))  Downloading certifi-2017.7.27.1-py2.py3-none-any.whl (349kB)  Collecting chardet<3.1.0,>=3.0.2 (from requests->-r /tmp/build/requirements.txt (line 2))  Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB)  Collecting sqlalchemy (from scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 3))  Downloading SQLAlchemy-1.1.14.tar.gz (5.2MB)  Collecting alembic (from scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 3))  Downloading alembic-0.9.6.tar.gz (998kB)  Collecting Mako (from alembic->scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 3))  Downloading Mako-1.0.7.tar.gz (564kB)  Collecting python-editor>=0.3 (from alembic->scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 3))  Downloading python-editor-1.0.3.tar.gz  Collecting MarkupSafe>=0.9.2 (from Mako->alembic->scraperwiki==0.5.1->-r /tmp/build/requirements.txt (line 3))  Downloading MarkupSafe-1.0.tar.gz  Installing collected packages: six, python-dateutil, urllib3, idna, certifi, chardet, requests, sqlalchemy, MarkupSafe, Mako, python-editor, alembic, scraperwiki, polling-bot  Running setup.py install for sqlalchemy: started  Running setup.py install for sqlalchemy: finished with status 'done'  Running setup.py install for MarkupSafe: started  Running setup.py install for MarkupSafe: finished with status 'done'  Running setup.py install for Mako: started  Running setup.py install for Mako: finished with status 'done'  Running setup.py install for python-editor: started  Running setup.py install for python-editor: finished with status 'done'  Running setup.py install for alembic: started  Running setup.py install for alembic: finished with status 'done'  Running setup.py install for scraperwiki: started  Running setup.py install for scraperwiki: finished with status 'done'  Running setup.py install for polling-bot: started  Running setup.py install for polling-bot: finished with status 'done'  Successfully installed Mako-1.0.7 MarkupSafe-1.0 alembic-0.9.6 certifi-2017.7.27.1 chardet-3.0.4 idna-2.6 polling-bot-0.0.0 python-dateutil-2.6.1 python-editor-1.0.3 requests-2.18.4 scraperwiki-0.5.1 six-1.11.0 sqlalchemy-1.1.14 urllib3-1.22   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... Nothing to do today, but here's the results from the last run.. ===== :rotating_light: *Elections happening in the next month* :alarm_clock: 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.city-of-lincoln.2017-10-19/post/DIW:E05010787|City of Lincoln local election - Carholme>. known candidates: 4 :lock: 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.epping-forest.2017-10-19/post/DIW:E05004167|Epping Forest local election - Lower Sheering>. known candidates: 2 :lock: 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.gravesham.2017-10-19/post/DIW:E05004969|Gravesham local election - Meopham North>. known candidates: 4 :lock: 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.hartlepool.2017-10-19/constituencies|Hartlepool local election>. known candidates: 0 :womble: required 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.nottingham.2017-10-19/post/UTW:E05001826|Nottingham local election - Bestwood>. known candidates: 6 :lock: 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.south-oxfordshire.2017-10-19/constituencies|South Oxfordshire local election>. known candidates: 0 :womble: required 19/10/2017: <https://candidates.democracyclub.org.uk/election/local.wigan.2017-10-19/post/MTW:E05000843|Wigan local election - Astley Mosley Common>. known candidates: 5 :lock: 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.charnwood.2017-10-26/constituencies|Charnwood local election>. known candidates: 0 :womble: required 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.derbyshire-dales.2017-10-26/constituencies|Derbyshire Dales local election>. known candidates: 0 :womble: required 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.herefordshire.2017-10-26/constituencies|Herefordshire local election>. known candidates: 0 :womble: required 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.kirklees.2017-10-26/post/MTW:E05001390|Kirklees local election - Batley East>. known candidates: 5 :lock: 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.mid-sussex.2017-10-26/constituencies|Mid Sussex local election>. known candidates: 0 :womble: required 26/10/2017: <https://candidates.democracyclub.org.uk/election/local.tameside.2017-10-26/constituencies|Tameside local election>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.arun.2017-11-02/constituencies|Arun local election>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.buckinghamshire.2017-11-02/constituencies|Buckinghamshire local election>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.copeland.2017-11-02/constituencies|Copeland Borough Council>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.north-devon.2017-11-02/constituencies|North Devon local election>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.sefton.2017-11-02/constituencies|Sefton local election>. known candidates: 0 :womble: required 02/11/2017: <https://candidates.democracyclub.org.uk/election/local.south-bucks.2017-11-02/constituencies|South Bucks local election>. known candidates: 0 :womble: required 09/11/2017: <https://candidates.democracyclub.org.uk/election/local.camden.2017-11-09/constituencies|Camden local election>. known candidates: 0 :womble: required 09/11/2017: <https://candidates.democracyclub.org.uk/election/local.fareham.2017-11-09/constituencies|Fareham local election>. known candidates: 0 :womble: required 09/11/2017: <https://candidates.democracyclub.org.uk/election/local.flintshire.2017-11-09/constituencies|Flintshire local election>. known candidates: 0 :womble: required 09/11/2017: <https://candidates.democracyclub.org.uk/election/local.wandsworth.2017-11-09/constituencies|Wandsworth local election>. known candidates: 0 :womble: required 16/11/2017: <https://candidates.democracyclub.org.uk/election/local.west-lindsey.2017-11-16/constituencies|West Lindsey local election>. known candidates: 0 :womble: required

Data

Downloaded 0 times

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (74 KB) Use the API

rows 10 / 238

name timestamp known_candidates url id poll_open_date locked post_id
Babergh local election
2017-08-18T15:30:53+00:00
0
local.babergh.2017-09-07
2017-09-07
Cannock Chase local election
2017-08-18T15:30:53+00:00
0
local.cannock-chase.2017-09-07
2017-09-07
Colchester local election
2017-08-18T15:30:53+00:00
0
local.colchester.2017-09-07
2017-09-07
Croydon local election
2017-08-18T15:30:53+00:00
0
local.croydon.2017-09-07
2017-09-07
East Cambridgeshire local election
2017-08-18T15:30:53+00:00
0
local.east-cambridgeshire.2017-09-07
2017-09-07
Glasgow City local election
2017-08-18T15:30:53+00:00
0
local.glasgow-city.2017-09-07
2017-09-07
Herefordshire local election
2017-08-18T15:30:53+00:00
0
local.herefordshire.2017-09-07
2017-09-07
Lancaster local election
2017-08-18T15:30:53+00:00
0
local.lancaster.2017-09-07
2017-09-07
Lewes local election
2017-08-18T15:30:53+00:00
0
local.lewes.2017-09-07
2017-09-07
Mid Devon local election
2017-08-18T15:30:53+00:00
0
local.mid-devon.2017-09-14
2017-09-14

Statistics

Average successful run time: 1 minute

Total run time: about 1 hour

Total cpu time used: less than a minute

Total disk space used: 107 KB

History

  • Auto ran revision 346240d5 and completed successfully .
    nothing changed in the database
  • Auto ran revision 346240d5 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8512ddd8 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8512ddd8 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8512ddd8 and completed successfully .
    24 records added in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

womblr