woodbine / sp_MOD017_MOD_gov

Scrapes example.com and www.gov.uk

Example Domain


This scraper only works until end of 2015, will need to be updated in 2016

Contributors woodbine blablupcom

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... MOD017_MOD_gov_2015_12 MOD017_MOD_gov_2015_11 MOD017_MOD_gov_2015_10 MOD017_MOD_gov_2015_09 MOD017_MOD_gov_2015_08 MOD017_MOD_gov_2015_07 MOD017_MOD_gov_2015_06 MOD017_MOD_gov_2015_05 MOD017_MOD_gov_2015_04 MOD017_MOD_gov_2015_03 MOD017_MOD_gov_2015_02 MOD017_MOD_gov_2015_01 MOD017_MOD_gov_2014_12 MOD017_MOD_gov_2014_11 MOD017_MOD_gov_2014_10 MOD017_MOD_gov_2014_09 MOD017_MOD_gov_2014_08 MOD017_MOD_gov_2014_07 MOD017_MOD_gov_2014_06 MOD017_MOD_gov_2014_05 MOD017_MOD_gov_2014_04 MOD017_MOD_gov_2014_03 MOD017_MOD_gov_2014_02 MOD017_MOD_gov_2014_01

Data

Downloaded 529 times by SimKennedy

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (14 KB) Use the API

rows 10 / 25

d l f
2016-04-29 04:13:16.322190
MOD017_MOD_gov_2015_12
2018-02-20 08:44:44.494568
MOD017_MOD_gov_2015_12
2018-02-20 08:44:45.112823
MOD017_MOD_gov_2015_11
2018-02-20 08:44:45.915677
MOD017_MOD_gov_2015_10
2018-02-20 08:44:46.479818
MOD017_MOD_gov_2015_09
2018-02-20 08:44:47.009343
MOD017_MOD_gov_2015_08
2018-02-20 08:44:47.594755
MOD017_MOD_gov_2015_07
2018-02-20 08:44:48.171437
MOD017_MOD_gov_2015_06
2018-02-20 08:44:52.011174
MOD017_MOD_gov_2015_05
2018-02-20 08:44:52.617374
MOD017_MOD_gov_2015_04

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: 28 minutes

Total disk space used: 41.3 KB

History

  • Auto ran revision 838f3563 and completed successfully .
    24 records added, 24 records removed in the database
    51 pages scraped
  • Auto ran revision 838f3563 and completed successfully .
    24 records added, 24 records removed in the database
    51 pages scraped
  • Auto ran revision 838f3563 and failed .
    nothing changed in the database
  • Auto ran revision 838f3563 and completed successfully .
    24 records added, 24 records removed in the database
    51 pages scraped
  • Auto ran revision 838f3563 and completed successfully .
    24 records added, 24 records removed in the database
    51 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

sp_MOD017_MOD_gov / scraper.py