woodbine / sp_MOD017_MOD_gov

Scrapes www.gov.uk and assets.publishing.service.gov.uk

GOV.UK - The place to find government services and information - Simpler, clearer, faster


This scraper only works until end of 2015, will need to be updated in 2016

Contributors woodbine blablupcom

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... MOD017_MOD_gov_2015_12 MOD017_MOD_gov_2015_11 MOD017_MOD_gov_2015_10 MOD017_MOD_gov_2015_09 MOD017_MOD_gov_2015_08 MOD017_MOD_gov_2015_07 MOD017_MOD_gov_2015_06 MOD017_MOD_gov_2015_05 MOD017_MOD_gov_2015_04 MOD017_MOD_gov_2015_03 MOD017_MOD_gov_2015_02 MOD017_MOD_gov_2015_01 MOD017_MOD_gov_2014_12 MOD017_MOD_gov_2014_11 MOD017_MOD_gov_2014_10 MOD017_MOD_gov_2014_09 MOD017_MOD_gov_2014_08 MOD017_MOD_gov_2014_07 MOD017_MOD_gov_2014_06 MOD017_MOD_gov_2014_05 MOD017_MOD_gov_2014_04 MOD017_MOD_gov_2014_03 MOD017_MOD_gov_2014_02 MOD017_MOD_gov_2014_01

Data

Downloaded 543 times by SimKennedy

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (14 KB) Use the API

rows 10 / 25

d l f
2016-04-29 04:13:16.322190
MOD017_MOD_gov_2015_12
2018-07-18 17:15:52.717895
MOD017_MOD_gov_2015_12
2018-07-18 17:15:54.390235
MOD017_MOD_gov_2015_11
2018-07-18 17:15:56.125864
MOD017_MOD_gov_2015_10
2018-07-18 17:15:58.511467
MOD017_MOD_gov_2015_09
2018-07-18 17:16:00.244700
MOD017_MOD_gov_2015_08
2018-07-18 17:16:02.173866
MOD017_MOD_gov_2015_07
2018-07-18 17:16:04.191219
MOD017_MOD_gov_2015_06
2018-07-18 17:16:08.821625
MOD017_MOD_gov_2015_05
2018-07-18 17:16:10.531367
MOD017_MOD_gov_2015_04

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: 40 minutes

Total disk space used: 41.3 KB

History

  • Auto ran revision 838f3563 and completed successfully .
    24 records added, 24 records removed in the database
    74 pages scraped
  • Auto ran revision 838f3563 and completed successfully .
    24 records added, 24 records removed in the database
    75 pages scraped
  • Auto ran revision 838f3563 and completed successfully .
    24 records added, 24 records removed in the database
    75 pages scraped
  • Auto ran revision 838f3563 and completed successfully .
    24 records added, 24 records removed in the database
    75 pages scraped
  • Auto ran revision 838f3563 and completed successfully .
    24 records added, 24 records removed in the database
    75 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

sp_MOD017_MOD_gov / scraper.py