blablupcom / sp_DFT004_DFT_gov

Scrapes data.gov.uk, www.gov.uk, data.dft.gov.uk, and 1 other domain

data.gov.uk


This is a scraper that runs on Morph. To get started see the documentation

Contributors woodbine blablupcom

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... DFT004_DFT_gov_2015_12 DFT004_DFT_gov_2015_11 DFT004_DFT_gov_2015_10 DFT004_DFT_gov_2015_09 DFT004_DFT_gov_2015_08 DFT004_DFT_gov_2015_07 DFT004_DFT_gov_2015_06 DFT004_DFT_gov_2015_05 DFT004_DFT_gov_2015_04 DFT004_DFT_gov_2015_03 DFT004_DFT_gov_2015_02 DFT004_DFT_gov_2015_01 DFT004_DFT_gov_2014_12 DFT004_DFT_gov_2014_11 DFT004_DFT_gov_2014_10 DFT004_DFT_gov_2014_09 DFT004_DFT_gov_2014_08 DFT004_DFT_gov_2014_07 DFT004_DFT_gov_2014_06 DFT004_DFT_gov_2014_05 DFT004_DFT_gov_2014_04 DFT004_DFT_gov_2014_03 DFT004_DFT_gov_2014_02 DFT004_DFT_gov_2014_01 DFT004_DFT_gov_2013_12 DFT004_DFT_gov_2013_11 DFT004_DFT_gov_2013_10 DFT004_DFT_gov_2013_09 DFT004_DFT_gov_2013_08 DFT004_DFT_gov_2013_07 DFT004_DFT_gov_2013_06 DFT004_DFT_gov_2013_05 DFT004_DFT_gov_2013_04 DFT004_DFT_gov_2013_03 DFT004_DFT_gov_2013_02 DFT004_DFT_gov_2013_01 DFT004_DFT_gov_2012_12 DFT004_DFT_gov_2012_11 DFT004_DFT_gov_2012_10 DFT004_DFT_gov_2012_09 DFT004_DFT_gov_2012_08 DFT004_DFT_gov_2012_07 DFT004_DFT_gov_2012_06 DFT004_DFT_gov_2012_05 DFT004_DFT_gov_2012_04 DFT004_DFT_gov_2012_03 DFT004_DFT_gov_2012_02 DFT004_DFT_gov_2012_01 DFT004_DFT_gov_2011_12 DFT004_DFT_gov_2011_11 DFT004_DFT_gov_2011_10 DFT004_DFT_gov_2011_09 DFT004_DFT_gov_2011_08 DFT004_DFT_gov_2011_07 DFT004_DFT_gov_2011_06 DFT004_DFT_gov_2011_05 DFT004_DFT_gov_2011_04 DFT004_DFT_gov_2011_03 DFT004_DFT_gov_2011_02 DFT004_DFT_gov_2011_01 DFT004_DFT_gov_2010_12 DFT004_DFT_gov_2010_11 DFT004_DFT_gov_2010_10 DFT004_DFT_gov_2010_09 DFT004_DFT_gov_2010_08 DFT004_DFT_gov_2010_07 DFT004_DFT_gov_2010_06 DFT004_DFT_gov_2010_05 DFT004_DFT_gov_2010_Q0 DFT004_DFT_gov_2009_Y1

Data

Downloaded 6 times by MikeRalphson randomgitman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (34 KB) Use the API

rows 10 / 70

l d f
2016-10-13 09:52:19.990015
DFT004_DFT_gov_2015_12
2016-10-13 09:52:20.305390
DFT004_DFT_gov_2015_11
2016-10-13 09:52:20.623551
DFT004_DFT_gov_2015_10
2016-10-13 09:52:20.888271
DFT004_DFT_gov_2015_09
2016-10-13 09:52:21.148227
DFT004_DFT_gov_2015_08
2016-10-13 09:52:21.425888
DFT004_DFT_gov_2015_07
2016-10-13 09:52:21.773548
DFT004_DFT_gov_2015_06
2016-10-13 09:52:22.091606
DFT004_DFT_gov_2015_05
2016-10-13 09:52:22.478616
DFT004_DFT_gov_2015_04
2016-10-13 09:52:22.879504
DFT004_DFT_gov_2015_03

Statistics

Average successful run time: 2 minutes

Total run time: 7 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 77.1 KB

History

  • Manually ran revision 1d6712c5 and completed successfully .
    70 records added, 70 records removed in the database
    84 pages scraped
  • Manually ran revision bc358c6b and completed successfully .
    70 records added, 61 records removed in the database
    84 pages scraped
  • Manually ran revision 75cad58b and completed successfully .
    61 records added in the database
    75 pages scraped
  • Created on morph.io

Scraper code

Python

sp_DFT004_DFT_gov / scraper.py