This is a scraper that runs on Morph. To get started see the documentation

Contributors woodbine blablupcom

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... DFT004_DFT_gov_2016_12 DFT004_DFT_gov_2016_11 DFT004_DFT_gov_2016_10 DFT004_DFT_gov_2016_09 DFT004_DFT_gov_2016_08 DFT004_DFT_gov_2016_07 DFT004_DFT_gov_2016_06 DFT004_DFT_gov_2016_05 DFT004_DFT_gov_2016_04 DFT004_DFT_gov_2016_03 DFT004_DFT_gov_2016_02 DFT004_DFT_gov_2016_01 DFT004_DFT_gov_2015_12 DFT004_DFT_gov_2015_11 DFT004_DFT_gov_2015_10 DFT004_DFT_gov_2015_09 DFT004_DFT_gov_2015_08 DFT004_DFT_gov_2015_07 DFT004_DFT_gov_2015_06 DFT004_DFT_gov_2015_05 DFT004_DFT_gov_2015_04 DFT004_DFT_gov_2015_03 DFT004_DFT_gov_2015_02 DFT004_DFT_gov_2015_01 DFT004_DFT_gov_2014_12 DFT004_DFT_gov_2014_11 DFT004_DFT_gov_2014_10 DFT004_DFT_gov_2014_09 DFT004_DFT_gov_2014_08 DFT004_DFT_gov_2014_07 DFT004_DFT_gov_2014_06 DFT004_DFT_gov_2014_05 DFT004_DFT_gov_2014_04 DFT004_DFT_gov_2014_03 DFT004_DFT_gov_2014_02 DFT004_DFT_gov_2014_01 DFT004_DFT_gov_2013_12 DFT004_DFT_gov_2013_11 DFT004_DFT_gov_2013_10 DFT004_DFT_gov_2013_09 DFT004_DFT_gov_2013_08 DFT004_DFT_gov_2013_07 DFT004_DFT_gov_2013_06 DFT004_DFT_gov_2013_05 DFT004_DFT_gov_2013_04 DFT004_DFT_gov_2013_03 DFT004_DFT_gov_2013_02 DFT004_DFT_gov_2013_01 DFT004_DFT_gov_2012_12 DFT004_DFT_gov_2012_11 DFT004_DFT_gov_2012_10 DFT004_DFT_gov_2012_09 DFT004_DFT_gov_2012_08 DFT004_DFT_gov_2012_07 DFT004_DFT_gov_2012_06 DFT004_DFT_gov_2012_05 DFT004_DFT_gov_2012_04 DFT004_DFT_gov_2012_03 DFT004_DFT_gov_2012_02 DFT004_DFT_gov_2012_01 DFT004_DFT_gov_2011_12 DFT004_DFT_gov_2011_11 DFT004_DFT_gov_2011_10 DFT004_DFT_gov_2011_09 DFT004_DFT_gov_2011_08 DFT004_DFT_gov_2011_07 DFT004_DFT_gov_2011_06 DFT004_DFT_gov_2011_05 DFT004_DFT_gov_2011_04 DFT004_DFT_gov_2011_03 DFT004_DFT_gov_2011_02 DFT004_DFT_gov_2011_01 DFT004_DFT_gov_2010_12 DFT004_DFT_gov_2010_11 DFT004_DFT_gov_2010_10 DFT004_DFT_gov_2010_09 DFT004_DFT_gov_2010_08 DFT004_DFT_gov_2010_07 DFT004_DFT_gov_2010_06 DFT004_DFT_gov_2010_05 DFT004_DFT_gov_2010_Q0 DFT004_DFT_gov_2009_Y1

Data

Downloaded 6 times by MikeRalphson randomgitman

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (41 KB) Use the API

rows 10 / 82

d f l
2017-04-13 20:36:14.617135
DFT004_DFT_gov_2016_12
2017-04-13 20:36:14.827266
DFT004_DFT_gov_2016_11
2017-04-13 20:36:17.404636
DFT004_DFT_gov_2016_10
2017-04-13 20:36:18.579504
DFT004_DFT_gov_2016_09
2017-04-13 20:36:18.780102
DFT004_DFT_gov_2016_08
2017-04-13 20:36:22.696691
DFT004_DFT_gov_2016_07
2017-04-13 20:36:22.917893
DFT004_DFT_gov_2016_06
2017-04-13 20:36:23.203557
DFT004_DFT_gov_2016_05
2017-04-13 20:36:23.419834
DFT004_DFT_gov_2016_04
2017-04-13 20:36:23.639669
DFT004_DFT_gov_2016_03

Statistics

Average successful run time: 2 minutes

Total run time: 9 minutes

Total cpu time used: less than 20 seconds

Total disk space used: 89.1 KB

History

  • Manually ran revision 5c022500 and completed successfully .
    82 records added in the database
  • Manually ran revision 9f2d7732 and failed .
    nothing changed in the database
  • Manually ran revision 1d6712c5 and completed successfully .
    70 records added, 70 records removed in the database
    84 pages scraped
  • Manually ran revision bc358c6b and completed successfully .
    70 records added, 61 records removed in the database
    84 pages scraped
  • Manually ran revision 75cad58b and completed successfully .
    61 records added in the database
    75 pages scraped
  • Created on morph.io

Scraper code

Python

sp_DFT004_DFT_gov / scraper.py