woodbine / sp_MOD017_MOD_gov

README.md

This scraper only works until end of 2015, will need to be updated in 2016

Contributors

Last run completed successfully 2019-12-05.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... MOD017_MOD_gov_2015_12 MOD017_MOD_gov_2015_11 MOD017_MOD_gov_2015_10 MOD017_MOD_gov_2015_09 MOD017_MOD_gov_2015_08 MOD017_MOD_gov_2015_07 MOD017_MOD_gov_2015_06 MOD017_MOD_gov_2015_05 MOD017_MOD_gov_2015_04 MOD017_MOD_gov_2015_03 MOD017_MOD_gov_2015_02 MOD017_MOD_gov_2015_01 MOD017_MOD_gov_2014_12 MOD017_MOD_gov_2014_11 MOD017_MOD_gov_2014_10 MOD017_MOD_gov_2014_09 MOD017_MOD_gov_2014_08 MOD017_MOD_gov_2014_07 MOD017_MOD_gov_2014_06 MOD017_MOD_gov_2014_05 MOD017_MOD_gov_2014_04 MOD017_MOD_gov_2014_03 MOD017_MOD_gov_2014_02 MOD017_MOD_gov_2014_01

Data

Downloaded 810 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (14 KB) Use the API

rows 10 / 25

d	l	f
2016-04-29 04:13:16.322190	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/506512/Transparency_File_AP10-25k.csv	MOD017_MOD_gov_2015_12
2019-12-05 09:20:53.821515	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/520377/20160118-Transparency_Dec_15.csv	MOD017_MOD_gov_2015_12
2019-12-05 09:20:54.640267	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/491166/20151221-Transparency_Final_File_Nov_15.csv	MOD017_MOD_gov_2015_11
2019-12-05 09:20:54.912982	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/481251/20151117-Transparency_Oct15_Final_File.csv	MOD017_MOD_gov_2015_10
2019-12-05 09:20:55.793817	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/473121/20151027-Transparency_Sep15_Final_File.csv	MOD017_MOD_gov_2015_09
2019-12-05 09:20:56.545386	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/465238/Transparency_Final_File_Aug_15_New.csv	MOD017_MOD_gov_2015_08
2019-12-05 09:20:56.796822	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/462126/20150909_Transparency_July_2015_Final.csv	MOD017_MOD_gov_2015_07
2019-12-05 09:20:57.035900	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/460583/20150827_TransparencyJune-15_Final_File.csv	MOD017_MOD_gov_2015_06
2019-12-05 09:20:57.745296	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/457315/Transparency_May15.csv	MOD017_MOD_gov_2015_05
2019-12-05 09:20:58.005933	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/451175/20150713-Transparency_APR_15_for_Review.csv	MOD017_MOD_gov_2015_04

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: about 1 hour

Total disk space used: 41.3 KB

History

Auto ran revision 838f3563 and completed successfully 2019-12-05.

run time 19 s

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and failed 2019-12-04.

run time 35 s

23 records added, 23 records removed in the database
Auto ran revision 838f3563 and completed successfully 2019-12-03.

run time 25 s

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and completed successfully 2019-12-02.

run time 14 s

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and completed successfully 2019-12-01.

run time 30 s

24 records added, 24 records removed in the database
...
Created on morph.io 2015-04-12

Show complete history

Scraper code

Python

sp_MOD017_MOD_gov / scraper.py

git clone URL