woodbine / sp_MOD017_MOD_gov

README.md

This scraper only works until end of 2015, will need to be updated in 2016

Contributors

Last run completed successfully 2020-10-28.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... MOD017_MOD_gov_2015_12 MOD017_MOD_gov_2015_11 MOD017_MOD_gov_2015_10 MOD017_MOD_gov_2015_09 MOD017_MOD_gov_2015_08 MOD017_MOD_gov_2015_07 MOD017_MOD_gov_2015_06 MOD017_MOD_gov_2015_05 MOD017_MOD_gov_2015_04 MOD017_MOD_gov_2015_03 MOD017_MOD_gov_2015_02 MOD017_MOD_gov_2015_01 MOD017_MOD_gov_2014_12 MOD017_MOD_gov_2014_11 MOD017_MOD_gov_2014_10 MOD017_MOD_gov_2014_09 MOD017_MOD_gov_2014_08 MOD017_MOD_gov_2014_07 MOD017_MOD_gov_2014_06 MOD017_MOD_gov_2014_05 MOD017_MOD_gov_2014_04 MOD017_MOD_gov_2014_03 MOD017_MOD_gov_2014_02 MOD017_MOD_gov_2014_01

Data

Downloaded 810 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (14 KB) Use the API

rows 10 / 25

d	l	f
2016-04-29 04:13:16.322190	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/506512/Transparency_File_AP10-25k.csv	MOD017_MOD_gov_2015_12
2020-10-28 18:31:47.380500	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/520377/20160118-Transparency_Dec_15.csv	MOD017_MOD_gov_2015_12
2020-10-28 18:31:49.948635	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/491166/20151221-Transparency_Final_File_Nov_15.csv	MOD017_MOD_gov_2015_11
2020-10-28 18:31:52.127038	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/481251/20151117-Transparency_Oct15_Final_File.csv	MOD017_MOD_gov_2015_10
2020-10-28 18:31:54.311097	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/473121/20151027-Transparency_Sep15_Final_File.csv	MOD017_MOD_gov_2015_09
2020-10-28 18:31:56.494275	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/465238/Transparency_Final_File_Aug_15_New.csv	MOD017_MOD_gov_2015_08
2020-10-28 18:31:58.613560	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/462126/20150909_Transparency_July_2015_Final.csv	MOD017_MOD_gov_2015_07
2020-10-28 18:32:00.684213	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/460583/20150827_TransparencyJune-15_Final_File.csv	MOD017_MOD_gov_2015_06
2020-10-28 18:32:02.997988	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/457315/Transparency_May15.csv	MOD017_MOD_gov_2015_05
2020-10-28 18:32:05.199449	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/451175/20150713-Transparency_APR_15_for_Review.csv	MOD017_MOD_gov_2015_04

Statistics

Average successful run time: 2 minutes

Total run time: 2 days

Total cpu time used: about 1 hour

Total disk space used: 41.3 KB

History

Auto ran revision 838f3563 and completed successfully 2020-10-28.

run time 52 s

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and completed successfully 2020-10-27.

run time 51 s

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and completed successfully 2020-10-26.

run time 4 minutes

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and completed successfully 2020-10-25.

run time 3 minutes

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and completed successfully 2020-10-24.

run time 52 s

24 records added, 24 records removed in the database
...
Created on morph.io 2015-04-12

Show complete history

Scraper code

Python

sp_MOD017_MOD_gov / scraper.py

git clone URL