woodbine / sp_MOD017_MOD_gov

README.md

This scraper only works until end of 2015, will need to be updated in 2016

Contributors

Last run completed successfully 2020-01-24.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... MOD017_MOD_gov_2015_12 MOD017_MOD_gov_2015_11 MOD017_MOD_gov_2015_10 MOD017_MOD_gov_2015_09 MOD017_MOD_gov_2015_08 MOD017_MOD_gov_2015_07 MOD017_MOD_gov_2015_06 MOD017_MOD_gov_2015_05 MOD017_MOD_gov_2015_04 MOD017_MOD_gov_2015_03 MOD017_MOD_gov_2015_02 MOD017_MOD_gov_2015_01 MOD017_MOD_gov_2014_12 MOD017_MOD_gov_2014_11 MOD017_MOD_gov_2014_10 MOD017_MOD_gov_2014_09 MOD017_MOD_gov_2014_08 MOD017_MOD_gov_2014_07 MOD017_MOD_gov_2014_06 MOD017_MOD_gov_2014_05 MOD017_MOD_gov_2014_04 MOD017_MOD_gov_2014_03 MOD017_MOD_gov_2014_02 MOD017_MOD_gov_2014_01

Data

Downloaded 810 times by

data

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (14 KB) Use the API

rows 10 / 25

d	l	f
2016-04-29 04:13:16.322190	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/506512/Transparency_File_AP10-25k.csv	MOD017_MOD_gov_2015_12
2020-01-24 18:21:22.289323	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/520377/20160118-Transparency_Dec_15.csv	MOD017_MOD_gov_2015_12
2020-01-24 18:21:24.193166	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/491166/20151221-Transparency_Final_File_Nov_15.csv	MOD017_MOD_gov_2015_11
2020-01-24 18:21:25.858318	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/481251/20151117-Transparency_Oct15_Final_File.csv	MOD017_MOD_gov_2015_10
2020-01-24 18:21:27.575525	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/473121/20151027-Transparency_Sep15_Final_File.csv	MOD017_MOD_gov_2015_09
2020-01-24 18:21:29.263558	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/465238/Transparency_Final_File_Aug_15_New.csv	MOD017_MOD_gov_2015_08
2020-01-24 18:21:30.939285	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/462126/20150909_Transparency_July_2015_Final.csv	MOD017_MOD_gov_2015_07
2020-01-24 18:21:32.639400	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/460583/20150827_TransparencyJune-15_Final_File.csv	MOD017_MOD_gov_2015_06
2020-01-24 18:21:34.327150	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/457315/Transparency_May15.csv	MOD017_MOD_gov_2015_05
2020-01-24 18:21:36.099461	http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/451175/20150713-Transparency_APR_15_for_Review.csv	MOD017_MOD_gov_2015_04

Statistics

Average successful run time: 2 minutes

Total run time: 2 days

Total cpu time used: about 1 hour

Total disk space used: 41.3 KB

History

Auto ran revision 838f3563 and completed successfully 2020-01-24.

run time 47 s

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and completed successfully 2020-01-23.

run time 50 s

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and completed successfully 2020-01-22.

run time 48 s

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and completed successfully 2020-01-21.

run time 49 s

24 records added, 24 records removed in the database
Auto ran revision 838f3563 and completed successfully 2020-01-20.

run time 47 s

24 records added, 24 records removed in the database
...
Created on morph.io 2015-04-12

Show complete history

Scraper code

Python

sp_MOD017_MOD_gov / scraper.py

git clone URL