woodbine / sp_DID030_DFID_gov

Scrapes www.gov.uk

GOV.UK - The place to find government services and information - Simpler, clearer, faster

README.md

This is a scraper that runs on Morph. To get started see the documentation

Contributors woodbine blablupcom

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 546 times by SimKennedy woodbine

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (48 KB) Use the API

rows 10 / 144

d l f
2016-09-20 12:23:16.653265
http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/534632/may-2016.csv
DID030_DFID_gov_2016_05
2016-11-12 16:19:15.140685
http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/567459/September-2016.csv
DID030_DFID_gov_2016_09
2016-11-12 16:19:17.581674
http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/557758/August-2016.csv
DID030_DFID_gov_2016_08
2016-11-12 16:19:19.586816
http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/550772/July-2016.csv
DID030_DFID_gov_2016_07
2016-11-12 16:19:21.267075
http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/543775/june-2016.csv
DID030_DFID_gov_2016_06
2016-11-12 16:19:23.028253
http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/554518/may-2016a.csv
DID030_DFID_gov_2016_05
2016-11-12 16:19:24.979036
http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/527269/April2016.csv
DID030_DFID_gov_2016_04
2016-11-12 16:19:25.530556
http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/520794/March2016.csv
DID030_DFID_gov_2016_03
2016-11-12 16:19:27.406725
http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/514188/February_2016.csv
DID030_DFID_gov_2016_02
2016-11-12 16:19:29.214959
http://www.gov.uk/government/uploads/system/uploads/attachment_data/file/505275/January2016.csv
DID030_DFID_gov_2016_01

Statistics

Average successful run time: 2 minutes

Total run time: 1 day

Total cpu time used: about 1 hour

Total disk space used: 76.3 KB

History

  • Auto ran revision 03be1319 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 03be1319 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 03be1319 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 03be1319 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 03be1319 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

sp_DID030_DFID_gov / scraper.py