woodbine / sp_E5048_SLBC_gov

Scrapes www.sutton.gov.uk, drive.google.com, docs.google.com, and 24 other domains

Government, politics and public administration, Sutton Council Home, Sutton Council


Handles nested pages, so two sets of pages, a list page and then a download sub-page.

Contributors woodbine blablupcom

The scraper is running. It was queued automatically .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Data

Downloaded 547 times by SimKennedy MikeRalphson woodbine

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (26 KB) Use the API

rows 10 / 90

Statistics

Average successful run time: 5 minutes

Total run time: 18 days

Total cpu time used: about 4 hours

Total disk space used: 53.8 KB

History

  • Auto ran revision aa43d8d4 and completed successfully .
    84 records added, 84 records removed in the database
    520 pages scraped
  • Auto ran revision aa43d8d4 and completed successfully .
    84 records added, 84 records removed in the database
    520 pages scraped
  • Auto ran revision aa43d8d4 and completed successfully .
    84 records added, 84 records removed in the database
    520 pages scraped
  • Auto ran revision aa43d8d4 and completed successfully .
    84 records added, 84 records removed in the database
    520 pages scraped
  • Auto ran revision aa43d8d4 and completed successfully .
    84 records added, 84 records removed in the database
    520 pages scraped
  • ...
  • Created on morph.io

Show complete history

Scraper code

Python

sp_E5048_SLBC_gov / scraper.py