morph-test-scrapers / okfn_test

This is a test scraper for OKFN.

Scrapes foo.com and www.foo.com

Foo.com


This is a scraper that runs on Morph. To get started see the documentation

Contributors henare

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... nil

Data

Downloaded 4 times by henare MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (3 KB) Use the API

rows 1 / 1

name occupation
susan
software developer

Statistics

Average successful run time: half a minute

Total run time: about 1 hour

Total cpu time used: 2 minutes

Total disk space used: 24.1 KB

History

  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    5 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    6 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    5 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    3 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    1 page scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    6 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    3 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Auto ran revision 9591a311 and completed successfully .
    1 record added, 1 record removed in the database
    2 pages scraped
  • Manually ran revision 9591a311 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Created on morph.io

Scraper code

Ruby

okfn_test / scraper.rb