scottbw / ukrlp_1

UKRLP

Scrapes www.ukrlp.co.uk

Welcome to the UKRLP web site: A registry of learning providers and provide access to provider details for all stakeholders in the UK.


ScraperWiki PHP libraries

This directory contains miscellaneous PHP libraries which ScraperWiki Classic used, and which aren't packaged in PECL or PEAR. It's checked out and added to the include_path on new ScraperWiki.

You can just use it like this:

php require 'simple_html_dom.php' require 'excel_reader2.php'

The symlinks, for example to simple_html_dom.php, in scraperwiki/ are for backwards compatibility with ScraperWiki Classic scrapers.

API reference:

scraperwiki::scrape($url)

Scrape a given $url and return the response content as a string.

scraperwiki::savesqlite($uniquekeys, $data, [$table_name])

Save data into a SQLite database (created automatically in the background).

$unique_keys (required) should be an array() of one or more column names.

$data (required) should either be a single row to save (as an array() of strings and/or numbers), or a list of multiple rows to save in one go (as an array() of array()s)

$table_name is optional. If unspecified, the default of "swdata" will be used. You can pass any string you like here to save your data into a new table name.

scraperwiki:save_var($name, $value)

Save a given variable $name with a given $value to the datastore.

scraperwiki:get_var($name, [$default])

Retrieve a given variable $name from the datastore.

If you pass an optional $default value, this will be returned in the case that the given variable $name could not be found in the datastore.

Contributors RedFoxBot scottbw

Last run completed successfully .

Console output of last run

Injecting configuration and compiling... Injecting scraper and running...

Statistics

Average successful run time: 31 minutes

Total run time: about 1 hour

Total cpu time used: 3 minutes

Total disk space used: 690 KB

History

  • Manually ran revision cbd8804d and completed successfully .
    nothing changed in the database
    2000 pages scraped
  • Manually ran revision 7effe9aa and failed .
    nothing changed in the database
  • Manually ran revision ce6e67da and completed successfully .
    nothing changed in the database
    2000 pages scraped
  • Manually ran revision ae6df56c and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 1d3a3c4f and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 49bf0c00 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 6983c191 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 41ff9fa7 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 5f0f96e8 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision d5c23c75 and failed .
    nothing changed in the database
  • Manually ran revision 39f1853d and failed .
    nothing changed in the database
  • Manually ran revision 8592887f and failed .
    nothing changed in the database
  • Manually ran revision 9cd6824a and failed .
    nothing changed in the database
  • Manually ran revision 73ab8677 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision f6512821 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 6806433e and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision 7de59930 and failed .
    nothing changed in the database
    2 pages scraped
  • Created on morph.io

Scraper code

PHP

ukrlp_1 / scraper.php