tn2226 / cat_photos

Cat Photos - Example Python Morph.io Scraper with CKAN API upload


cat_photos

Cat Photos - Example Python Morph.io Scraper with CKAN API upload

export MORPH_CKAN_URL='http://data.disclosurelo.gs' export MORPH_CKAN_API_KEY='xxxx-xxxxxx-xxxxx-xxxx-xxxxxxxx'

You can set environment variables for a morph.io scraper run by going to the settings page of the scraper

Contributors maxious mlandauer

Last run completed successfully .

Console output of last run

Data

Downloaded 1 time by smike724

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (8 KB) Use the API

rows 10 / 12

url caption image_url
Cat Standing Up
A Serious Cat
Sleeping on a Keyboard
Cat Brothers
A Fluffy White Cat
Cat and a Trash Can
Five Little Kittens
Computer Cats
Cat Cuddles
Call of the Wild

Statistics

Average successful run time: less than 5 seconds

Total run time: less than 10 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 88.2 KB

History

  • Manually ran revision c9b98339 and completed successfully .
    12 records added, 12 records removed in the database
  • Manually ran revision c9b98339 and completed successfully .
    12 records added in the database
  • Created on morph.io

Scraper code

Python

cat_photos / scraper.py