tn2226 / cat_photos

Cat Photos - Example Python Morph.io Scraper with CKAN API upload

README.md

cat_photos

Cat Photos - Example Python Morph.io Scraper with CKAN API upload

export MORPH_CKAN_URL='http://data.disclosurelo.gs' export MORPH_CKAN_API_KEY='xxxx-xxxxxx-xxxxx-xxxx-xxxxxxxx'

You can set environment variables for a morph.io scraper run by going to the settings page of the scraper

Contributors maxious mlandauer

Last run completed successfully .

Console output of last run

Data

Downloaded 1 time by smike724

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (8 KB) Use the API

rows 10 / 12

url caption image_url
http://www.catphotos.org/cat-standing-up/
Cat Standing Up
http://www.catphotos.org/wp-content/themes/CatPhotos/thumb.php?src=wp-content/uploads/2013/02/cat-standing.jpg&w=300&h=200&zc=1&q=100
http://www.catphotos.org/a-serious-cat/
A Serious Cat
http://www.catphotos.org/wp-content/themes/CatPhotos/thumb.php?src=wp-content/uploads/2013/02/a-serious-1024x768.jpg&w=300&h=200&zc=1&q=100
http://www.catphotos.org/sleeping-on-a-keyboard/
Sleeping on a Keyboard
http://www.catphotos.org/wp-content/themes/CatPhotos/thumb.php?src=wp-content/uploads/2013/02/break-1024x768.jpg&w=300&h=200&zc=1&q=100
http://www.catphotos.org/cat-brothers/
Cat Brothers
http://www.catphotos.org/wp-content/themes/CatPhotos/thumb.php?src=wp-content/uploads/2013/02/cats_brothers.jpg&w=300&h=200&zc=1&q=100
http://www.catphotos.org/a-fluffy-white-cat/
A Fluffy White Cat
http://www.catphotos.org/wp-content/themes/CatPhotos/thumb.php?src=wp-content/uploads/2013/02/white-cat-1-1024x768.jpg&w=300&h=200&zc=1&q=100
http://www.catphotos.org/cat-and-a-trash-can/
Cat and a Trash Can
http://www.catphotos.org/wp-content/themes/CatPhotos/thumb.php?src=wp-content/uploads/2013/02/garbage-cat.jpg&w=300&h=200&zc=1&q=100
http://www.catphotos.org/five-little-kittens/
Five Little Kittens
http://www.catphotos.org/wp-content/themes/CatPhotos/thumb.php?src=wp-content/uploads/2013/02/party-of-kittens.jpg&w=300&h=200&zc=1&q=100
http://www.catphotos.org/computer-cats/
Computer Cats
http://www.catphotos.org/wp-content/themes/CatPhotos/thumb.php?src=wp-content/uploads/2013/02/computer-kittens.jpg&w=300&h=200&zc=1&q=100
http://www.catphotos.org/cat-cuddles/
Cat Cuddles
http://www.catphotos.org/wp-content/themes/CatPhotos/thumb.php?src=wp-content/uploads/2012/11/IMG_0481-1024x768.jpg&w=300&h=200&zc=1&q=100
http://www.catphotos.org/call-of-the-wild/
Call of the Wild
http://www.catphotos.org/wp-content/themes/CatPhotos/thumb.php?src=wp-content/uploads/2013/01/image-1024x576.jpg&w=300&h=200&zc=1&q=100

Statistics

Average successful run time: less than 5 seconds

Total run time: less than 10 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 89.5 KB

History

  • Manually ran revision c9b98339 and completed successfully .
    12 records added, 12 records removed in the database
  • Manually ran revision c9b98339 and completed successfully .
    12 records added in the database
  • Created on morph.io

Scraper code

Python

cat_photos / scraper.py