masterofpun / r_datasets

Data of all posts on r/datasets

Scrapes www.reddit.com

reddit: the front page of the internet


This is a scraper that runs on Morph. To get started see the documentation

Contributors masterofpun

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Python app detected -----> Installing python-3.5.1  $ pip install -r requirements.txt  Collecting requests==2.10.0 (from -r requirements.txt (line 8))  Downloading requests-2.10.0-py2.py3-none-any.whl (506kB)  Installing collected packages: requests  Successfully installed requests-2.10.0   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running... ('51k3y8',)

Data

Downloaded 14 times by masterofpun franc00018 whenamanlies talperetz guyscriven nhrs marcschonwandt

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (2.21 MB) Use the API

rows 10 / 4079

created_utc author domain num_comments score title id is_self url selftext
1255017488
antitheftdevice
nyc.gov
0
5
New York City Data Mine - 170 datasets from 30 agencies
9s3dg
false
1255017624
antitheftdevice
ratedata.gaincapital.com
0
3
Forex Historic Rate Data from 2000 to present
9s3em
false
1255044577
antitheftdevice
free-zipcodes.com
1
4
Zip Code Database
9s7vp
false
1255092512
antitheftdevice
cs.cmu.edu
0
7
Enron Email Dataset
9sej9
false
1255353085
antitheftdevice
archive.ics.uci.edu
0
4
Poker Hand Data Set
9t7yp
false
1270446815
draicone
grouplens.org
0
6
MovieLens Data Sets
bmiqi
false
1270448213
draicone
blog.orite.com.au
0
3
Australian postcodes with geocoding
bmiyt
false
1270449054
draicone
musicbrainz.org
0
17
MusicBrainz database - artists, releases, tracks, labels, incl. relationships
bmj4p
false
1270449675
draicone
guardian.co.uk
0
5
The Guardian's data store - large collection of datasets on topics like banks, UK elections, government borrowing, primary school league tables...
bmj8u
false
1270450644
voltagex
data.gov
0
20
US Data.gov datasets
bmjfd
false

Statistics

Average successful run time: less than a minute

Total run time: about 18 hours

Total cpu time used: 1 minute

Total disk space used: 2.26 MB

History

  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    2 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    15 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    6837 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran and failed .
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    172 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    80 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    4 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    569341 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    3 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    6 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    6 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    4 records added in the database
  • Auto ran revision 8419e722 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    6 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    5 records added in the database
    34 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    4 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    5 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    1 record added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    5 records added in the database
    72 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    23 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 8419e722 and completed successfully .
    nothing changed in the database
    3 pages scraped
  • Auto ran revision 8419e722 and failed .
  • Auto ran revision 8419e722 and completed successfully .
    4 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    2 records added in the database
    18 pages scraped
  • Auto ran revision 8419e722 and completed successfully .
    3 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    4 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    1 record added in the database
    2 pages scraped
  • Manually ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 8419e722 and completed successfully .
    12 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    2 records added in the database
  • Auto ran revision 8419e722 and completed successfully .
    2 records added in the database
    1 page scraped
  • Manually ran revision 8419e722 and completed successfully .
    2 records added in the database
    1 page scraped
  • Auto ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 8419e722 and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 8419e722 and completed successfully .
    3978 records added in the database
    2 pages scraped
  • Manually ran revision 8419e722 and completed successfully .
    5 records added in the database
    1 page scraped
  • Manually ran revision 6c2949dc and failed .
    3973 records added in the database
    1 page scraped
  • Manually ran revision 89ca8b8f and completed successfully .
    5 records added in the database
    1 page scraped
  • Manually ran revision 89ca8b8f and failed .
    5 records added in the database
    1 page scraped
  • Manually ran revision 64fea30d and completed successfully .
    5 records added in the database
    1 page scraped
  • Manually ran revision b242af43 and completed successfully .
    5 records added in the database
    1 page scraped
  • Manually ran revision d423be8d and completed successfully .
    5 records added in the database
    1 page scraped
  • Manually ran revision d423be8d and completed successfully .
    5 records added in the database
    1 page scraped
  • Manually ran revision d423be8d and completed successfully .
    3975 records added in the database
    2 pages scraped
  • Manually ran revision d423be8d and failed .
    nothing changed in the database
  • Auto ran revision b63ac07d and completed successfully .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 8772d80e and completed successfully .
    3973 records added in the database
    2 pages scraped
  • Created on morph.io

Scraper code

Python

r_datasets / scraper.py