This is a scraper that runs on Morph. To get started see the documentation

Contributors chrismytton

Last run completed successfully .

Console output of last run

Injecting configuration and compiling...  -----> Ruby app detected -----> Compiling Ruby -----> Using Ruby version: ruby-2.3.4 -----> Installing dependencies using bundler 1.15.2  Running: bundle install --without development:test --path vendor/bundle --binstubs vendor/bundle/bin -j4 --deployment  Warning: the running version of Bundler (1.15.2) is older than the version that created the lockfile (1.16.5). We suggest you upgrade to the latest version of Bundler by running `gem install bundler`.  Fetching gem metadata from https://rubygems.org/......  Fetching version metadata from https://rubygems.org/.  Fetching https://github.com/openaustralia/scraperwiki-ruby.git  Using bundler 1.15.2  Fetching coderay 1.1.3  Fetching connection_pool 2.2.3  Fetching unf_ext 0.0.7.7  Installing connection_pool 2.2.3  Installing coderay 1.1.3  Fetching httpclient 2.8.3  Installing unf_ext 0.0.7.7 with native extensions  Fetching mime-types-data 3.2020.0512  Installing httpclient 2.8.3  Installing mime-types-data 3.2020.0512  Fetching net-http-digest_auth 1.4.1  Fetching mini_portile2 2.4.0  Installing net-http-digest_auth 1.4.1  Installing mini_portile2 2.4.0  Fetching ntlm-http 0.1.1  Fetching webrobots 0.1.2  Installing ntlm-http 0.1.1  Installing webrobots 0.1.2  Fetching method_source 1.0.0  Installing method_source 1.0.0  Fetching sqlite3 1.4.2  Fetching net-http-persistent 4.0.0  Installing net-http-persistent 4.0.0  Installing sqlite3 1.4.2 with native extensions  Fetching mime-types 3.3.1  Installing mime-types 3.3.1  Fetching nokogiri 1.10.10  Installing nokogiri 1.10.10 with native extensions  Fetching pry 0.13.1  Installing pry 0.13.1  Fetching unf 0.1.4  Installing unf 0.1.4  Fetching domain_name 0.5.20190701  Installing domain_name 0.5.20190701  Fetching http-cookie 1.0.3  Installing http-cookie 1.0.3  Fetching sqlite_magic 0.0.6  Installing sqlite_magic 0.0.6  Using scraperwiki 3.0.1 from https://github.com/openaustralia/scraperwiki-ruby.git (at morph_defaults@fc50176)  Fetching mechanize 2.7.6  Installing mechanize 2.7.6  Bundle complete! 3 Gemfile dependencies, 22 gems now installed.  Gems in the groups development and test were not installed.  Bundled gems are installed into ./vendor/bundle.  Bundle completed (25.14s)  Cleaning up the bundler cache. -----> Detecting rake tasks   ###### WARNING:  You have not declared a Ruby version in your Gemfile.  To set your Ruby version add this line to your Gemfile:  ruby '2.3.4'  # See https://devcenter.heroku.com/articles/ruby-versions for more information.   -----> Discovering process types  Procfile declares types -> scraper Injecting scraper and running...

Data

Downloaded 23 times by chrismytton soundsnzuk sichacvah codeitnos aisayev jackemcpherson cecilstclair

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (446 KB) Use the API

rows 10 / 2320

artist album label year reviewer review_date score
John Carpenter
Lost Themes
Sacred Bones
2015
Aaron Leitko
2015-02-05
7.6
Matana Roberts
COIN COIN Chapter Three: river run thee
Constellation
2015
Grayson Haver Currin
2015-02-05
8.2
Noveller
Fantastic Planet
Fire
2015
Colin Joyce
2015-02-05
7.0
Various Artists
Dance Mania: Ghetto Madness
Strut
2015
Meaghan Garvey
2015-02-05
7.4
Dungen
Allas Sak
Mexican Summer
2015
Aaron Leitko
2015-09-22
8.0
Natasha Kmeto
Inevitable
Dropping Gems
2015
Britt Julious
2015-09-22
7.8
Botany
Dimming Awe, the Light Is Raw
Western Vinyl
2015
Eric Torres
2015-09-22
7.2
U.S. Girls
Half Free
4AD
2015
Stuart Berman
2015-09-23
8.0
Fennesz / King Midas Sound
Edition 1
Ninja Tune
2015
Andy Beta
2015-09-23
6.7
Jawbox
Jawbox
Dischord / DeSoto
1996/2015
Brian Howe
2015-09-23
7.6

Statistics

Average successful run time: 1 minute

Total run time: about 1 month

Total cpu time used: 22 minutes

Total disk space used: 475 KB

History

  • Manually ran revision e9e420a0 and completed successfully .
    11 records added in the database
  • Auto ran revision aae60f66 and failed .
    nothing changed in the database
  • Auto ran revision aae60f66 and failed .
    nothing changed in the database
  • Auto ran revision aae60f66 and completed successfully .
    12 records added, 8 records removed in the database
  • Auto ran revision aae60f66 and completed successfully .
    12 records added, 8 records removed in the database
  • ...
  • Created on morph.io

Show complete history

Scraper code

Ruby

pitchfork_scraper / scraper.rb