birolabs / crunchbase-a

crunchbase-a

Scrapes www.crunchbase.com


Contributors paulpatrick

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/bundle/ruby/1.9.1/gems/httpclient-2.2.4/lib/httpclient.rb:948:in `follow_redirect': unexpected response: #<HTTP::Message::Headers:0x00000001272b70 @http_version="1.1", @body_size=0, @chunked=false, @request_method=nil, @request_uri=nil, @request_query=nil, @request_absolute_uri=nil, @status_code=416, @reason_phrase="Requested Range Not Satisfiable", @body_type=nil, @body_charset=nil, @body_date=nil, @body_encoding=#<Encoding:ASCII-8BIT>, @is_request=false, @header_item=[["Server", "nginx"], ["Date", "Mon, 14 Mar 2016 22:12:39 GMT"], ["Content-Type", "text/html"], ["Connection", "keep-alive"], ["Vary", "Accept-Encoding"], ["Content-Length", "4270"]], @dumped=false> (HTTPClient::BadResponseError) from /app/vendor/bundle/ruby/1.9.1/gems/httpclient-2.2.4/lib/httpclient.rb:580:in `get_content' from /app/vendor/bundle/ruby/1.9.1/bundler/gems/scraperwiki-ruby-fc5017681250/lib/scraperwiki.rb:35:in `scrape' from scraper.rb:28:in `initialize' from scraper.rb:89:in `new' from scraper.rb:89:in `block in <main>' from scraper.rb:88:in `upto' from scraper.rb:88:in `each' from scraper.rb:88:in `<main>'

Statistics

Total run time: half a minute

Total cpu time used: less than 5 seconds

Total disk space used: 20 KB

History

  • Manually ran revision 7b22cd5e and failed .
    nothing changed in the database
    1 page scraped
  • Created on morph.io

Scraper code

Ruby

crunchbase-a / scraper.rb