ali-ce / CrunchBase2

companies

Scrapes www.crunchbase.com


This is a scraper that runs on Morph. To get started see the documentation

Contributors ali-ce

Last run failed with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... /app/vendor/bundle/ruby/2.0.0/gems/httpclient-2.6.0.1/lib/httpclient.rb:1076:in `success_content': unexpected response: #<HTTP::Message::Headers:0x007f49caf61c18 @http_version="1.1", @body_size=0, @chunked=false, @request_method="GET", @request_uri=#<URI::HTTP:0x007f49caf630e0 URL:http://www.crunchbase.com/companies?c=a&q=funded>, @request_query=nil, @request_absolute_uri=nil, @status_code=416, @reason_phrase="Requested Range Not Satisfiable", @body_type=nil, @body_charset=nil, @body_date=nil, @body_encoding=#<Encoding:ASCII-8BIT>, @is_request=false, @header_item=[["Server", "nginx"], ["Date", "Fri, 04 Sep 2015 11:57:57 GMT"], ["Content-Type", "text/html"], ["Connection", "keep-alive"], ["Vary", "Accept-Encoding"], ["Content-Length", "4353"]], @dumped=false> (HTTPClient::BadResponseError) from /app/vendor/bundle/ruby/2.0.0/gems/httpclient-2.6.0.1/lib/httpclient.rb:625:in `get_content' from /app/vendor/bundle/ruby/2.0.0/bundler/gems/scraperwiki-ruby-fc5017681250/lib/scraperwiki.rb:35:in `scrape' from scraper.rb:28:in `initialize' from scraper.rb:89:in `new' from scraper.rb:89:in `block in <main>' from scraper.rb:88:in `upto' from scraper.rb:88:in `each' from scraper.rb:88:in `<main>'

Statistics

Total run time: less than a minute

Total cpu time used: less than 5 seconds

Total disk space used: 27.9 KB

History

  • Manually ran revision 0930788d and failed .
    nothing changed in the database
    1 page scraped
  • Manually ran revision 42e583b2 and failed .
    nothing changed in the database
    2 pages scraped
  • Manually ran revision d82cac8c and failed .
    nothing changed in the database
  • Created on morph.io

Scraper code

Ruby

CrunchBase2 / scraper.rb