backgroundcheck / my-bd_cmp_list

Bangladesh - Companies Information

Contributors

Last run failed 2020-01-17 with status code 1.

Console output of last run

Injecting configuration and compiling... Injecting scraper and running... D, [2020-01-17T14:00:57.444499 #16] DEBUG -- : query: "search_text=0&p_entry_mode=3&page_no=1&CB=1&entity_type=1&result_type=0" I, [2020-01-17T14:00:57.444829 #16] INFO -- : Net::HTTP::Post: /psp/nc_search D, [2020-01-17T14:00:57.444877 #16] DEBUG -- : request-header: accept => */* D, [2020-01-17T14:00:57.444906 #16] DEBUG -- : request-header: user-agent => Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.1) Gecko/20100122 firefox/3.6.1 D, [2020-01-17T14:00:57.444932 #16] DEBUG -- : request-header: accept-encoding => gzip,deflate,identity D, [2020-01-17T14:00:57.444957 #16] DEBUG -- : request-header: accept-charset => ISO-8859-1,utf-8;q=0.7,*;q=0.7 D, [2020-01-17T14:00:57.444982 #16] DEBUG -- : request-header: accept-language => en-us,en;q=0.5 D, [2020-01-17T14:00:57.445006 #16] DEBUG -- : request-header: host => www.roc.gov.bd:7781 D, [2020-01-17T14:00:57.445031 #16] DEBUG -- : request-header: content-type => application/x-www-form-urlencoded D, [2020-01-17T14:00:57.445056 #16] DEBUG -- : request-header: content-length => 71 /app/vendor/bundle/ruby/1.9.1/gems/net-http-persistent-2.5.2/lib/net/http/persistent.rb:521:in `rescue in connection_for': connection refused: www.roc.gov.bd:7781 (Net::HTTP::Persistent::Error) from /app/vendor/bundle/ruby/1.9.1/gems/net-http-persistent-2.5.2/lib/net/http/persistent.rb:463:in `connection_for' from /app/vendor/bundle/ruby/1.9.1/gems/net-http-persistent-2.5.2/lib/net/http/persistent.rb:788:in `request' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize/http/agent.rb:258:in `fetch' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize.rb:1229:in `post_form' from /app/vendor/bundle/ruby/1.9.1/gems/mechanize-2.5.1/lib/mechanize.rb:469:in `post' from scraper.rb:92:in `action' from scraper.rb:107:in `block in <main>' from scraper.rb:105:in `each' from scraper.rb:105:in `each_with_index' from scraper.rb:105:in `<main>'

Statistics

Average successful run time: 39 minutes

Total run time: 1 day

Total cpu time used: 29 minutes

Total disk space used: 22.1 KB

History

Auto ran revision f6c23ab2 and failed 2020-01-17.

run time 6 s

nothing changed in the database
Auto ran revision f6c23ab2 and failed 2020-01-16.

run time 1 minute

nothing changed in the database
Auto ran revision f6c23ab2 and failed 2020-01-15.

run time 7 s

nothing changed in the database
Auto ran revision f6c23ab2 and failed 2020-01-14.

run time 4 s

nothing changed in the database
Auto ran revision f6c23ab2 and failed 2020-01-13.

run time 5 s

nothing changed in the database
...
Forked from ScraperWiki 2016-04-30

Show complete history

Scraper code

Ruby

my-bd_cmp_list / scraper.rb

git clone URL