Bug #4434

make test-all "-j10000" のように大きな並列数を与えると異常終了

Added by Motohiro KOSAKI about 3 years ago. Updated about 1 year ago.

[ruby-dev:43264]
Status:Feedback
Priority:Low
Assignee:Shota Fukumori
Category:lib
Target version:next minor
ruby -v:ruby 1.9.3dev (2011-02-22 trunk 30941) [x86_64-linux] Backport:

Description

=begin
% make test-all TESTS="-j10000"
./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext -- "./test/runner.rb" -j10000
Run options: -j10000

Running tests:

[FATAL] Failed to create timer thread (errno: 11)
[FATAL] Failed to create timer thread (errno: 11)
make: *** [yes-test-all] Error 1

/home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in write': Broken pipe - <STDOUT> (Errno::EPIPE)
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in
puts'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in run'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:139:in
'
/home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in write': Broken pipe - <STDOUT> (Errno::EPIPE)
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in
puts'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in run'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:139:in
'
/home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in write': Broken pipe - <STDOUT> (Errno::EPIPE)
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in
puts'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in run'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:139:in
'
/home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in write': Broken pipe - <STDOUT> (Errno::EPIPE)
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in
puts'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in run'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:139:in
'
/home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in write': Broken pipe - <STDOUT> (Errno::EPIPE)
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in
puts'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in run'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:139:in
'
/home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in write': Broken pipe - <STDOUT> (Errno::EPIPE)
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in
puts'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in run'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:139:in
'
/home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in write': Broken pipe - <STDOUT> (Errno::EPIPE)
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in
puts'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in run'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:139:in
'
/home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in write': Broken pipe - <STDOUT> (Errno::EPIPE)
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in
puts'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:74:in run'
from /home/kosaki/linux/ruby-svn/ruby/lib/test/unit/parallel.rb:139:in
'

=end

History

#1 Updated by Shota Fukumori about 3 years ago

  • Category changed from test to lib

=begin

=end

#2 Updated by Koichi Sasada almost 3 years ago

この問題はどうなっていますでしょうか.

#3 Updated by Shota Fukumori about 2 years ago

  • Status changed from Assigned to Feedback

r34968 の変更で IO.popen による worker プロセスの起動に失敗した時に

ERROR: Failed to launch job process - Errno::EMFILE: Too many open files - ./miniruby

と表示されるようになったので make test-all TESTS="-j10000" で現在チケットに書いてあるような
分かりにくい異常終了の仕方にはなってないのですが問題無いでしょうか。

(-j10000 は手元の環境じゃ too many open files になるというのもあり、引き続き再現するか不明
なので一旦 feedback にします)

#4 Updated by Motohiro KOSAKI about 2 years ago

Too many open files を出してるのがマネージャープロセスなら、しょうがないんじゃない。それはRLIMIT上げればいいんだし。
workerプロセスが出してるなら問題で、それはfdリークを意味してるので -j の数によってテストが変わってしまう可能性があるのでよくないよね。

#5 Updated by Yusuke Endoh about 1 year ago

  • Target version changed from 2.0.0 to next minor

テストの問題に過ぎない (ですよね?) ので先送り。

Yusuke Endoh mame@tsg.ne.jp

Also available in: Atom PDF