Project

General

Profile

Bug #4814

minitest 2.2.x and test/unit do not get along

Added by zenspider (Ryan Davis) almost 8 years ago. Updated about 7 years ago.

Status:
Rejected
Priority:
Normal
Target version:
-
ruby -v:
-
Backport:
[ruby-core:36679]

Description

TestParallel tests are broken on trunk after my update of minitest (+ your patch to test/unit to get tests running).

32) Failure:
test_jobs_status(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:176]:
Expected /\d+=test_(first|second|third|forth) */ to match "Run options: -j t2 --jobs-status\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

33) Failure:
test_no_retry_option(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:170]:
Expected /^ +\d+) Failure:\nptest_fail_at_worker(TestD)/ to match "Run options: -j t2 --no-retry\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

34) Failure:
test_should_retry_failed_on_workers(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:162]:
Expected /Retrying.+$/ to match "Run options: -j t2\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

35) Failure:
test_should_run_all_without_any_leaks(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:156]:
Expected /.(.SF.*F|F..+SF).*$/ to match "Run options: -j t2\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

History

Updated by naruse (Yui NARUSE) almost 8 years ago

Hi, ryan

Thank you for running test-all before commit.
But can you make a ticket when the commit will break test-all?
Especially for r31885, which broke installation, breaks continuous integration.

Updated by sorah (Sorah Fukumori) almost 8 years ago

  • Status changed from Open to Feedback

Hi,

How I reproduce this issue?

Updated by zenspider (Ryan Davis) almost 8 years ago

  • ruby -v changed from ruby 1.9.3dev (2011-06-01 trunk 31883) [x86_64-darwin10.7.0] to -

On Jun 1, 2011, at 21:33 , Shota Fukumori wrote:

How I reproduce this issue?

make test-all was all I was doing.

The only oddity is that I delete the drb tests first because they fail spectacularly on osx (75 seconds per error, 100% error).

Updated by sorah (Sorah Fukumori) almost 8 years ago

could test again with make TESTS="-v testunit/test_parallel.rb" test-all at r31902?

I can't reproduce at ruby 1.9.3dev (2011-06-02 trunk 31902) [x86_64-darwin10.7.0].

Updated by zenspider (Ryan Davis) almost 8 years ago

On Jun 2, 2011, at 03:56 , Shota Fukumori wrote:

could test again with `make TESTS

Updated by naruse (Yui NARUSE) almost 8 years ago

How's it going?

Updated by zenspider (Ryan Davis) almost 8 years ago

mail-to-rubymine truncated my response... Fixed:

I'm still broken:

7107 % svn st
7107 % svn info io.c | grep Revision
Revision: 31902
7108 % make -j 4 ruby19
make: `ruby19' is up to date.
7109 % make TESTS="-v testunit/test_parallel.rb" test-all
./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext -- "./test/runner.rb" --ruby="./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext --" -v testunit/test_parallel.rb
Run options: "--ruby=./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext --" -v

Running tests:

TestParallel::TestParallel#test_jobs_status = 0.12 s = F
TestParallel::TestParallel#test_no_retry_option = 0.12 s = F
TestParallel::TestParallel#test_should_retry_failed_on_workers = 0.12 s = F
TestParallel::TestParallel#test_should_run_all_without_any_leaks = 0.13 s = F
TestParallel::TestParallelWorker#test_accept_run_command_multiple_times = 0.11 s = .
TestParallel::TestParallelWorker#test_done = 0.11 s = .
TestParallel::TestParallelWorker#test_p = 0.11 s = .
TestParallel::TestParallelWorker#test_quit = 0.11 s = .
TestParallel::TestParallelWorker#test_run = 0.11 s = .
TestParallel::TestParallelWorker#test_run_multiple_testcase_in_one_file = 0.11 s = .

Finished tests in 1.145128s, 8.7326 tests/s, 35.8039 assertions/s.

1) Failure:
test_jobs_status(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:176]:
Expected /\d+=test_(first|second|third|forth) */ to match "Run options: -j t2 --jobs-status\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

2) Failure:
test_no_retry_option(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:170]:
Expected /^ +\d+) Failure:\nptest_fail_at_worker(TestD)/ to match "Run options: -j t2 --no-retry\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

3) Failure:
test_should_retry_failed_on_workers(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:162]:
Expected /Retrying.+$/ to match "Run options: -j t2\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

4) Failure:
test_should_run_all_without_any_leaks(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:156]:
Expected /.(.SF.*F|F..+SF).*$/ to match "Run options: -j t2\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

10 tests, 41 assertions, 4 failures, 0 errors, 0 skips
make: *** [yes-test-all] Error 4

Even after updating to the latest revision:

Run options: "--ruby=./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext --" -v

Running tests:

TestParallel::TestParallel#test_ignore_jzero = 0.11 s = .
TestParallel::TestParallel#test_jobs_status = 0.12 s = F
TestParallel::TestParallel#test_no_retry_option = 0.11 s = F
TestParallel::TestParallel#test_should_retry_failed_on_workers = 0.11 s = F
TestParallel::TestParallel#test_should_run_all_without_any_leaks = 0.11 s = F
TestParallel::TestParallelWorker#test_accept_run_command_multiple_times = 0.12 s = .
TestParallel::TestParallelWorker#test_done = 0.13 s = .
TestParallel::TestParallelWorker#test_p = 0.16 s = .
TestParallel::TestParallelWorker#test_quit = 0.11 s = .
TestParallel::TestParallelWorker#test_run = 0.11 s = .
TestParallel::TestParallelWorker#test_run_multiple_testcase_in_one_file = 0.11 s = .

Finished tests in 1.302439s, 8.4457 tests/s, 32.2472 assertions/s.

1) Failure:
test_jobs_status(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:175]:
Expected /\d+=test_(first|second|third|forth) */ to match "Run options: -j t1 --jobs-status\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:500:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:557:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:566:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:635:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:639:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

2) Failure:
test_no_retry_option(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:169]:
Expected /^ +\d+) Failure:\nptest_fail_at_worker(TestD)/ to match "Run options: -j t1 --no-retry\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:500:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:557:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:566:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:635:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:639:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

3) Failure:
test_should_retry_failed_on_workers(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:162]:
Expected /Retrying.+$/ to match "Run options: -j t1\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:500:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:557:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:566:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:635:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:639:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

4) Failure:
test_should_run_all_without_any_leaks(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:156]:
Expected /[SF.]{7}$/ to match "Run options: -j t1\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:500:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:557:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:566:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:635:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:639:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

11 tests, 42 assertions, 4 failures, 0 errors, 0 skips
make: *** [yes-test-all] Error 4

Updated by sorah (Sorah Fukumori) about 7 years ago

  • Status changed from Feedback to Rejected

Rejecting because of no feedback and I can't reproduce in my environment.

(if this issue is still reproducible, please reopen)

Updated by zenspider (Ryan Davis) about 7 years ago

On Jun 2, 2011, at 03:56 , Shota Fukumori wrote:

could test again with make TESTS="-v testunit/test_parallel.rb" test-all at r31902?

I can't reproduce at ruby 1.9.3dev (2011-06-02 trunk 31902) [x86_64-darwin10.7.0].

As an aside, since you're on OSX, do the drb tests work for you? How to fix?

TestDRbAry#test_01 = 74.83 s = E
TestDRbAry#test_02_collect = 75.54 s = E
TestDRbAry#test_03_redo = 75.03 s = E
TestDRbAry#test_05_break = 75.03 s = E
TestDRbAry#test_06_next = 75.03 s = E
TestDRbAry#test_07_break_18 = 75.04 s = E

Huh... any suggestion on what I might be doing wrong because I can reproduce against latest?

% ./miniruby -v
ruby 1.9.3dev (2011-06-02 trunk 31906) [x86_64-darwin10.7.0]

% make TESTS="-v testunit/test_parallel.rb" test-all
./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext -- "./test/runner.rb" --ruby="./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext --" -v testunit/test_parallel.rb
Run options: "--ruby=./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext --" -v

# Running tests:

TestParallel::TestParallel#test_jobs_status = 0.12 s = F
TestParallel::TestParallel#test_no_retry_option = 0.12 s = F
TestParallel::TestParallel#test_should_retry_failed_on_workers = 0.12 s = F
TestParallel::TestParallel#test_should_run_all_without_any_leaks = 0.12 s = F
TestParallel::TestParallelWorker#test_accept_run_command_multiple_times = 0.11 s = .
TestParallel::TestParallelWorker#test_done = 0.11 s = .
TestParallel::TestParallelWorker#test_p = 0.11 s = .
TestParallel::TestParallelWorker#test_quit = 0.10 s = .
TestParallel::TestParallelWorker#test_run = 0.11 s = .
TestParallel::TestParallelWorker#test_run_multiple_testcase_in_one_file = 0.11 s = .

Finished tests in 1.118685s, 8.9391 tests/s, 36.6502 assertions/s.

1) Failure:
test_jobs_status(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:176]:
Expected /\d+=test_(first|second|third|forth) */ to match "Run options: -j t2 --jobs-status\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

2) Failure:
test_no_retry_option(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:170]:
Expected /^ +\d+) Failure:\nptest_fail_at_worker(TestD)/ to match "Run options: -j t2 --no-retry\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

3) Failure:
test_should_retry_failed_on_workers(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:162]:
Expected /Retrying.+$/ to match "Run options: -j t2\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

4) Failure:
test_should_run_all_without_any_leaks(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:156]:
Expected /.(.SF.*F|F..+SF).*$/ to match "Run options: -j t2\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

10 tests, 41 assertions, 4 failures, 0 errors, 0 skips
make: *** [yes-test-all] Error 4

Updated by zenspider (Ryan Davis) about 7 years ago

On Jun 2, 2011, at 03:56 , Shota Fukumori wrote:

could test again with make TESTS="-v testunit/test_parallel.rb" test-all at r31902?

I can't reproduce at ruby 1.9.3dev (2011-06-02 trunk 31902) [x86_64-darwin10.7.0].

As an aside, since you're on OSX, do the drb tests work for you? How to fix?

TestDRbAry#test_01 = 74.83 s = E
TestDRbAry#test_02_collect = 75.54 s = E
TestDRbAry#test_03_redo = 75.03 s = E
TestDRbAry#test_05_break = 75.03 s = E
TestDRbAry#test_06_next = 75.03 s = E
TestDRbAry#test_07_break_18 = 75.04 s = E

Huh... any suggestion on what I might be doing wrong because I can reproduce against latest?

% ./miniruby -v
ruby 1.9.3dev (2011-06-02 trunk 31906) [x86_64-darwin10.7.0]

% make TESTS="-v testunit/test_parallel.rb" test-all
./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext -- "./test/runner.rb" --ruby="./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext --" -v testunit/test_parallel.rb
Run options: "--ruby=./miniruby -I./lib -I. -I.ext/common ./tool/runruby.rb --extout=.ext --" -v

# Running tests:

TestParallel::TestParallel#test_jobs_status = 0.12 s = F
TestParallel::TestParallel#test_no_retry_option = 0.12 s = F
TestParallel::TestParallel#test_should_retry_failed_on_workers = 0.12 s = F
TestParallel::TestParallel#test_should_run_all_without_any_leaks = 0.12 s = F
TestParallel::TestParallelWorker#test_accept_run_command_multiple_times = 0.11 s = .
TestParallel::TestParallelWorker#test_done = 0.11 s = .
TestParallel::TestParallelWorker#test_p = 0.11 s = .
TestParallel::TestParallelWorker#test_quit = 0.10 s = .
TestParallel::TestParallelWorker#test_run = 0.11 s = .
TestParallel::TestParallelWorker#test_run_multiple_testcase_in_one_file = 0.11 s = .

Finished tests in 1.118685s, 8.9391 tests/s, 36.6502 assertions/s.

1) Failure:
test_jobs_status(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:176]:
Expected /\d+=test_(first|second|third|forth) */ to match "Run options: -j t2 --jobs-status\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

2) Failure:
test_no_retry_option(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:170]:
Expected /^ +\d+) Failure:\nptest_fail_at_worker(TestD)/ to match "Run options: -j t2 --no-retry\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

3) Failure:
test_should_retry_failed_on_workers(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:162]:
Expected /Retrying.+$/ to match "Run options: -j t2\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

4) Failure:
test_should_run_all_without_any_leaks(TestParallel::TestParallel) [/Users/ryan/Work/svn/ruby/ruby/test/testunit/test_parallel.rb:156]:
Expected /.(.SF.*F|F..+SF).*$/ to match "Run options: -j t2\n\n# Running ptests:\n\n/Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:495:in ensure in _run_parallel': undefined methodeach' for nil:NilClass (NoMethodError)\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:552:in _run_parallel'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:561:in_run_suites'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:746:in _run_anything'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/misc.rb:14:inrun_tests'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:896:in block in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:ineach'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:895:in _run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/minitest/unit.rb:884:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:21:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:609:inrun'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/lib/test/unit.rb:613:in run'\n\tfrom /Users/ryan/Work/svn/ruby/ruby/test/testunit/tests_for_parallel/runner.rb:7:in'\n".

10 tests, 41 assertions, 4 failures, 0 errors, 0 skips
make: *** [yes-test-all] Error 4

Also available in: Atom PDF