Bug #15746: 11 test cases run failed

• Status: Rejected
• Assignee: -
• Target version: -
• ruby -v: 2.6.2
• Backport: 2.4: UNKNOWN, 2.5: UNKNOWN, 2.6: UNKNOWN

[sandy-lcq (sandy li)]

Below problem is find on 2.5.3 and also 2.6.2.
and ruby is compiled from source. and source get from:
http://cache.ruby-lang.org/pub/ruby

below test failed:
ruby test_delegate.rb
ruby test_forwardable.rb
ruby test_pstore.rb
ruby test_securerandom.rb
ruby test_tempfile.rb
ruby test_time.rb
ruby test_timeout.rb
ruby test_tmpdir.rb
ruby test_weakref.rb
ruby test_cmath.rb

ruby test_extlibs.rb

The top nine mainly failed like:

1.Error: test_error_handling(TestCMath):
NoMethodError: undefined method `assert_raise_with_message' for #TestCMath:0x000056300b0c5800
Did you mean? assert_raise_message

As I checked, assert_raise_with_message exist in stdlib 2.1.2 -> Test::Unit::Assertions.
refer:
https://ruby-doc.org/stdlib-2.1.2/libdoc/test/unit/rdoc/Test/Unit/Assertions.html

but for ruby 2.6.2, Test::Unit::Assertions don't have this method.

2.test_cmath.rb:31:in `test_log'
Error: test_log(TestCMath): RangeError: can't convert 0.8047189562170503+1.1071487177940904i into Float

As I checked, assert_in_delta exist in test/unit/assertion.rb, but require argument be float.

above problem can be solved by add "require 'minitest/autorun'"

The last test failed like:
Traceback (most recent call last):
test_extlibs.rb:6:in `': uninitialized constant Test (NameError)

need to add require "test/unit"

[sandy-lcq (sandy li)]

• Description updated (diff)

[sandy-lcq (sandy li)]

• Subject changed from 12 test failed to 12 test cases run failed
• Description updated (diff)

[sandy-lcq (sandy li)]

• Description updated (diff)

[sandy-lcq (sandy li)]

• Subject changed from 12 test cases run failed to 10 test cases run failed
• Description updated (diff)

[nobu (Nobuyoshi Nakada)]

• Status changed from Open to Rejected

Run these tests under the build tree.

[sandy-lcq (sandy li)]

• Subject changed from 10 test cases run failed to 11 test cases run failed
• Description updated (diff)

[sandy-lcq (sandy li)]

• Description updated (diff)

nobu (Nobuyoshi Nakada) wrote:

Run these tests under the build tree.

Hi,

I don't think this is problem where I run the test. Can you explain more? Thanks.
Besides, I run the test on target since cross compile.

1. for error like:
   Error: test_error_handling(TestCMath):
   NoMethodError: undefined method `assert_raise_with_message' for #TestCMath:0x000056300b0c5800
   Did you mean? assert_raise_message

no matter where I run the test, the version of my std lib (2.6.2) Test::Unit::Assertion don't have this method.
this is why I add "require minitest/autorun"

2. for this error:
   test_extlibs.rb:6:in `': uninitialized constant Test (NameError)

Test is defined in test/unit.rb, can we use it if we don't require it?

[nobu (Nobuyoshi Nakada)]

Run with make test-all or test/runner.rb:

$ make test-all TESTS=test_extlibs.rb TESTOPTS=-v
../src/revision.h unchanged
Run options: "--ruby=./miniruby -I../src/lib -I. -I.ext/common  ../src/tool/runruby.rb --extout=.ext  -- --disable-gems" --excludes-dir=../src/test/excludes --name=!/memory_leak/ -v

# Running tests:

TestExtLibs#test_existence_of_bigdecimal = 0.05 s = .
TestExtLibs#test_existence_of_continuation = 0.06 s = .
TestExtLibs#test_existence_of_coverage = 0.06 s = .
TestExtLibs#test_existence_of_date = 0.06 s = .
TestExtLibs#test_existence_of_digest = 0.06 s = .
TestExtLibs#test_existence_of_digest/bubblebabble = 0.06 s = .
TestExtLibs#test_existence_of_digest/md5 = 0.06 s = .
TestExtLibs#test_existence_of_digest/rmd160 = 0.06 s = .
TestExtLibs#test_existence_of_digest/sha1 = 0.06 s = .
TestExtLibs#test_existence_of_digest/sha2 = 0.06 s = .
TestExtLibs#test_existence_of_etc = 0.06 s = .
TestExtLibs#test_existence_of_fcntl = 0.06 s = .
TestExtLibs#test_existence_of_fiber = 0.09 s = .
TestExtLibs#test_existence_of_fiddle = 0.08 s = .
TestExtLibs#test_existence_of_io/console = 0.06 s = .
TestExtLibs#test_existence_of_io/nonblock = 0.06 s = .
TestExtLibs#test_existence_of_io/wait = 0.06 s = .
TestExtLibs#test_existence_of_json = 0.07 s = .
TestExtLibs#test_existence_of_nkf = 0.06 s = .
TestExtLibs#test_existence_of_objspace = 0.06 s = .
TestExtLibs#test_existence_of_openssl = 0.10 s = .
TestExtLibs#test_existence_of_pathname = 0.06 s = .
TestExtLibs#test_existence_of_psych = 0.09 s = .
TestExtLibs#test_existence_of_pty = 0.06 s = .
TestExtLibs#test_existence_of_racc/cparse = 0.06 s = .
TestExtLibs#test_existence_of_rbconfig/sizeof = 0.05 s = .
TestExtLibs#test_existence_of_ripper = 0.07 s = .
TestExtLibs#test_existence_of_sdbm = 0.06 s = .
TestExtLibs#test_existence_of_socket = 0.06 s = .
TestExtLibs#test_existence_of_stringio = 0.05 s = .
TestExtLibs#test_existence_of_strscan = 0.05 s = .
TestExtLibs#test_existence_of_syslog = 0.06 s = .
TestExtLibs#test_existence_of_thread = 0.05 s = .
TestExtLibs#test_existence_of_zlib = 0.06 s = .
Finished tests in 2.271774s, 14.9663 tests/s, 44.8988 assertions/s.
34 tests, 102 assertions, 0 failures, 0 errors, 0 skips

ruby -v: ruby 2.7.0dev (2019-04-09 trunk 67475) [x86_64-darwin18]

$ ./exe/ruby ../src/test/runner.rb -v ../src/test/test_extlibs.rb 
Run options: -v

# Running tests:

[ 1/34] TestExtLibs#test_existence_of_bigdecimal = 0.06 s
[ 2/34] TestExtLibs#test_existence_of_continuation = 0.06 s
[ 3/34] TestExtLibs#test_existence_of_coverage = 0.06 s
[ 4/34] TestExtLibs#test_existence_of_date = 0.06 s
[ 5/34] TestExtLibs#test_existence_of_digest = 0.07 s
[ 6/34] TestExtLibs#test_existence_of_digest/bubblebabble = 0.06 s
[ 7/34] TestExtLibs#test_existence_of_digest/md5 = 0.06 s
[ 8/34] TestExtLibs#test_existence_of_digest/rmd160 = 0.06 s
[ 9/34] TestExtLibs#test_existence_of_digest/sha1 = 0.06 s
[10/34] TestExtLibs#test_existence_of_digest/sha2 = 0.06 s
[11/34] TestExtLibs#test_existence_of_etc = 0.06 s
[12/34] TestExtLibs#test_existence_of_fcntl = 0.06 s
[13/34] TestExtLibs#test_existence_of_fiber = 0.06 s
[14/34] TestExtLibs#test_existence_of_fiddle = 0.06 s
[15/34] TestExtLibs#test_existence_of_io/console = 0.06 s
[16/34] TestExtLibs#test_existence_of_io/nonblock = 0.07 s
[17/34] TestExtLibs#test_existence_of_io/wait = 0.06 s
[18/34] TestExtLibs#test_existence_of_json = 0.07 s
[19/34] TestExtLibs#test_existence_of_nkf = 0.06 s
[20/34] TestExtLibs#test_existence_of_objspace = 0.06 s
[21/34] TestExtLibs#test_existence_of_openssl = 0.10 s
[22/34] TestExtLibs#test_existence_of_pathname = 0.05 s
[23/34] TestExtLibs#test_existence_of_psych = 0.09 s
[24/34] TestExtLibs#test_existence_of_pty = 0.06 s
[25/34] TestExtLibs#test_existence_of_racc/cparse = 0.06 s
[26/34] TestExtLibs#test_existence_of_rbconfig/sizeof = 0.06 s
[27/34] TestExtLibs#test_existence_of_ripper = 0.07 s
[28/34] TestExtLibs#test_existence_of_sdbm = 0.06 s
[29/34] TestExtLibs#test_existence_of_socket = 0.06 s
[30/34] TestExtLibs#test_existence_of_stringio = 0.06 s
[31/34] TestExtLibs#test_existence_of_strscan = 0.06 s
[32/34] TestExtLibs#test_existence_of_syslog = 0.06 s
[33/34] TestExtLibs#test_existence_of_thread = 0.06 s
[34/34] TestExtLibs#test_existence_of_zlib = 0.06 s
Finished tests in 2.138339s, 15.9002 tests/s, 95.4012 assertions/s.
34 tests, 204 assertions, 0 failures, 0 errors, 0 skips

ruby -v: ruby 2.7.0dev (2019-04-09 trunk 67475) [x86_64-darwin18]

[sandy-lcq (sandy li)]

nobu (Nobuyoshi Nakada) wrote:

Run with make test-all or test/runner.rb:

$ make test-all TESTS=test_extlibs.rb TESTOPTS=-v
../src/revision.h unchanged
Run options: "--ruby=./miniruby -I../src/lib -I. -I.ext/common  ../src/tool/runruby.rb --extout=.ext  -- --disable-gems" --excludes-dir=../src/test/excludes --name=!/memory_leak/ -v

# Running tests:

TestExtLibs#test_existence_of_bigdecimal = 0.05 s = .
TestExtLibs#test_existence_of_continuation = 0.06 s = .
TestExtLibs#test_existence_of_coverage = 0.06 s = .
TestExtLibs#test_existence_of_date = 0.06 s = .
TestExtLibs#test_existence_of_digest = 0.06 s = .
TestExtLibs#test_existence_of_digest/bubblebabble = 0.06 s = .
TestExtLibs#test_existence_of_digest/md5 = 0.06 s = .
TestExtLibs#test_existence_of_digest/rmd160 = 0.06 s = .
TestExtLibs#test_existence_of_digest/sha1 = 0.06 s = .
TestExtLibs#test_existence_of_digest/sha2 = 0.06 s = .
TestExtLibs#test_existence_of_etc = 0.06 s = .
TestExtLibs#test_existence_of_fcntl = 0.06 s = .
TestExtLibs#test_existence_of_fiber = 0.09 s = .
TestExtLibs#test_existence_of_fiddle = 0.08 s = .
TestExtLibs#test_existence_of_io/console = 0.06 s = .
TestExtLibs#test_existence_of_io/nonblock = 0.06 s = .
TestExtLibs#test_existence_of_io/wait = 0.06 s = .
TestExtLibs#test_existence_of_json = 0.07 s = .
TestExtLibs#test_existence_of_nkf = 0.06 s = .
TestExtLibs#test_existence_of_objspace = 0.06 s = .
TestExtLibs#test_existence_of_openssl = 0.10 s = .
TestExtLibs#test_existence_of_pathname = 0.06 s = .
TestExtLibs#test_existence_of_psych = 0.09 s = .
TestExtLibs#test_existence_of_pty = 0.06 s = .
TestExtLibs#test_existence_of_racc/cparse = 0.06 s = .
TestExtLibs#test_existence_of_rbconfig/sizeof = 0.05 s = .
TestExtLibs#test_existence_of_ripper = 0.07 s = .
TestExtLibs#test_existence_of_sdbm = 0.06 s = .
TestExtLibs#test_existence_of_socket = 0.06 s = .
TestExtLibs#test_existence_of_stringio = 0.05 s = .
TestExtLibs#test_existence_of_strscan = 0.05 s = .
TestExtLibs#test_existence_of_syslog = 0.06 s = .
TestExtLibs#test_existence_of_thread = 0.05 s = .
TestExtLibs#test_existence_of_zlib = 0.06 s = .
Finished tests in 2.271774s, 14.9663 tests/s, 44.8988 assertions/s.
34 tests, 102 assertions, 0 failures, 0 errors, 0 skips

ruby -v: ruby 2.7.0dev (2019-04-09 trunk 67475) [x86_64-darwin18]

$ ./exe/ruby ../src/test/runner.rb -v ../src/test/test_extlibs.rb 
Run options: -v

# Running tests:

[ 1/34] TestExtLibs#test_existence_of_bigdecimal = 0.06 s
[ 2/34] TestExtLibs#test_existence_of_continuation = 0.06 s
[ 3/34] TestExtLibs#test_existence_of_coverage = 0.06 s
[ 4/34] TestExtLibs#test_existence_of_date = 0.06 s
[ 5/34] TestExtLibs#test_existence_of_digest = 0.07 s
[ 6/34] TestExtLibs#test_existence_of_digest/bubblebabble = 0.06 s
[ 7/34] TestExtLibs#test_existence_of_digest/md5 = 0.06 s
[ 8/34] TestExtLibs#test_existence_of_digest/rmd160 = 0.06 s
[ 9/34] TestExtLibs#test_existence_of_digest/sha1 = 0.06 s
[10/34] TestExtLibs#test_existence_of_digest/sha2 = 0.06 s
[11/34] TestExtLibs#test_existence_of_etc = 0.06 s
[12/34] TestExtLibs#test_existence_of_fcntl = 0.06 s
[13/34] TestExtLibs#test_existence_of_fiber = 0.06 s
[14/34] TestExtLibs#test_existence_of_fiddle = 0.06 s
[15/34] TestExtLibs#test_existence_of_io/console = 0.06 s
[16/34] TestExtLibs#test_existence_of_io/nonblock = 0.07 s
[17/34] TestExtLibs#test_existence_of_io/wait = 0.06 s
[18/34] TestExtLibs#test_existence_of_json = 0.07 s
[19/34] TestExtLibs#test_existence_of_nkf = 0.06 s
[20/34] TestExtLibs#test_existence_of_objspace = 0.06 s
[21/34] TestExtLibs#test_existence_of_openssl = 0.10 s
[22/34] TestExtLibs#test_existence_of_pathname = 0.05 s
[23/34] TestExtLibs#test_existence_of_psych = 0.09 s
[24/34] TestExtLibs#test_existence_of_pty = 0.06 s
[25/34] TestExtLibs#test_existence_of_racc/cparse = 0.06 s
[26/34] TestExtLibs#test_existence_of_rbconfig/sizeof = 0.06 s
[27/34] TestExtLibs#test_existence_of_ripper = 0.07 s
[28/34] TestExtLibs#test_existence_of_sdbm = 0.06 s
[29/34] TestExtLibs#test_existence_of_socket = 0.06 s
[30/34] TestExtLibs#test_existence_of_stringio = 0.06 s
[31/34] TestExtLibs#test_existence_of_strscan = 0.06 s
[32/34] TestExtLibs#test_existence_of_syslog = 0.06 s
[33/34] TestExtLibs#test_existence_of_thread = 0.06 s
[34/34] TestExtLibs#test_existence_of_zlib = 0.06 s
Finished tests in 2.138339s, 15.9002 tests/s, 95.4012 assertions/s.
34 tests, 204 assertions, 0 failures, 0 errors, 0 skips

ruby -v: ruby 2.7.0dev (2019-04-09 trunk 67475) [x86_64-darwin18]

Thanks!