Bug #12443: Test failures in TestDir_M17N on cygwin

• Status: Closed
• Assignee: duerst (Martin Dürst)
• Target version: -
• ruby -v: ruby 2.4.0dev (2016-05-31 trunk 55228) [x86_64-cygwin]
• Backport: 2.1: UNKNOWN, 2.2: UNKNOWN, 2.3: UNKNOWN

[duerst (Martin Dürst)]

When I try to run bin/ruby test/runner.rb test/ruby/test_* (because make test-all doesn't work), I get the following failures for TestDir_M17N:

[ 594/4545] TestDir#test_glob_cases = 0.35 s
  2) Failure:
TestDir#test_glob_cases [/cygdrive/c/Data/ruby/test/ruby/test_dir.rb:255]:
[ruby-core:42469] [Feature #5994]
Dir.glob should return the filename with actual cases on the filesystem.
<["FileWithCases"]> expected but was
<["filewithcases"]>.

[ 608/4545] TestDir_M17N#test_entries_compose = 0.01 s
  3) Error:
TestDir_M17N#test_entries_compose:
ArgumentError: invalid byte sequence in Windows-31J
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:408:in `block (2 levels) in test_entries_compose'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:408:in `reject'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:408:in `block in test_entries_compose'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:9:in `block (2 levels) in with_tmpdir'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:8:in `chdir'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:8:in `block in with_tmpdir'
    /cygdrive/c/Data/ruby/lib/ruby/vendor_ruby/tmpdir.rb:89:in `mktmpdir'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:7:in `with_tmpdir'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:397:in `test_entries_compose'

[ 610/4545] TestDir_M17N#test_filename_as_bytes_extutf8 = 0.98 s
  4) Failure:
TestDir_M17N#test_filename_as_bytes_extutf8 [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:87]:
Expected [".", "..", "\xC2\xA1"] to include "¡".

[ 611/4545] TestDir_M17N#test_filename_bytes_euc_jp = 0.83 s
  5) Failure:
TestDir_M17N#test_filename_bytes_euc_jp [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:185]:
Expected [".", "..", "\xEF\x82\xA4\xEF\x82\xA2"] to include "\xA4\xA2".

[ 612/4545] TestDir_M17N#test_filename_euc_jp = 0.86 s
  6) Failure:
TestDir_M17N#test_filename_euc_jp [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:200]:
Expected [".", "..", "\x{EF82}\xA4\x{EF82}\xA2"] to include "▒▒".

[ 613/4545] TestDir_M17N#test_filename_ext_euc_jp_and_int_utf_8 = 0.90 s
  7) Failure:
TestDir_M17N#test_filename_ext_euc_jp_and_int_utf_8 [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:245]:
Expected [".", "..", "\x{EF82}\xA4\x{EF82}\xA2"] to include "▒▒".

[ 614/4545] TestDir_M17N#test_filename_extutf8 = 0.91 s
  8) Failure:
TestDir_M17N#test_filename_extutf8 [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:54]:
Expected [".", "..", "\x{E381}\x82"] to include "あ".

[ 615/4545] TestDir_M17N#test_filename_extutf8_inteucjp_representable = 0.88 s
  9) Failure:
TestDir_M17N#test_filename_extutf8_inteucjp_representable [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:124]:
Expected [".", "..", "\x{E381}\x82"] to include "あ".

[ 616/4545] TestDir_M17N#test_filename_extutf8_inteucjp_unrepresentable = 1.14 s
 10) Failure:
TestDir_M17N#test_filename_extutf8_inteucjp_unrepresentable [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:150]:
Expected [".", "..", "\x{E299}\xA1", "\x{E381}\x82"] to include "♡".

[ 617/4545] TestDir_M17N#test_filename_extutf8_invalid = 0.84 s
 11) Failure:
TestDir_M17N#test_filename_extutf8_invalid [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:67]:
Expected [".", "..", "\x{EF83}\xBF"] to include "\xFF".

[ 618/4545] TestDir_M17N#test_filename_utf8_raw_jp_name = 0.67 s
 12) Failure:
TestDir_M17N#test_filename_utf8_raw_jp_name [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:224]:
Expected [".", "..", "\x{E381}\x82"] to include "あ".

[ 619/4545] TestDir_M17N#test_filename_utf8_raw_windows_1251_name = 0.69 s
 13) Failure:
TestDir_M17N#test_filename_utf8_raw_windows_1251_name [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:228]:
Expected [".", "..", "\xD0\xA4"] to include "Ф".

[ 620/4545] TestDir_M17N#test_filename_utf8_raw_windows_1252_name = 0.60 s
 14) Failure:
TestDir_M17N#test_filename_utf8_raw_windows_1252_name [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:232]:
Expected [".", "..", "\xC3\x86"] to include "Æ".

[ 622/4545] TestDir_M17N#test_glob_encoding = 0.01 s
 15) Error:
TestDir_M17N#test_glob_encoding:
Encoding::UndefinedConversionError: "\x87\xE4" from Windows-31J to UTF-8
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:382:in `encode'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:382:in `block (2 levels) in test_glob_encoding'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:378:in `map'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:378:in `block in test_glob_encoding'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:9:in `block (2 levels) in with_tmpdir'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:8:in `chdir'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:8:in `block in with_tmpdir'
    /cygdrive/c/Data/ruby/lib/ruby/vendor_ruby/tmpdir.rb:89:in `mktmpdir'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:7:in `with_tmpdir'
    /cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:367:in `test_glob_encoding'

[ 625/4545] TestDir_M17N#test_glob_warning_match_all = 0.15 s
 16) Failure:
TestDir_M17N#test_glob_warning_match_all [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:339]:
Expected: /ΑΒΓΔΕ/
  Actual: "".

[ 626/4545] TestDir_M17N#test_glob_warning_match_dir = 0.01 s
 17) Failure:
TestDir_M17N#test_glob_warning_match_dir [/cygdrive/c/Data/ruby/test/ruby/test_dir_m17n.rb:350]:
Expected: /ΑΒΓΔΕ/
  Actual: "".

[naruse (Yui NARUSE)]

• Assignee deleted (naruse (Yui NARUSE))

cygwin is not supported officially.

[naruse (Yui NARUSE)]

• Status changed from Open to Feedback

[duerst (Martin Dürst)]

On 2016/06/01 05:33, [e-mail] wrote:

Issue #12443 has been updated by Yui NARUSE.

Status changed from Open to Feedback

What feedback is needed, and from whom?

Regards, Martin.

---

Bug #12443: Test failures in TestDir_M17N on cygwin
https://bugs.ruby-lang.org/issues/12443#change-58989

[duerst (Martin Dürst)]

The following may be relevant:
https://cygwin.com/cygwin-ug-net/using-specialnames.html#pathnames-unusual
What it says is that as long as UTF-8 is used, things should work fine. This probably means that we just have to make sure that the file system encoding is UTF-8, and switch off other tests if necessary.

[duerst (Martin Dürst)]

• Assignee set to duerst (Martin Dürst)

[duerst (Martin Dürst)]

• Status changed from Feedback to Closed

Applied in changeset r55453.

---

• test/ruby/test_dir_m17n.rb: Skip tests with non-UTF-8 encodings
  on cygwin. Cygwin can use the Unicode PUA (private use area) to store
  bytes from non-UTF-8 filenames (see
  https://cygwin.com/cygwin-ug-net/using-specialnames.html#pathnames-specialchars),
  but we are not supporting this. [Bug #12443]

[duerst (Martin Dürst)]

• Related to Bug #12506: On cygwin, Feature #5994 does not work added