Project

General

Profile

Bug #14456

Dir.glob with FNM_CASEFOLD gives ArgumentError: invalid byte sequence in UTF-8

Added by Gondolin (Damien Robert) 4 months ago. Updated 4 months ago.

Status:
Open
Priority:
Normal
Assignee:
-
Target version:
-
[ruby-core:85448]

Description

With ruby 2.5.0p0, in a folder that contains a file encoded in latin-1, I get the following error:

Dir.glob('*a', File::FNM_CASEFOLD)
ArgumentError: invalid byte sequence in UTF-8

Note that Dir.glob('*', File::FNM_CASEFOLD), Dir.glob('a*', File::FNM_CASEFOLD) and Dir.glob('*a') work, so it is a bit strange that
Dir.glob('*a', File::FNM_CASEFOLD) does not.


Related issues

Has duplicate Ruby trunk - Bug #14455: Dir.glob with FNM_CASEFOLD gives ArgumentError: invalid byte sequence in UTF-8Closed

History

#1 [ruby-core:85449] Updated by Gondolin (Damien Robert) 4 months ago

Apologies for the spam, my browser submitted this bug several times and I don't know how to erase the other bug reports.

#2 [ruby-core:85450] Updated by shevegen (Robert A. Heiler) 4 months ago

I don't know how to erase the other bug reports.

Not sure if it can be removed, but I think you can change the status
to "closed" (or someone from the ruby core team probably could).

To the bug report, just out of curiosity, can you avoid the UTF
problem if you change to use another encoding before calling
Dir.glob? For example, I usually use 'ISO-8859-1' mostly due to
german umlauts but the terminal/shell used, such as my case
usually mate-terminal (based on vte) these days, there is also an
option where I can decide to use UTF-8 as locale, or the current
active locale (ISO-8859-1). When I use both ISO and the locale
setting, I almost never get invalid byte sequence errors (and
of course if I sync any external input read... File.read() has
an option for specifying the :encoding, perhaps Dir.glob()
could also benefit from a hash with a key called :encoding but
I am perhaps digressing...)

#3 Updated by duerst (Martin Dürst) 4 months ago

  • Has duplicate Bug #14455: Dir.glob with FNM_CASEFOLD gives ArgumentError: invalid byte sequence in UTF-8 added

#4 [ruby-core:85467] Updated by Gondolin (Damien Robert) 4 months ago

shevegen (Robert A. Heiler) wrote:

Not sure if it can be removed, but I think you can change the status
to "closed" (or someone from the ruby core team probably could).

Someone did, thanks!

To the bug report, just out of curiosity, can you avoid the UTF
problem if you change to use another encoding before calling
Dir.glob?

Yes: Dir.glob('*a'.encode!('ISO-8859-1'), File::FNM_CASEFOLD) works.

#5 Updated by Gondolin (Damien Robert) 4 months ago

  • Description updated (diff)

Also available in: Atom PDF