Bug #11932: Ripper.sexp can't parse some files from ruby repository and returns nil

• Status: Closed
• Assignee: -
• Target version: -
• ruby -v: ruby 2.4.0dev (2015-12-31 trunk 53395) [x86_64-darwin15]
• Backport: 2.0.0: DONTNEED, 2.1: DONTNEED, 2.2: DONE, 2.3: DONE

[radarek (Radosław Bułat)]

Test file bug.rb:

require "ripper"

puts Dir['**/**.rb'].find_all { |f| Ripper.sexp(File.read(f)) == nil }

$ make runruby TESTRUN_SCRIPT=bug.rb
./miniruby -I./lib -I. -I.ext/common  ./tool/runruby.rb --extout=.ext  -- --disable-gems bug.rb
lib/net/imap.rb
lib/open-uri.rb
lib/rexml/text.rb
test/ruby/test_m17n.rb
test/ruby/test_regexp.rb

I didn't find any info in documentation anout returning nil so I assume this is not intended behavior.

[radarek (Radosław Bułat)]

• File reduced_imap.rb reduced_imap.rb added
• File reduced_m17n.rb reduced_m17n.rb added
• File reduced_open-uri.rb reduced_open-uri.rb added
• File reduced_regexp.rb reduced_regexp.rb added
• File reduced_text.rb reduced_text.rb added

I reduced buggy files. Seems it's related to parsing regexp.

[radarek (Radosław Bułat)]

• Subject changed from Ripper.sexp can't parse some files from it's repository and returns nil to Ripper.sexp can't parse some files from ruby repository and returns nil

[nobu (Nobuyoshi Nakada)]

• Status changed from Open to Closed

Applied in changeset r53409.

---

parse.y: yylval.num should be u3

• parse.y (set_yylval_num): should be used as nd_state, set to u3.
  [ruby-core:72638] [Bug #11932]

[nobu (Nobuyoshi Nakada)]

• Backport changed from 2.0.0: UNKNOWN, 2.1: UNKNOWN, 2.2: UNKNOWN, 2.3: UNKNOWN to 2.0.0: DONTNEED, 2.1: DONTNEED, 2.2: REQUIRED, 2.3: REQUIRED

[nagachika (Tomoyuki Chikanaga)]

• Backport changed from 2.0.0: DONTNEED, 2.1: DONTNEED, 2.2: REQUIRED, 2.3: REQUIRED to 2.0.0: DONTNEED, 2.1: DONTNEED, 2.2: DONE, 2.3: REQUIRED

r53411 and r53425 were backported into ruby_2_2 branch at r53824.

[naruse (Yui NARUSE)]

• Backport changed from 2.0.0: DONTNEED, 2.1: DONTNEED, 2.2: DONE, 2.3: REQUIRED to 2.0.0: DONTNEED, 2.1: DONTNEED, 2.2: DONE, 2.3: DONE

ruby_2_3 r54350 merged revision(s) 53411,53425.