Bug #20521: Memory leak in Ripper parsing

• Status: Closed
• Assignee: -
• Target version: -
• Backport: 3.1: DONTNEED, 3.2: DONTNEED, 3.3: DONE

[kddnewton (Kevin Newton)]

Currently, this code is leaking:

require "ripper"

source = <<~'RUBY'
<<-A; %w[j\
i
A
j]
RUBY

10.times do
  100_000.times do
    Ripper.sexp_raw(source)
  end

  puts `ps -o rss= -p #{$$}`
end

This results in:

 31584
 36304
 41504
 47008
 51712
 56384
 61088
 65792
 70480
 75200

I haven't managed to track it down, but I can see that 3.2.2 does not leak but 3.3.0 does leak.

[ufuk (Ufuk Kayserilioglu)]

Probably related to https://bugs.ruby-lang.org/issues/19835

[nobu (Nobuyoshi Nakada)]

• Backport changed from 3.1: UNKNOWN, 3.2: UNKNOWN, 3.3: UNKNOWN to 3.1: DONTNEED, 3.2: DONTNEED, 3.3: REQUIRED

[nobu (Nobuyoshi Nakada)]

• Related to Bug #18963: Ripper.tokenize(code).join != code when heredoc and multiline string is on the same line added

[nobu (Nobuyoshi Nakada)]

• Related to Bug #19835: Parser leaks memory for incomplete tokens added

[nobu (Nobuyoshi Nakada)]

• Status changed from Open to Closed

Applied in changeset git|27321290d954300192c82cdf5e2c794a695473f5.

---

[Bug #20521] ripper: Clean up strterm

[k0kubun (Takashi Kokubun)]

• Backport changed from 3.1: DONTNEED, 3.2: DONTNEED, 3.3: REQUIRED to 3.1: DONTNEED, 3.2: DONTNEED, 3.3: DONE

ruby_3_3 23f4b78ad8844ec81cb02fad25a6247a2d498582 merged revision(s) 27321290.