Project

General

Profile

Actions

Feature #14426

closed

[PATCH] openssl: reduce memory allocation in OpenSSL::Buffering#do_write

Added by janko (Janko Marohnić) about 6 years ago. Updated over 5 years ago.

Status:
Closed
Target version:
-
[ruby-core:85298]

Description

When writing data to an SSLSocket, there are a lot of, in my opinion, unnecessary strings being allocated, concretely in OpenSSL::Buffering#do_write.

When the buffer would be written, it would always be copied into a new string first, regardless of whether the write was partial or not. And in case of partial writes, it's not necessary to create copies of remaining data, we could just use the String[from, length] = "" trick immediately which modifies the string in-place.

I also thought that splitting writes on newlines was adding unnecessary memory allocations, so I removed that.

I tested uploading a 5MB file using HTTP.rb, and memory allocation went from 7.7 MB to 0.2 MB with this change.

require "http"
require "memory_profiler"
require "stringio"

body = StringIO.new("a" * 5*1024*1024)

MemoryProfiler.report do
  HTTP.post("https://example.com", body: body)
end.pretty_print

Files

openssl-memory-allocation.patch (913 Bytes) openssl-memory-allocation.patch janko (Janko Marohnić), 07/07/2018 05:04 PM
Actions

Also available in: Atom PDF

Like0
Like0Like0Like0Like0Like0Like0Like0