Feature #12928
openUse socket conect_timeout in net stdlib for open_timeout
Description
Current net/http and net/pop use Timeout.timeout to tigger open_timeout event.
Timeout.timeout is slow. It will create and destroy a thread every time.
Timeout.timeout is also dangerous. see [[http://www.mikeperham.com/2015/05/08/timeout-rubys-most-dangerous-api/]]
It is more effective and safe to use socket timeout to accomplish this.
Follow is the changes need to do.
- Replace TCPSocket.open with Socket.new
- Use socket.connect_nonblock and IO.select to connect and trigger timeout event.
The pull request is here:
[[https://github.com/ruby/ruby/pull/1480]]
Updated by xiewenwei (xie wenwei) almost 8 years ago
The codes are updated. I use Socket.tcp now. Socket.tcp returns Socket instance. So I need to convert it to TCPSocket instance using TCPSocket.for_fd.
Updated by normalperson (Eric Wong) almost 8 years ago
xiewenwei@gmail.com wrote:
net/http, net/pop, net/smtp and net/ftp use
Timeout.timeout
to calculate connect_timeout.
Timeout.timeout is slow. It creates and destroys a thread every time.
Timeout.timeout is also dangerous. see Timeout: Ruby's Most Dangerous API
I agree with eliminating Timeout, but I don't think your
solution is enough because it does not cover timeouts for
DNS resolution (getaddrinfo(3) calls).
For timeouts, we would need to use resolv.rb instead of getaddrinfo(3)
provided by libc to do timeouts without a separate thread. I started
adding timeouts to resolv.rb last year but can't remember how far I got...
I'm not sure if resolv.rb supports all the features of a modern
getaddrinfo(3), either, AFAIK, not many people use resolv.rb.
It is more effective and safe to use socket timeout to accomplish that.
Follow is the changes need to do.
- Replace
TCPSocket.open
withSocket.tcp
- Create
TCPSocket
withTCPSocket.for_fd
I don't think this step should be necessary; Socket and
TCPSocket should be usable interchangeably for stream sockets
(maybe some API calls need to be changed, but I'd rather avoid
the extra object entirely).
Updated by xiewenwei (xie wenwei) almost 8 years ago
- Subject changed from Use socket timeout for net/http and net/pop for open_timeout to Use socket conect_timeout for net stdlib for open_timeout
I changed the codes. Removed TCPSocket.for_fd and used socket directly now.
But I am no idea for DNS resolution timeout. How to fix it?
Updated by xiewenwei (xie wenwei) almost 8 years ago
- Subject changed from Use socket conect_timeout for net stdlib for open_timeout to Use socket conect_timeout in net stdlib for open_timeout
Updated by shugo (Shugo Maeda) almost 8 years ago
- Related to Feature #12435: Using connect_nonblock to open TCP connections in Net::HTTP#connect added
Updated by xiewenwei (xie wenwei) almost 8 years ago
I got it. It is not simple to fix as I expected before. Thank you.
Updated by dylants (Dylan Thacker-Smith) almost 5 years ago
It looks like we can now use the resolv_timeout
Socket.tcp
option that was recently added by https://bugs.ruby-lang.org/projects/ruby-trunk/repository/git/revisions/0e9d56f5e73ed2fd8e7c858fdea7b7d5b905bb64.
The only complication with trying to use Socket.tcp
now would be that it has two separate timeouts that are specified at the same time, but the net stdlib uses a combine open timeout that include DNS resolving and TCP connecting. Preserving that behaviour would mean using the open timeout for DNS resolution, then using the remaining time for the connect timeout. Doing this outside Socket.tcp
would mean duplicating a lot of the code in that method.
Should we add a combined timeout
option to Socket.tcp` so we can easily use that in the net stdlib's open timeouts?