Feature #16352

Updated by shyouhei (Shyouhei Urabe) about 2 years ago

 Using a gem to handle matrix operations called Numo-array I found the following error when save large matrix: 
 in `dump': long too big to dump (TypeError) 
 Github thread: 
 Digging with the authors, we found the following code that reproduces the error: 
 ruby -e 'Marshal.dump(" "*2**31)' 
 Executed in : 
 ruby 2.7.0dev (2019-11-12T12:03:22Z master 3816622fbe) [x86_64-linux] 

 The marshal library    has a limit that is checked with the SIZEOF_LONG constant. This check is performed in this line to 321 of the Marshal.c file. I don't understand the motivation of this limit and has a great impact in libraries that need to serialize large objects as numeric matrix. In this case, the limit of    >= 2 GiB it's reached easily and it blocks the ruby development in scientifical projects as cited. I found other bug related: #1560, but the Marshal problem itself was not addressed in this case. 
 Thank you in advance 
 PEdro Seoane