[DocDB] FastUInt32ToBufferLeft core dump

[pilshchikov]

Jira Link: DB-14728

Description

Case:

1. Run 3 nodes, RF=3 cluster, 2 CPU, 8 RAM
2. Load with 2 concurrent workloads for 3 hours, keep CPU load at 90% and with almost fully used RAM
   Core dump was thrown:

(lldb) target create "/home/yugabyte/yb-software/yugabyte-2024.1.4.0-b106-almalinux8-aarch64/bin/yb-server" --core "/home/yugabyte/cores/core_40451_1735813070_!home!yugabyte!yb-software!yugabyte-2024.1.4.0-b106-almalinux8-aarch64!bin!yb-server"
Core file '/home/yugabyte/cores/core_40451_1735813070_!home!yugabyte!yb-software!yugabyte-2024.1.4.0-b106-almalinux8-aarch64!bin!yb-server' (aarch64) was loaded.
(lldb) bt all
* thread #1, name = 'yb-tserver', stop reason = signal SIGABRT
 ....
    frame #0: 0x0000aaaadf5fe15c yb-server`FastUInt32ToBufferLeft(u=49681067, buffer="") at numbers.cc:979:17
    frame #1: 0x0000aaaadff30644 yb-server`yb::rpc::OutboundCall::SetTimedOut() [inlined] FastInt32ToBufferLeft(i=<unavailable>, buffer=<unavailable>) at numbers.cc:1050:10
    frame #2: 0x0000aaaadff3062c yb-server`yb::rpc::OutboundCall::SetTimedOut() [inlined] decltype(auto) yb::IntToBuffer<int>(value=<unavailable>, buffer="") at tostring.h:101:12
    frame #3: 0x0000aaaadff3062c yb-server`yb::rpc::OutboundCall::SetTimedOut() at format.h:51:16
    frame #4: 0x0000aaaadff3062c yb-server`yb::rpc::OutboundCall::SetTimedOut() [inlined] yb::internal::FormatTuple<int>::FormatTuple(this=0x0000ffffa0aa68e8, current=0x000017bf6e889270) at format.h:118:9
    frame #5: 0x0000aaaadff3062c yb-server`yb::rpc::OutboundCall::SetTimedOut() [inlined] yb::internal::FormatTuple<yb::MonoDelta, int>::FormatTuple(this=<unavailable>, current=<unavailable>, args=0x000017bf6e889270) at format.h:138:26
    frame #6: 0x0000aaaadff3060c yb-server`yb::rpc::OutboundCall::SetTimedOut() [inlined] yb::internal::FormatTuple<boost::asio::ip::basic_endpoint<boost::asio::ip::tcp>, yb::MonoDelta, int>::FormatTuple(this=<unavailable>, current=<unavailable>, args=<unavailable>, args=0x000017bf6e889270) at format.h:138:26
    frame #7: 0x0000aaaadff305c0 yb-server`yb::rpc::OutboundCall::SetTimedOut() [inlined] yb::internal::FormatTuple<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, boost::asio::ip::basic_endpoint<boost::asio::ip::tcp>, yb::MonoDelta, int>::FormatTuple(this=0x0000ffffa0aa68a0, current=<unavailable>, args=<unavailable>, args=<unavailable>, args=0x000017bf6e889270) at format.h:138:26
    frame #8: 0x0000aaaadff3054c yb-server`yb::rpc::OutboundCall::SetTimedOut() [inlined] std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> yb::internal::FormatImpl<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, boost::asio::ip::basic_endpoint<boost::asio::ip::tcp>, yb::MonoDelta, int>(format=<unavailable>, args=<unavailable>, args=<unavailable>, args=<unavailable>, args=0x000017bf6e889270) at format.h:208:24
    frame #9: 0x0000aaaadff3054c yb-server`yb::rpc::OutboundCall::SetTimedOut() [inlined] std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> yb::Format<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, boost::asio::ip::basic_endpoint<boost::asio::ip::tcp>, yb::MonoDelta, int>(format=<unavailable>, args=<unavailable>, args=<unavailable>, args=<unavailable>, args=0x000017bf6e889270) at format.h:224:10
    frame #10: 0x0000aaaadff3054c yb-server`yb::rpc::OutboundCall::SetTimedOut(this=0x000017bf6e889200) at outbound_call.cc:637:19

All logs and full core dump in JIRA ticket comments

Issue Type

kind/bug

Warning: Please confirm that this issue does not contain any sensitive information

• I confirm this issue does not contain any sensitive information.