Cancel the request to the server, the server will be broken down

[JonSmall]

When I use Postman to send a JSON message via the API /v2/models/${model}/generate, if there is a network issue or I cancel the request to the server, the server will be broken down, I feel little confused, i do nothing to the server, i just close the client, why and how can i sovle this problem.

Here is the error message below

Signal (11) received.
Signal (11) received.
0# 0x0000556EFB9CD13D in /opt/tritonserver/bin/tritonserver
1# 0x000014FC721A2520 in /usr/lib/x86_64-linux-gnu/libc.so.6
2# 0x0000556EFC106614 in /opt/tritonserver/bin/tritonserver
3# 0x0000556EFC0F537D in /opt/tritonserver/bin/tritonserver
4# 0x0000556EFBB1A9BE in /opt/tritonserver/bin/tritonserver
5# 0x0000556EFBB1AB55 in /opt/tritonserver/bin/tritonserver
6# 0x0000556EFC0FBE23 in /opt/tritonserver/bin/tritonserver
7# 0x0000556EFC10F8A7 in /opt/tritonserver/bin/tritonserver
8# 0x0000556EFC110197 in /opt/tritonserver/bin/tritonserver
9# 0x0000556EFC0FBD62 in /opt/tritonserver/bin/tritonserver
10# 0x000014FC721F4AC3 in /usr/lib/x86_64-linux-gnu/libc.so.6
11# clone in /usr/lib/x86_64-linux-gnu/libc.so.6

---

Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.

I1201 04:57:31.222771 17374 pb_stub.cc:1815] Non-graceful termination detected.
I1201 04:57:31.223891 17375 pb_stub.cc:1815] Non-graceful termination detected.

mpirun noticed that process rank 0 with PID 0 on node 2726b37cb579 exited on signal 11 (Segmentation fault).

[nnshah1]

I believe this is related to: triton-inference-server/server#6576
For both generate and generate_stream - there was a possibility that the client is disconnected before the responses were sent - and this led to a fault.

This has been resolved and will be available in the 23.12 Triton release.