-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Open
Description
Description
When running a FIL backend deployment, tritonserver fails to start with the following error
failed to load 'example' version 1: Not found: unable to load shared library: librapids_logger.so: cannot open shared object file: No such file or directory
A search for this file also returned no matches:
$ find / -name 'librapids_logger.so'
$
Triton Information
What version of Triton are you using? 25.08
Are you using the Triton container or did you build it yourself? Container nvcr.io/nvidia/tritonserver:25.08-py3
To Reproduce
- Train lightgbm model
- Save weights into models/example/1/model.json
- Create a config at models/example/config.pbtxt
- Run
docker run --rm -it -v $(pwd)/models:/models nvcr.io/nvidia/tritonserver:25.08-py3
- Run
tritonserver --model-repository=/models
Describe the models (framework, inputs, outputs), ideally include the model configuration file (if using an ensemble include the model configuration file for that as well).
config.pbtxt
backend: "fil"
max_batch_size: 32768
input [
{
name: "input__0"
data_type: TYPE_FP32
dims: [ 4 ]
}
]
output [
{
name: "output__0"
data_type: TYPE_FP32
dims: [ 1 ]
}
]
instance_group [{ kind: KIND_AUTO }]
parameters [
{
key: "model_type"
value: { string_value: "lightgbm" }
},
{
key: "output_class"
value: { string_value: "true" }
}
]
dynamic_batching {}
Expected behavior
The server should run and serve the model.
Metadata
Metadata
Assignees
Labels
No labels