creating config.pbtxt automatically

[robosina]

Is it possible to create the config.pbtxt automatically from the engine file, since the binding can already be exposed from the engine files? I want to integrate an encoder-decoder model using this backend, but it seems that it might not be as straightforward at first glance. Therefore, I was thinking about automating tasks such as creating things automatically. Also, if you have any documentation on hand about encoder-decoder and if in the current state of the backend is it possible to integrate an encoder-decoder example for it, I would appreciate it if you could share it with us.

[symphonylyh]

Hi @robosina , we're working on adding enc-dec to Triton backend. Since it needs C++ runtime for enc-dec as a pre-requisite, we're prioritizing the C++ runtime first. Will ping this thread after it's done.

You suggestion on auto generating config.pbtxt is great, but I think it has to remain manual for a while before we change that for all models.

[robosina]

@byshiue @symphonylyh Sorry for pinging you. About this part:

we're working on adding enc-dec to Triton backend. Since it needs C++ runtime for enc-dec as a pre-requisite, we're prioritizing the C++ runtime first. Will ping this thread after it's done.

I'm interested in how I can collaborate on this matter. Can I open a branch and get some help from you for the implementation of this if your schedule is full? I just need a few some small hints to get started, I would appreciate your responses.