KEP-2401: Create LLM Training Runtimes for Llama 3.1 model family

[Electronic-Waste]

What you would like to be added?

As we discussed in #2410 (comment), we should support Llama 3.1 model family in the initial stage.

This will resolve: #2212

/remove-label lifecycle/needs-triage
/area runtime

Why is this needed?

Scheduled in #2410

Love this feature?

Give it a 👍 We prioritize the features with most 👍

[andreyvelich]

@Electronic-Waste Could we start with support of Llama 3.2 initially ?
We might want to support legacy version of Llama models if we see requests from our users.

[Electronic-Waste]

@andreyvelich For sure, I'll start from Llama 3.2!

/area llm