How to configure Embabel 0.3.0 with snowflake cortex OpenAI-compatible LLM endpoint in a Spring Boot Java project

[RanjanJadhav]

Hi All,

I'm integrating Embabel 0.3.0 into a Java Spring Boot aaplication and want to use it as the orchestrator, with Snowflake Cortex as the LLM provider.

Snowflake Cortex exposes an OpenAI-compatible base URL and API keys/PAT.

I am specifically seeking guidance on:

1. Can Embabel be configured with Snowflake Cortex as the LLM provider using its base URL and API keys/PAT ?
2. How exactly should the snowflake Cortex base URL and API key be set in Embabel's configuration ?
3. Is there a minimal working example (Java Spring Boot) that shows the integration ?

Any code examples or documentation links would be greatly appretiated.

Thank You

[alexheifetz]

Hi @RanjanJadhav, Embabel Framework provides mechanism for users to register OpenAiCompatbile Model Providers.

It can be done at the "user level", there is section in the user guide that talks about it:

Another option is to add Model Provider as an AutoConfiguration (Embabel Agent Framework can detect and bootstrap your Model Provider that way.

Sample code for that would be:

https://github.com/embabel/embabel-agent/blob/main/embabel-agent-autoconfigure/models/embabel-agent-gemini-autoconfigure/src/main/kotlin/com/embabel/agent/config/models/gemini/GeminiModelsConfig.kt