Problem or motivation
Different parts of Nemantix may require different LLM with diverse capabilities: i.e., more powerful models for coding, and less capable for request resolution.
Proposed solution
A possible solution is to provide a configuration class that instantiates various LLM proxies for each capability: e.g., coding, internal usage (e..g, request resolution, deliberate selection, in/out extraction), etc.
NXS example (if applicable)
Alternatives considered
No response
Additional context
No response
Problem or motivation
Different parts of Nemantix may require different LLM with diverse capabilities: i.e., more powerful models for coding, and less capable for request resolution.
Proposed solution
A possible solution is to provide a configuration class that instantiates various LLM proxies for each capability: e.g., coding, internal usage (e..g, request resolution, deliberate selection, in/out extraction), etc.
NXS example (if applicable)
Alternatives considered
No response
Additional context
No response