Skip to content

[Enhancement] Update OSCAR responses with inference parameters #93

Description

@peterzhuamazon

Hi,

Like many model hosting services bedrock allows you to tweak the inference parameters.
https://docs.aws.amazon.com/bedrock/latest/userguide/inference-parameters.html

As an example, my local coding agent set temperature to 0.7 to be more strict and logical, while general thinking is on 1.0, and creative task on 1.2.

We should explore this area so that each agent can be tuned with specific inference parameters, and maybe even fixed seed to guarantee responses to be the same if given same inputs.

Thanks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Status
    Backlog
    Status
    🆕 New

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions