Hi,
Like many model hosting services bedrock allows you to tweak the inference parameters.
https://docs.aws.amazon.com/bedrock/latest/userguide/inference-parameters.html
As an example, my local coding agent set temperature to 0.7 to be more strict and logical, while general thinking is on 1.0, and creative task on 1.2.
We should explore this area so that each agent can be tuned with specific inference parameters, and maybe even fixed seed to guarantee responses to be the same if given same inputs.
Thanks.
Hi,
Like many model hosting services bedrock allows you to tweak the inference parameters.
https://docs.aws.amazon.com/bedrock/latest/userguide/inference-parameters.html
As an example, my local coding agent set temperature to 0.7 to be more strict and logical, while general thinking is on 1.0, and creative task on 1.2.
We should explore this area so that each agent can be tuned with specific inference parameters, and maybe even fixed seed to guarantee responses to be the same if given same inputs.
Thanks.