Skip to content

Conversation

@TeddyCr
Copy link

@TeddyCr TeddyCr commented Nov 26, 2025

Motivation and Context

Working with BedrockLLMClient, I noticed some timeout issues between Koog and bedrock (SocketTimeoutError).
It appears, from my understanding and investigation, the timeout config set in the BedrockLLMClient was not propagated to the HttpClient of the BedrockRuntimeClient.

Breaking Changes


Type of the changes

  • New feature (non-breaking change which adds functionality)
  • Bug fix (non-breaking change which fixes an issue)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Documentation update
  • Tests improvement
  • Refactoring

Checklist

  • The pull request has a description of the proposed change
  • I read the Contributing Guidelines before opening the pull request
  • The pull request uses develop as the base branch
  • Tests for the changes have been added
  • All new and existing tests passed
Additional steps for pull requests adding a new feature
  • An issue describing the proposed change exists
  • The pull request includes a link to the issue
  • The change was discussed and approved in the issue
  • Docs have been added / updated

From initial investigation, it appeared the aws bedrock client was not
properly set with the timeout configuration set in the Koog BedrockLLMClient
@TeddyCr TeddyCr changed the title fix: properly pass bedrock timeout setting to bedrockClient fix: properly pass BedrockLLMClient timeout setting to BedrockRuntimeClient.HttpClient Nov 26, 2025
@kpavlov kpavlov added the bugfix Something was fixed 🎉 label Nov 26, 2025
… validation

- `BedrockLLMClient.bedrockClient` is now internal
- Configure `callTimeout=settings.requestTimeoutMillis`
- Fixed test, now it's testing the actual values. Test maxAttempts and requestTimeouts
@kpavlov kpavlov force-pushed the TeddyCr/minor-pass-bedrock-timeout-to-client branch from b1fd4c2 to 9e8d04c Compare November 26, 2025 16:16
Copy link
Contributor

@kpavlov kpavlov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @TeddyCr
I also added the callTimeout configuration and improved unit test a bit

@TeddyCr
Copy link
Author

TeddyCr commented Nov 26, 2025

Thank you @TeddyCr I also added the callTimeout configuration and improved unit test a bit

Awesome. Thank you @kpavlov

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bugfix Something was fixed 🎉

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants