How to debug credetials not loaded issue?

[vbmade2000]

Here is my code.

pub async fn new_retriable_s3_client() -> aws_sdk_s3::Client {
    let testing = false;

    let credentials_provider = DefaultCredentialsChain::builder().build().await;

    // RetryConfig is required if we need a client that retries on failure.
    let retry_config = aws_sdk_s3::config::retry::RetryConfig::standard()
        .with_max_attempts(3)
        .with_initial_backoff(Duration::from_secs(10));

    let region_provider = RegionProviderChain::default_provider()
        .or_else(aws_types::region::Region::new("eu-west-1"));

    let sdk_config = aws_config::from_env().region(region_provider).load().await;

    let mut s3_config_builder =
        aws_sdk_s3::config::Builder::from(&sdk_config).credentials_provider(credentials_provider);
    s3_config_builder.set_retry_config(Some(retry_config));

    if testing {
        s3_config_builder = s3_config_builder.endpoint_url("http://localhost:9000");
    }
    aws_sdk_s3::Client::from_conf(s3_config_builder.build())
}

This code throws credentials cache returned CredentialsNotLoaded. There is a method called provide_credentials of the trait ProvideCredentials but despite of importing the trait in the scope, it is not working.

Because of this issue, I am getting S3 operation timed out (500) while uploading files to S3 bucket. Please guide me through how to debug/resolve the issue.

[rcoh]

is there a reason you're overriding the credentials provider with the default provider? I don't think that would do anything. If you're trying to get something to work locally, I'd suggest s3_config.builder.credentials_provider(Credentials::for_tests()) in the if testing block.

In general, the best way to debug the SDK is using tracing—

tracing_subscriber::fmt::init()

Then, rerun with RUST_LOG=debug set.

However, if the operation timed out, that implies that you aren't able to actually connect to S3–if credentials couldn't be loaded, it would fail-fast with a different error.

[vbmade2000]

I thought it is required to provide some CredentialsProvider explicitly. If I don't provide it explicitly, would it create a default provider automatically?

Testing is something I am going to tackle later but I have noted your suggestion. Thanks.

I already receive following logs but they are not much helpful.

{"msg":"lazy_load_credentials;","level":"INFO","ts":"2023-05-23T06:06:09.375","tag":"tracing::span"} 
{"msg":"-> lazy_load_credentials;","level":"TRCE","ts":"2023-05-23T06:06:09.375","tag":"tracing::span::active"} 
{"msg":"<- lazy_load_credentials;","level":"TRCE","ts":"2023-05-23T06:06:09.375","tag":"tracing::span::active"} 
{"msg":"-- lazy_load_credentials;","level":"TRCE","ts":"2023-05-23T06:06:09.375","tag":"tracing::span"} 
{"msg":"credentials cache miss occurred; retrieved new AWS credentials (took 30.205µs)","level":"INFO","ts":"2023-05-23T06:06:09.376","tag":"aws_credential_types::cache::lazy_caching"} 
{"msg":"load_region; provider=DefaultRegionChain(RegionProviderChain { providers: [EnvironmentVariableRegionProvider { env: Env(Real) }, ProfileFileRegionProvider { provider_config: ProviderConfig { env: Env(Real), fs: Fs(Real), sleep: Some(TokioSleep), region: None } }, ImdsRegionProvider { client: LazyClient { client: OnceCell { value: None }, builder: Builder { max_attempts: None, endpoint: None, mode_override: None, token_ttl: None, connect_timeout: None, read_timeout: None, config: Some(ProviderConfig { env: Env(Real), fs: Fs(Real), sleep: Some(TokioSleep), region: None }) } }, env: Env(Real) }] })","level":"INFO","ts":"2023-05-23T06:06:12.929","tag":"aws_config::meta::region"} 
{"msg":"-> load_region;","level":"TRCE","ts":"2023-05-23T06:06:12.929","tag":"tracing::span::active"} 
{"msg":"load_region; provider=EnvironmentVariableRegionProvider { env: Env(Real) }","level":"INFO","ts":"2023-05-23T06:06:12.930","tag":"aws_config::meta::region"} 

Do I still have to call tracing_subscriber::fmt::init()?

[vbmade2000]

@rcoh It is working now. Thanks for the help. Closing discussion now.

[github-actions[bot]]

Hello! Reopening this discussion to make it searchable.