AwsCredentialsFileException occasionally happens.

[i10416]

Dear maintainers,

First of all, thank you for this excellent library and your contributions to the Scala and Typelevel ecosystem.

In my work, I run several batch jobs on a daily basis in AWS ECS and AWS Batch that depend on the smithy4s AWS integration.
Occasionally, these jobs fail with the following error:

smithy4s.aws.AwsCredentialsFileException: Credentials file not found at '/root/.aws/credentials'

I’m not sure whether this is a bug in the smithy4s AWS runtime or if it’s caused by a delay in the AWS credentials setup (for example, when the workflow initializes AwsEnvironment before the credentials file becomes available).

If anyone has encountered the same issue, I would greatly appreciate any comments or advice.

[kubukoz]

It sounds bug-ish. Perhaps you can work around it by configuring the credentials provider to perform some retries?

You'd use:

• AwsCredentialsProvider.default (with a wrapper that adds retries)
• AwsEnvironment.make with the custom creds provider
• proceed to create a client normally

Alternatively, you can try to use the default cred provider, but with a slightly longer timeout. In ECS, as far as I know, the creds should be fetched using this code path, so maybe it's just failing to do so and falling back to files (which won't exist in ECS).

P.S. This seems to be #1464