Why does the sdk always prepend the bucket name to the endpoint and look it up in DNS?

[deitch]

Using the sdk, if I set the endpoint to https://localhost, it just uses that as the endpoint; on the other hand, if I set it to https://127.0.0.1 (or almost any other endpoint), it always tries to prepend the bucket name, giving me errors like:

operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , request send failed, Put "http://mybucket.127.0.0.1//a/b/c/d?x-id=PutObject": dial tcp: lookup mybucket.127.0.0.1 on 127.0.0.53:53: no such host

I get the same if I set the endpoint to something made up like mybaddomaindoesnotexist.com or something real and resolvable like github.com. For localhost, it treats it specially.

Why does it always do the lookup of bucket.<endpoint>? Isn't the point of endpoint to be, "contact me here"?

Sample code (left out error-handling, etc):

        endpoint := "http://127.0.0.1:66554"
        bucket := "mybucket"
	cfg, err := config.LoadDefaultConfig(context.TODO(),
		config.WithEndpointResolver(
			aws.EndpointResolverFunc(func(service, region string) (aws.Endpoint, error) {
				return aws.Endpoint{URL: endpoint}, nil
			}),
		),
	)

	client := s3.NewFromConfig(cfg)
	uploader := manager.NewUploader(client)

	_, err = uploader.Upload(context.TODO(), &s3.PutObjectInput{
		Bucket: aws.String(bucket),
		Key:    aws.String("/path/to/put/object"),
		Body:   f,
	})

The above will try to look up mybucket.127.0.0.1 (and fail).

[RanVaknin]

Hi @deitch ,
This is because the new bucket endpoint paradigm is virtual hosted style url.
Its not clear what is the expectation from your question, but I assume you are aiming to format your URL as path style urls?
If so you need to explicitly enable this option because S3 has largely moved away from path style urls.
You can read more about it in my comment here.
Thanks,
Ran~
Answer:

[github-actions[bot]]

Hello! A team member has marked the above comment as the likely answer to this discussion thread.

• If you agree, please upvote that comment, or click on Mark as answer. I will automatically mark the comment as the answer next time I check.

• If this answer does not help you, please downvote the answer instead and let us know why it was not helpful. I will add a label to this discussion to gain attention from the team.

[github-actions[bot]]

Hello! Reopening this discussion to make it searchable.