Skip to content

Endpoint address in the spark operator example #127

@n9986

Description

@n9986

Expected Behavior

The fs.s3a.endpoint should point to 127.0.0.1 so it addresses the sidecar.

Current Behavior

The documentation says:

Obtain the IP address and port of the minio service. Use them as input to fs.s3a.endpoint the below SparkApplication. e.g. [http://10.43.141.149:80](http://10.43.141.149/)

Possible Solution

Am I wrong about this or does the sidecar automatically intercept any endpoint IP address?

Steps to Reproduce (for bugs)

N/A

Context

This is confusing as the past versions of this repository show 127.0.0.1 as the endpoint address in the Spark S3 settings.

Regression

N/A

Your Environment

N/A

Metadata

Metadata

Assignees

No one assigned

    Labels

    communityall incoming issuestriageall incoming issues in triage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions