How to provide unstructured api key and api url in S3FileLoader?

[dchwong]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

from langchain_community.document_loaders.s3_file import S3FileLoader


        loader = S3FileLoader(
            settings.AWS_STORAGE_BUCKET_NAME,
            key,
            aws_access_key_id=settings.AWS_S3_ACCESS_KEY_ID,
            aws_secret_access_key=settings.AWS_S3_SECRET_ACCESS_KEY,
            endpoint_url=f'{settings.AWS_S3_ENDPOINT_URL}',
        )

Description

I would like to use my api key and url for my paid unstructured subscription.

System Info

langchain==0.1.13
langchain-cohere==0.1.0rc1
langchain-community==0.0.29
langchain-core==0.1.36
langchain-openai==0.1.1
langchain-text-splitters==0.0.1

[dosubot[bot]]

It looks like you're configuring the S3FileLoader correctly by specifying the aws_access_key_id, aws_secret_access_key, and endpoint_url. These parameters are essential for authenticating with the AWS S3 service and specifying the endpoint URL for your paid unstructured subscription.

Here's a concise guide on how to use these parameters:

• aws_access_key_id and aws_secret_access_key: These credentials allow the S3FileLoader to authenticate with AWS S3. They are necessary unless the SDK can find credentials in your environment or AWS credentials file.

• endpoint_url: This parameter should be set to the URL provided by your paid unstructured subscription. It's the entry point for AWS web service requests.

Ensure you replace the placeholders in the S3FileLoader initialization with your actual data:

from langchain_community.document_loaders import S3FileLoader

loader = S3FileLoader(
    "your_bucket_name", 
    "your_file_name.docx", 
    aws_access_key_id="your_access_key_id", 
    aws_secret_access_key="your_secret_access_key",
    endpoint_url="your_endpoint_url"
)

loader.load()

If you encounter any issues, such as error messages, please provide more details so we can offer a more precise solution.

For further information, you might find these resources helpful:

• S3FileLoader in langchain_community/document_loaders/s3_file.py
• Document Loaders in LangChain documentation

Let us know if you need more assistance!

Sources

• docs/docs/integrations/document_loaders/aws_s3_file.ipynb
• libs/community/langchain_community/document_loaders/s3_file.py

About Dosu

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.

[dchwong]

no, endpoint_url is not unstructured's endpoint

[DiegoPinochet]

did you find a solution? I have the same problem