ConfluenceLoader very slow when using the latest version of python-atlassian-api

[GTimothee]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

from langchain_community.document_loaders import ConfluenceLoader
import logging
import time

logging.info("- Processing page with ID {}...".format(page_id))
t = time.time()
loader = ConfluenceLoader(
    url="https://<domain>.atlassian.net/wiki/",
    username=os.getenv("confluence_username"),
    api_key=os.getenv("confluence_token"),
    space_key="<SPACE>",  # space in confluence that stores the documents
    page_ids=[page_id],
    limit=1,
        max_pages=1,
        keep_markdown_format=True,
        keep_newlines=True
    )
print(f"took {int(time.time()-t)} seconds to instanciate the object")

print("Pulling pages...")
t = time.time()
pages = loader.load()
logging.info("- retrieved {} pages".format(len(pages)))
print(f"took {int(time.time()-t)} seconds to run")

Description

Hi,

I found that there is a compatibility problem between langchain and atlassian python api 's last version. I am not sure if it is a bug from the atlassian library or just a need for langchain to update the way it requests Confluence.

When using the 4.0.4 version of the atlassian library it just takes forever (minutes!) to fetch a small confluence page. Even the ConfluenceLoader object creation takes like 5 seconds. When I downgrade to the 3.41.19 version suddently it takes 0 seconds to instantiate the object and 1 second to pull the page.

I guess investigating the root cause would help the community.

System Info

• I am using langchain-community==0.3.25
• langchain-community==0.2.14 and atlassian-python-api==3.41.19 is a bit slower (like 1 or 2s more) but it works.
• linux
• python 3.10

other langchain packages installed:

langchain==0.3.25
langchain-chroma==0.1.1
langchain-core==0.3.65
langchain-openai==0.3.23
langchain-text-splitters==0.3.8