GoogleDriveLoader : Add to load docs in SHARED SHORTCUT FOLDERS

[AnonymousVibrate]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

from langchain_community.vectorstores import FAISS
from langchain_huggingface import HuggingFaceEmbeddings
from langchain.text_splitter import RecursiveCharacterTextSplitter
from langchain.document_loaders import GoogleDriveLoader

DB_FAISS_PATH = './Vectorstore/db_faiss'
acckey = r'Keys.json'



def get_vectorstore_from_url():
    # get the text in document form
    loader = GoogleDriveLoader(
        folder_id='xxxxxxxxx',
        service_account_key=acckey,
        file_types=['document', 'sheet'],
        recursive=True,
    )
    
    document = loader.load()

    # split the document into chunks
    text_splitter = RecursiveCharacterTextSplitter(chunk_size=3000, chunk_overlap=500, separators='\n\n')
    document_chunks = text_splitter.split_documents(document)
    
    embeddings = HuggingFaceEmbeddings(model_name='sentence-transformers/all-MiniLM-L6-v2', model_kwargs={'device': 'cpu'})
    # create a vectorstore from the chunks

    vector_store = FAISS.from_documents(document_chunks, embeddings)
    vector_store.save_local(DB_FAISS_PATH)

    #new_db = FAISS.load_local(DB_FAISS_PATH, embeddings, allow_dangerous_deserialization=True)
    #return new_db
    return vector_store


get_vectorstore_from_url()
print('SUCCESS')

`

Description

The recursive=True seems applicable only to a folders you created, I was trying to add SHARED SHORTCUT FOLDER by the other users but it seems like it doesn't load up the docs.

System Info

windows 11 PRO
python version 3.12.4 64bit