In langchain_google_community there is an issue with GmailToolkit Search

[Honolulu578]

Failed to interact with Gmail agent: 'utf-8' codec can't decode byte 0xa9.
Issue lies in _parse_messages method, you can see there is already a try/except block for multipart messages (i.e., it falls back to "latin-1" if decoding with UTF-8 fails). However, if the message is not multipart, it always uses UTF-8—and that is what triggers the exception for non-UTF8 data.

If the email data is not truly UTF-8, a UnicodeDecodeError will crash here, because there is no fallback like in the multipart case.

[Honolulu578]

I would do this instead:
else:
try:
message_body = email_msg.get_payload(decode=True).decode("utf-8")
except UnicodeDecodeError:
# Fallback to 'latin-1' or 'replace' as needed:
message_body = email_msg.get_payload(decode=True).decode("latin-1")

[dosubot[bot]]

Hey @Honolulu578! I'm here to help with any coding hiccups you encounter. I can assist with bug fixes, answer questions, and even guide you on becoming a contributor. Let me know how I can assist you!

A similar issue has been discussed, where the _parse_messages method in GmailToolkit was modified to handle non-UTF-8 encoded email data without causing a UnicodeDecodeError. The solution involved trying multiple encodings and falling back to a default if necessary. Here's a suggested approach:

else:
    payload = email_msg.get_payload(decode=True)
    for encoding in ["utf-8", "latin-1", "ascii"]:
        try:
            message_body = payload.decode(encoding)
            break
        except UnicodeDecodeError:
            continue
    if not message_body:
        message_body = payload.decode("utf-8", errors="replace")

This code attempts to decode the email payload using a list of encodings ("utf-8", "latin-1", "ascii"), and if all fail, it uses "utf-8" with error replacement to ensure no UnicodeDecodeError is raised ^[1].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}