Skip to content

Feature Request: Convert PDF to Markdown inside Chat UI #441

Closed
@julien-blanchon

Description

@julien-blanchon

Feature Description:

I'd like to propose the following feature: Add a PDF to Markdown converter and they include this Markdown content directly in the chat. This feature would not only enhance the user experience but also provide a seamless way to discuss and reference content from PDFs, especially research papers.

It's worth noting that similar features exist in platforms like the Anthropic Claude 2 and Perplexity.AI interface. However, their implementations primarily focus on a basic text extraction, which often results in a lossy conversion. Specifically, with mathematical equations, tables, and other complex formatting are not retaine. My proposed implementation aims to address this limitation by ensuring a more comprehensive and lossless conversion using the Mathpix Paid API, and maybe other service in the future.

Design Implementation:

  • Dropdown on Hover: When a user hovers the chat form with a file, a dropdown menu will appear. This dropdown will provide an option to "Upload PDF".
  • Once the file is released this will send the file to be converted.
  • After the conversion, the markdown content will be append in the chat.

Example

demo (1)

Pull Request

#442

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions