RapidOcr causes merging of text while parsing.

[vishaldasnewtide]

Bug

While extracting text from several PDFs using Docling, most words are merged into a single entity without spaces.
...

Steps to reproduce

Extracted text:

Docling version

2.32.0
...

Python version

3.11.9
...

[cau-git]

Hi @vishaldasnewtide, to allow proper reproduction please provide the original input file and conversion settings.

[vishaldasnewtide]

AlexandriaObol.pdf

Hi @cau-git, Sure

def _initialize_converter(self) -> None:
        """Initialize the document converter with appropriate settings."""
        pdf_pipeline_options = None
        if self.optimize_pdf:
            # Configure RapidOCR with GPU acceleration
            pdf_pipeline_options = PdfPipelineOptions(ocr_options=RapidOcrOptions())
            pdf_pipeline_options.do_ocr = self.enable_ocr
            pdf_pipeline_options.do_table_structure = True
            pdf_pipeline_options.table_structure_options.do_cell_matching = True

            # Configure accelerator to use CUDA explicitly
            pdf_pipeline_options.accelerator_options = AcceleratorOptions(
                num_threads=self.pdf_threads,
                device=AcceleratorDevice.AUTO,
                cuda_use_flash_attention2=True
            )

        # Create converter instance with separate PDF and image options
        self.converter = DoclingConverter(
            allowed_formats=[
                InputFormat.PDF,
                InputFormat.IMAGE,
                InputFormat.DOCX,
                InputFormat.HTML,
                InputFormat.PPTX,
                InputFormat.ASCIIDOC,
                InputFormat.CSV,
                InputFormat.MD,
                InputFormat.XLSX
            ],
            format_options={
                InputFormat.PDF: PdfFormatOption(
                    pipeline_cls=StandardPdfPipeline,
                    backend=PyPdfiumDocumentBackend,
                    pipeline_options=pdf_pipeline_options
                ),
                InputFormat.DOCX: WordFormatOption(
                    pipeline_cls=SimplePipeline
                ),
                InputFormat.IMAGE: ImageFormatOption(
                    pipeline_cls=StandardPdfPipeline,
                    backend=PyPdfiumDocumentBackend,
                    pipeline_options=pdf_pipeline_options
                ),

            },
        )

[vishaldasnewtide]

@cau-git Now I am facing this issue

"C:\Users\Admin\AppData\Local\pypoetry\Cache\virtualenvs\risingtidevectorsearch-ryepBKyc-py3.11\Lib\site-packages\docling_ibm_models\layoutmodel\layout_predictor.py", line 92, 
in __init__ ).to(self._device) ^^^^^^^^^^^^^^^^ 
File "C:\Users\Admin\AppData\Local\pypoetry\Cache\virtualenvs\risingtidevectorsearch-ryepBKyc-py3.11\Lib\site-packages\transformers\modeling_utils.py", 
line 3850, in to return super().to(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 
File "C:\Users\Admin\AppData\Local\pypoetry\Cache\virtualenvs\risingtidevectorsearch-ryepBKyc-py3.11\Lib\site-packages\torch\nn\modules\module.py", line 1343, 
in to return self._apply(convert) ^^^^^^^^^^^^^^^^^^^^ 
File "C:\Users\Admin\AppData\Local\pypoetry\Cache\virtualenvs\risingtidevectorsearch-ryepBKyc-py3.11\Lib\site-packages\torch\nn\modules\module.py", line 903, 
in _apply module._apply(fn) File "C:\Users\Admin\AppData\Local\pypoetry\Cache\virtualenvs\risingtidevectorsearch-ryepBKyc-py3.11\Lib\site-packages\torch\nn\modules\module.py", 
line 903, in _apply module._apply(fn) 
File "C:\Users\Admin\AppData\Local\pypoetry\Cache\virtualenvs\risingtidevectorsearch-ryepBKyc-py3.11\Lib\site-packages\torch\nn\modules\module.py", line 903,
 in _apply module._apply(fn) [Previous line repeated 4 more times]
 File "C:\Users\Admin\AppData\Local\pypoetry\Cache\virtualenvs\risingtidevectorsearch-ryepBKyc-py3.11\Lib\site-packages\torch\nn\modules\module.py", line 930, 
 in _apply param_applied = fn(param) ^^^^^^^^^ File "C:\Users\Admin\AppData\Local\pypoetry\Cache\virtualenvs\risingtidevectorsearch-ryepBKyc-py3.11\Lib\site-packages\torch\nn\modules\module.py", 
 line 1336, 
 in convert raise NotImplementedError( NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() 
 instead of torch.nn.Module.to() when moving module from meta to a different device.",