成功安装，但第一次运行报错：权重类型不匹配，自动下载的模型是bfloat16，但需要的是float32。

[Ae01688]

报错信息：AssertionError: Variable dtype not match, Variable [ linear_164.w_0 ] need tensor with dtype paddle.float32 but load tensor with dtype paddle.bfloat16。

使用环境：
WSL - Ubuntu 24.04 - 虚拟环境 - CUDA版本 12.3 - 显卡 RTX2060

使用的安装命令：

python -m pip install paddlepaddle-gpu==3.2.0 -i https://www.paddlepaddle.org.cn/packages/stable/cu126/
python -m pip install -U "paddleocr[doc-parser]"
python -m pip install https://paddle-whl.bj.bcebos.com/nightly/cu126/safetensors/safetensors-0.6.2.dev0-cp38-abi3-linux_x86_64.whl

安装过程全程无报错。

测试报错的示例代码：

paddleocr doc_parser -i https://paddle-model-ecology.bj.bcebos.com/paddlex/imgs/demo_image/paddleocr_vl_demo.png

运行上述代码，可以正常下载模型，然后再设置模型权重的时候报错如下：

具体报错信息如下：
"""
(paddle_test) a6@rttPC:~/my_project$ paddleocr doc_parser -i https://paddle-model-ecology.bj.bcebos.com/paddlex/imgs/demo_image/paddleocr_vl_demo.png
/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddle/utils/cpp_extension/extension_utils.py:718: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
warnings.warn(warning_message)
Creating model: ('PP-DocLayoutV2', None)
Model files already exist. Using cached files. To redownload, please delete the directory manually: /home/ae666/.paddlex/official_models/PP-DocLayoutV2.
Creating model: ('PaddleOCR-VL-0.9B', None)
Model files already exist. Using cached files. To redownload, please delete the directory manually: /home/ae666/.paddlex/official_models/PaddleOCR-VL.
Loading configuration file /home/ae666/.paddlex/official_models/PaddleOCR-VL/PaddleOCR-VL-0.9B/config.json
Loading weights file /home/ae666/.paddlex/official_models/PaddleOCR-VL/PaddleOCR-VL-0.9B/model.safetensors
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
use GQA - num_heads: 16- num_key_value_heads: 2
/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddle/utils/decorator_utils.py:420: Warning:
Non compatible API. Please refer to https://www.paddlepaddle.org.cn/documentation/docs/en/develop/guides/model_convert/convert_from_pytorch/api_difference/torch/torch.split.html first.
warnings.warn(
Loaded weights file from disk, setting weights to model.
Traceback (most recent call last):
File "/home/ae666/my_project/paddle_test/bin/paddleocr", line 7, in
sys.exit(console_entry())
^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddleocr/main.py", line 26, in console_entry
main()
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddleocr/_cli.py", line 192, in main
_execute(args)
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddleocr/_cli.py", line 181, in _execute
args.executor(args)
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddleocr/_pipelines/paddleocr_vl.py", line 363, in execute_with_args
perform_simple_inference(
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddleocr/_utils/cli.py", line 62, in perform_simple_inference
wrapper = wrapper_cls(**init_params)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddleocr/_pipelines/paddleocr_vl.py", line 63, in init
super().init(**kwargs)
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddleocr/_pipelines/base.py", line 67, in init
self.paddlex_pipeline = self._create_paddlex_pipeline()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddleocr/_pipelines/base.py", line 105, in _create_paddlex_pipeline
return create_pipeline(config=self._merged_paddlex_config, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/pipelines/init.py", line 167, in create_pipeline
pipeline = BasePipeline.get(pipeline_name)(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/utils/deps.py", line 206, in _wrapper
return old_init_func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/pipelines/_parallel.py", line 103, in init
self._pipeline = self._create_internal_pipeline(config, self.device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/pipelines/_parallel.py", line 158, in _create_internal_pipeline
return self._pipeline_cls(
^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/pipelines/paddleocr_vl/pipeline.py", line 127, in init
self.vl_rec_model = self.create_model(vl_rec_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/pipelines/base.py", line 106, in create_model
model = create_predictor(
^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/models/init.py", line 87, in create_predictor
return BasePredictor.get(model_name)(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/models/doc_vlm/predictor.py", line 66, in init
self.infer, self.processor = self._build(**kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/models/doc_vlm/predictor.py", line 152, in _build
model = PaddleOCRVLForConditionalGeneration.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/models/common/vlm/transformers/model_utils.py", line 1986, in from_pretrained
cls._load_pretrained_model(
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/models/common/vlm/transformers/model_utils.py", line 1543, in _load_pretrained_model
error_msgs = _load_state_dict_into_model(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/models/common/vlm/transformers/model_utils.py", line 299, in _load_state_dict_into_model
model_to_load.set_hf_state_dict(state_dict)
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddlex/inference/models/doc_vlm/modeling/paddleocr_vl/_paddleocr_vl.py", line 626, in set_hf_state_dict
return self.set_state_dict(state_dict, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddle/base/framework.py", line 794, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddle/nn/layer/layers.py", line 2280, in set_state_dict
param.set_value(state)
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddle/base/wrapped_decorator.py", line 50, in wrapper
return decorated(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddle/base/framework.py", line 722, in impl
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/ae666/my_project/paddle_test/lib/python3.12/site-packages/paddle/base/dygraph/tensor_patch_methods.py", line 237, in set_value
assert self.dtype == dtype, (
^^^^^^^^^^^^^^^^^^^
AssertionError: Variable dtype not match, Variable [ linear_164.w_0 ] need tensor with dtype paddle.float32 but load tensor with dtype paddle.bfloat16
"""