推理孟子3时，使用generate接口推理：推理出来了，但是速度慢，重复警告，什么原因导致的呢？

[jesuswa]

【推理代码】：
from mindspore import context
from mindformers.generation import GenerationConfig
from mindformers.tools.register import MindFormerConfig
from mindformers import LlamaForCausalLM, LlamaConfig, LlamaTokenizer

context.set_context(device_id=0, mode=0)

init MengZi3-13b-Base model

mengzi_model_path = "/home/HwHiAiUser/work/models/Mengzi3-13B-Base/MengZi3-13B/MengZi3_13b.ckpt" # 填写实际路径
config_path = '/home/HwHiAiUser/work/models/Mengzi3-13B-Base/MengZi3-13B/run_mengzi3_13b_910b.yaml' # 填写实际路径

config = MindFormerConfig(config_path)
config.model.model_config.checkpoint_name_or_path = mengzi_model_path
mengzi_config = LlamaConfig(**config.model.model_config)

mengzi_model = LlamaForCausalLM(config=mengzi_config)

init MengZi3-13b-Base tokenizer

tokenizer_path = "/home/HwHiAiUser/work/models/Mengzi3-13B-Base/tokenizer.model" # 填写实际路径
tokenizer = LlamaTokenizer(vocab_file=tokenizer_path)

inputs = tokenizer("背诵李绅的悯农，答案是")["input_ids"]
outputs = mengzi_model.generate(inputs, max_length=128)
print(tokenizer.decode(outputs))

运行结果

[{'text_generation_text': ['背诵李绅的悯农，答案是：锄禾日当午，汗滴禾下土。谁知盘中餐，粒粒皆辛苦。\n锄禾日当午，汗滴禾下土。\n

谁知盘中餐，粒粒皆辛苦。\n译文：\n农民在正午烈日的暴晒下锄禾，汗水从身上滴在禾苗生长的土地上。又有谁知道盘中的饭食，每颗每粒都是农民用

辛勤的劳动换来的呢？\n赏析：\n这首诗描绘了在烈日当空的正午农民田里劳作的景象，概括地表现了农民终年辛勤劳动的生活，最后以“谁知盘中餐']}]

【日志详情】：
(AI) [root@localhost wget]# /root/anaconda3/envs/AI/bin/python /home/HwHiAiUser/work/Embedding/llm_inference/Mengzi.py
2024-04-08 10:01:13,138 - mindformers[mindformers/version_control.py:60] - INFO - The Cell Reuse compilation acceleration feature is not supported when the environment variable ENABLE_CELL_REUSE is 0 or MindSpore version is earlier than 2.1.0 or stand_alone mode or pipeline_stages <= 1
2024-04-08 10:01:13,138 - mindformers[mindformers/version_control.py:64] - INFO -
The current ENABLE_CELL_REUSE=0, please set the environment variable as follows:
export ENABLE_CELL_REUSE=1 to enable the Cell Reuse compilation acceleration feature.
2024-04-08 10:01:13,138 - mindformers[mindformers/version_control.py:70] - INFO - The Cell Reuse compilation acceleration feature does not support single-card mode.This feature is disabled by default. ENABLE_CELL_REUSE=1 does not take effect.
2024-04-08 10:01:13,139 - mindformers[mindformers/version_control.py:73] - INFO - The Cell Reuse compilation acceleration feature only works in pipeline parallel mode(pipeline_stage>1).Current pipeline stage=1, the feature is disabled by default.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:01:13.608.639 [mindspore/ops/primitive.py:228] The in_strategy of the operator in your network will not take effect in stand_alone mode. This means the the shard function called in the network is ignored.
If you want to enable it, please use semi auto or auto parallel mode by context.set_auto_parallel_context(parallel_mode=ParallelMode.SEMI_AUTO_PARALLEL or context.set_auto_parallel_context(parallel_mode=ParallelMode.AUTO_PARALLEL)
2024-04-08 10:01:20,750 - mindformers[mindformers/modules/layers.py:554] - WARNING - The user passed the custom defined activation function True. If the user want to enable shard for the activation cell, the user should set the shard for each primitives in the cell.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:01:20.751.888 [mindspore/common/parameter.py:786] This interface may be deleted in the future.
2024-04-08 10:01:23,252 - mindformers[mindformers/modules/layers.py:554] - WARNING - The user passed the custom defined activation function True. If the user want to enable shard for the activation cell, the user should set the shard for each primitives in the cell.
2024-04-08 10:01:25,691 - mindformers[mindformers/modules/layers.py:554] - WARNING - The user passed the custom defined activation function True. If the user want to enable shard for the activation cell, the user should set the shard for each primitives in the cell.
2024-04-08 10:01:28,129 - mindformers[mindformers/modules/layers.py:554] - WARNING - The user passed the custom defined activation function True. If the user want to enable shard for the activation cell, the user should set the shard for each primitives in the cell.
2024-04-08 10:01:30,717 - mindformers[mindformers/modules/layers.py:554] - WARNING - The user passed the custom defined activation function True. If the user want to enable shard for the activation cell, the user should set the shard for each primitives in the cell.
2024-04-08 10:01:33,136 - mindformers[mindformers/modules/layers.py:554] - WARNING - The user passed the custom defined activation function True. If the user want to enable shard for the activation cell, the user should set the shard for each primitives in the cell.
2024-04-08 10:01:35,595 - mindformers[mindformers/modules/layers.py:554] - WARNING - The user passed the custom defined activation function True. If the user want to enable shard for the activation cell, the user should set the shard for each primitives in the cell.
2024-04-08 10:01:38,069 - mindformers[mindformers/modules/layers.py:554] - WARNING - The user passed the custom defined activation function True. If the user want to enable shard for the activation cell, the user should set the shard for each primitives in the cell.
2024-04-08 10:01:40,565 - mindformers[mindformers/modules/layers.py:554] - WARNING - The user passed the custom defined activation function True. If the user want to enable shard for the activation cell, the user should set the shard for each primitives in the cell.
2024-04-08 10:01:43,028 - mindformers[mindformers/modules/layers.py:554] - WARNING - The user passed the custom defined activation function True. If the user want to enable shard for the activation cell, the user should set the shard for each primitives in the cell.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:40.875.853 [mindspore/train/serialization.py:183] The type of model.layers.0.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:40.876.905 [mindspore/train/serialization.py:183] The type of model.layers.0.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:41.499.012 [mindspore/train/serialization.py:183] The type of model.layers.1.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:41.499.867 [mindspore/train/serialization.py:183] The type of model.layers.1.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:42.121.092 [mindspore/train/serialization.py:183] The type of model.layers.2.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:42.121.980 [mindspore/train/serialization.py:183] The type of model.layers.2.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:42.743.874 [mindspore/train/serialization.py:183] The type of model.layers.3.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:42.744.730 [mindspore/train/serialization.py:183] The type of model.layers.3.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:43.367.003 [mindspore/train/serialization.py:183] The type of model.layers.4.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:43.367.863 [mindspore/train/serialization.py:183] The type of model.layers.4.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:43.991.922 [mindspore/train/serialization.py:183] The type of model.layers.5.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:43.992.779 [mindspore/train/serialization.py:183] The type of model.layers.5.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:44.617.072 [mindspore/train/serialization.py:183] The type of model.layers.6.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:44.617.965 [mindspore/train/serialization.py:183] The type of model.layers.6.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:45.240.577 [mindspore/train/serialization.py:183] The type of model.layers.7.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:45.244.012 [mindspore/train/serialization.py:183] The type of model.layers.7.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:45.864.471 [mindspore/train/serialization.py:183] The type of model.layers.8.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:45.865.371 [mindspore/train/serialization.py:183] The type of model.layers.8.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:46.485.724 [mindspore/train/serialization.py:183] The type of model.layers.9.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:46.486.589 [mindspore/train/serialization.py:183] The type of model.layers.9.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:47.106.894 [mindspore/train/serialization.py:183] The type of model.layers.10.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:47.107.752 [mindspore/train/serialization.py:183] The type of model.layers.10.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:47.736.544 [mindspore/train/serialization.py:183] The type of model.layers.11.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:47.737.424 [mindspore/train/serialization.py:183] The type of model.layers.11.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:48.361.248 [mindspore/train/serialization.py:183] The type of model.layers.12.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:48.362.099 [mindspore/train/serialization.py:183] The type of model.layers.12.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:48.985.726 [mindspore/train/serialization.py:183] The type of model.layers.13.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:48.986.572 [mindspore/train/serialization.py:183] The type of model.layers.13.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:49.613.874 [mindspore/train/serialization.py:183] The type of model.layers.14.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:49.614.697 [mindspore/train/serialization.py:183] The type of model.layers.14.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:50.238.442 [mindspore/train/serialization.py:183] The type of model.layers.15.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:50.239.282 [mindspore/train/serialization.py:183] The type of model.layers.15.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:50.861.541 [mindspore/train/serialization.py:183] The type of model.layers.16.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:50.862.378 [mindspore/train/serialization.py:183] The type of model.layers.16.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:51.485.968 [mindspore/train/serialization.py:183] The type of model.layers.17.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:51.486.821 [mindspore/train/serialization.py:183] The type of model.layers.17.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:52.110.060 [mindspore/train/serialization.py:183] The type of model.layers.18.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:52.110.927 [mindspore/train/serialization.py:183] The type of model.layers.18.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:52.730.520 [mindspore/train/serialization.py:183] The type of model.layers.19.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:52.731.386 [mindspore/train/serialization.py:183] The type of model.layers.19.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:53.347.363 [mindspore/train/serialization.py:183] The type of model.layers.20.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:53.348.216 [mindspore/train/serialization.py:183] The type of model.layers.20.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:53.974.588 [mindspore/train/serialization.py:183] The type of model.layers.21.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:53.975.441 [mindspore/train/serialization.py:183] The type of model.layers.21.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:54.597.088 [mindspore/train/serialization.py:183] The type of model.layers.22.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:54.597.977 [mindspore/train/serialization.py:183] The type of model.layers.22.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:55.218.851 [mindspore/train/serialization.py:183] The type of model.layers.23.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:55.219.703 [mindspore/train/serialization.py:183] The type of model.layers.23.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:55.843.490 [mindspore/train/serialization.py:183] The type of model.layers.24.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:55.844.334 [mindspore/train/serialization.py:183] The type of model.layers.24.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:56.468.260 [mindspore/train/serialization.py:183] The type of model.layers.25.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:56.469.120 [mindspore/train/serialization.py:183] The type of model.layers.25.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:57.911.89 [mindspore/train/serialization.py:183] The type of model.layers.26.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:57.920.54 [mindspore/train/serialization.py:183] The type of model.layers.26.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:57.713.943 [mindspore/train/serialization.py:183] The type of model.layers.27.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:57.714.800 [mindspore/train/serialization.py:183] The type of model.layers.27.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:58.337.594 [mindspore/train/serialization.py:183] The type of model.layers.28.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:58.338.451 [mindspore/train/serialization.py:183] The type of model.layers.28.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:58.960.645 [mindspore/train/serialization.py:183] The type of model.layers.29.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:58.961.529 [mindspore/train/serialization.py:183] The type of model.layers.29.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:59.584.526 [mindspore/train/serialization.py:183] The type of model.layers.30.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:04:59.585.420 [mindspore/train/serialization.py:183] The type of model.layers.30.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:00.208.550 [mindspore/train/serialization.py:183] The type of model.layers.31.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:00.209.440 [mindspore/train/serialization.py:183] The type of model.layers.31.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:00.834.426 [mindspore/train/serialization.py:183] The type of model.layers.32.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:00.835.275 [mindspore/train/serialization.py:183] The type of model.layers.32.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:01.459.819 [mindspore/train/serialization.py:183] The type of model.layers.33.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:01.461.430 [mindspore/train/serialization.py:183] The type of model.layers.33.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:02.840.83 [mindspore/train/serialization.py:183] The type of model.layers.34.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:02.849.44 [mindspore/train/serialization.py:183] The type of model.layers.34.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:02.706.828 [mindspore/train/serialization.py:183] The type of model.layers.35.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:02.707.688 [mindspore/train/serialization.py:183] The type of model.layers.35.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:03.327.203 [mindspore/train/serialization.py:183] The type of model.layers.36.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:03.328.060 [mindspore/train/serialization.py:183] The type of model.layers.36.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:03.948.027 [mindspore/train/serialization.py:183] The type of model.layers.37.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:03.948.995 [mindspore/train/serialization.py:183] The type of model.layers.37.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:04.563.317 [mindspore/train/serialization.py:183] The type of model.layers.38.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:04.564.209 [mindspore/train/serialization.py:183] The type of model.layers.38.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:05.180.584 [mindspore/train/serialization.py:183] The type of model.layers.39.attention_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:05.181.535 [mindspore/train/serialization.py:183] The type of model.layers.39.ffn_norm.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:05.767.927 [mindspore/train/serialization.py:183] The type of model.norm_out.weight:Float16 in 'parameter_dict' is different from the type of it in 'net':Float32, then the type convert from Float16 to Float32 in the network.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.970.3 [mindspore/train/serialization.py:1378] For 'load_param_into_net', 80 parameters in the 'net' are not loaded, because they are not in the 'parameter_dict', please check whether the network structure is consistent when training and loading checkpoint.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.990.7 [mindspore/train/serialization.py:1383] model.layers.0.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.998.7 [mindspore/train/serialization.py:1383] model.layers.0.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.100.51 [mindspore/train/serialization.py:1383] model.layers.1.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.101.13 [mindspore/train/serialization.py:1383] model.layers.1.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.101.74 [mindspore/train/serialization.py:1383] model.layers.2.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.102.31 [mindspore/train/serialization.py:1383] model.layers.2.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.102.89 [mindspore/train/serialization.py:1383] model.layers.3.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.103.45 [mindspore/train/serialization.py:1383] model.layers.3.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.104.00 [mindspore/train/serialization.py:1383] model.layers.4.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.104.55 [mindspore/train/serialization.py:1383] model.layers.4.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.105.09 [mindspore/train/serialization.py:1383] model.layers.5.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.105.63 [mindspore/train/serialization.py:1383] model.layers.5.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.106.17 [mindspore/train/serialization.py:1383] model.layers.6.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.106.71 [mindspore/train/serialization.py:1383] model.layers.6.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.107.25 [mindspore/train/serialization.py:1383] model.layers.7.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.107.78 [mindspore/train/serialization.py:1383] model.layers.7.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.108.32 [mindspore/train/serialization.py:1383] model.layers.8.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.108.85 [mindspore/train/serialization.py:1383] model.layers.8.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.109.38 [mindspore/train/serialization.py:1383] model.layers.9.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.109.91 [mindspore/train/serialization.py:1383] model.layers.9.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.110.44 [mindspore/train/serialization.py:1383] model.layers.10.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.110.97 [mindspore/train/serialization.py:1383] model.layers.10.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.111.51 [mindspore/train/serialization.py:1383] model.layers.11.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.112.03 [mindspore/train/serialization.py:1383] model.layers.11.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.112.56 [mindspore/train/serialization.py:1383] model.layers.12.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.113.10 [mindspore/train/serialization.py:1383] model.layers.12.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.113.62 [mindspore/train/serialization.py:1383] model.layers.13.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.114.14 [mindspore/train/serialization.py:1383] model.layers.13.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.114.67 [mindspore/train/serialization.py:1383] model.layers.14.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.115.20 [mindspore/train/serialization.py:1383] model.layers.14.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.115.75 [mindspore/train/serialization.py:1383] model.layers.15.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.116.27 [mindspore/train/serialization.py:1383] model.layers.15.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.116.80 [mindspore/train/serialization.py:1383] model.layers.16.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.117.33 [mindspore/train/serialization.py:1383] model.layers.16.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.117.86 [mindspore/train/serialization.py:1383] model.layers.17.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.118.39 [mindspore/train/serialization.py:1383] model.layers.17.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.118.92 [mindspore/train/serialization.py:1383] model.layers.18.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.119.45 [mindspore/train/serialization.py:1383] model.layers.18.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.119.97 [mindspore/train/serialization.py:1383] model.layers.19.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.120.50 [mindspore/train/serialization.py:1383] model.layers.19.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.121.03 [mindspore/train/serialization.py:1383] model.layers.20.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.121.55 [mindspore/train/serialization.py:1383] model.layers.20.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.122.07 [mindspore/train/serialization.py:1383] model.layers.21.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.122.59 [mindspore/train/serialization.py:1383] model.layers.21.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.123.11 [mindspore/train/serialization.py:1383] model.layers.22.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.123.62 [mindspore/train/serialization.py:1383] model.layers.22.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.124.15 [mindspore/train/serialization.py:1383] model.layers.23.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.124.67 [mindspore/train/serialization.py:1383] model.layers.23.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.125.19 [mindspore/train/serialization.py:1383] model.layers.24.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.125.71 [mindspore/train/serialization.py:1383] model.layers.24.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.126.22 [mindspore/train/serialization.py:1383] model.layers.25.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.126.75 [mindspore/train/serialization.py:1383] model.layers.25.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.127.28 [mindspore/train/serialization.py:1383] model.layers.26.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.127.80 [mindspore/train/serialization.py:1383] model.layers.26.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.128.32 [mindspore/train/serialization.py:1383] model.layers.27.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.128.85 [mindspore/train/serialization.py:1383] model.layers.27.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.129.38 [mindspore/train/serialization.py:1383] model.layers.28.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.129.90 [mindspore/train/serialization.py:1383] model.layers.28.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.130.42 [mindspore/train/serialization.py:1383] model.layers.29.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.130.94 [mindspore/train/serialization.py:1383] model.layers.29.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.131.46 [mindspore/train/serialization.py:1383] model.layers.30.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.131.98 [mindspore/train/serialization.py:1383] model.layers.30.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.132.63 [mindspore/train/serialization.py:1383] model.layers.31.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.133.17 [mindspore/train/serialization.py:1383] model.layers.31.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.133.69 [mindspore/train/serialization.py:1383] model.layers.32.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.134.22 [mindspore/train/serialization.py:1383] model.layers.32.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.134.76 [mindspore/train/serialization.py:1383] model.layers.33.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.135.28 [mindspore/train/serialization.py:1383] model.layers.33.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.135.81 [mindspore/train/serialization.py:1383] model.layers.34.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.136.34 [mindspore/train/serialization.py:1383] model.layers.34.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.136.87 [mindspore/train/serialization.py:1383] model.layers.35.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.137.41 [mindspore/train/serialization.py:1383] model.layers.35.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.137.94 [mindspore/train/serialization.py:1383] model.layers.36.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.138.46 [mindspore/train/serialization.py:1383] model.layers.36.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.138.98 [mindspore/train/serialization.py:1383] model.layers.37.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.139.49 [mindspore/train/serialization.py:1383] model.layers.37.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.140.01 [mindspore/train/serialization.py:1383] model.layers.38.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.140.53 [mindspore/train/serialization.py:1383] model.layers.38.attention.kvcache_mgr.value_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.141.05 [mindspore/train/serialization.py:1383] model.layers.39.attention.kvcache_mgr.key_past is not loaded.
[WARNING] ME(2247295:281473350885408,MainProcess):2024-04-08-10:05:07.141.57 [mindspore/train/serialization.py:1383] model.layers.39.attention.kvcache_mgr.value_past is not loaded.
2024-04-08 10:05:07,014 - mindformers[mindformers/models/base_model.py:115] - INFO - weights in /home/HwHiAiUser/work/models/Mengzi3-13B-Base/MengZi3-13B/MengZi3_13b.ckpt are loaded
2024-04-08 10:05:07,585 - mindformers[mindformers/generation/text_generator.py:1099] - WARNING - When do_sample is set to False, top_k will be set to 1 and top_p will be set to 0, making them inactive.
2024-04-08 10:05:07,585 - mindformers[mindformers/generation/text_generator.py:1103] - INFO - Generation Config is: {'max_length': 128, 'max_new_tokens': None, 'num_beams': 1, 'do_sample': False, 'use_past': True, 'temperature': 1.0, 'top_k': 0, 'top_p': 1.0, 'repetition_penalty': 1, 'encoder_repetition_penalty': 1.0, 'renormalize_logits': False, 'pad_token_id': 0, 'bos_token_id': 1, 'eos_token_id': 2, '_from_model_config': True}
2024-04-08 10:05:07,585 - mindformers[mindformers/generation/text_generator.py:176] - INFO - The generation mode will be GREEDY_SEARCH.
[WARNING] COMMON(2247295,ffff9f17e020,python):2024-04-08-10:05:53.251.114 [mindspore/ccsrc/common/duplex_pipe.cc:111] Read] [DuplexPipe] Read was interrupted by system interrupt, retry: 0
2024-04-08 10:10:03,781 - mindformers[mindformers/generation/text_generator.py:478] - INFO - total time: 296.195463180542 s; generated tokens: 36 tokens; generate speed: 0.1215413619554891 tokens/s
[' 背诵李绅的悯农，答案是：锄禾日当午，汗滴禾下土。谁知盘中餐，粒粒皆辛苦。\n输出：\n这句诗描写的是哪个节气的劳动场景？']