Skip to content

토크나이저 warning 메시지 관련 #8

@sysmetic

Description

@sysmetic

안녕하세요

tokenizer = KoBertTokenizer.from_pretrained("monologg/kobert")

이분에서 아래와 같은 메세지가 뜹니다.

/home/username/.local/lib/python3.8/site-packages/transformers/tokenization_utils_base.py:1421: FutureWarning: The max_len attribute has been deprecated and will be removed in a future version, use model_max_length instead.
warnings.warn(
Setting 'max_len_single_sentence' is now deprecated. This value is automatically set up.
Setting 'max_len_sentences_pair' is now deprecated. This value is automatically set up.

혹시 버전에 맞게 수정 가능할까요?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions