mismatch: 403 vs. 406. (ignored) LLaVa"/>
WARNING: tokenization mismatch: 403 vs. 406. (ignored) LLaVa
LLaVa换BaiChuan底座报错
WARNING: tokenization mismatch: 403 vs. 406. (ignored)
解决
cd ~/.cache/huggingface/hub/models--baichuan-inc--Baichuan2-7B-Base/snapshots/0cc6a61c06cd0734270151109d07cf86ef0ace53
vim tokenizer_config.json
把bos_token改成true,然后加一下对应的bos_token字典如框中的即可。
更多推荐
WARNING: tokenization mismatch: 403 vs. 406. (ignored) LLaVa
发布评论