WARNING: tokenization mismatch: 403 vs. 406. (ignored) LLaVa

编程入门行业动态更新时间:2024-10-28 12:20:06

WARNING: tokenization <a href=https://www.elefans.com/category/jswz/34/1735684.html style= mismatch: 403 vs. 406. (ignored) LLaVa"/>

LLaVa换BaiChuan底座报错

WARNING: tokenization mismatch: 403 vs. 406. (ignored)

cd ~/.cache/huggingface/hub/models--baichuan-inc--Baichuan2-7B-Base/snapshots/0cc6a61c06cd0734270151109d07cf86ef0ace53
vim tokenizer_config.json

把bos_token改成true，然后加一下对应的bos_token字典如框中的即可。

更多推荐

WARNING: tokenization mismatch: 403 vs. 406. (ignored) LLaVa

本文发布于:2023-11-16 07:32:15，感谢您对本站的认可！

评论列表（有 0 条评论）