External Publication
Visit Post

The BPE pre-tokenizer was not recognized!

Hugging Face Forums [Unofficial] May 7, 2026
Source

John6666:

Misc. bug: convert_hf_to_gguf.py - The BPE pre-tokenizer was not recognized” - Qwen3.5-4B-Base · Issue #22700 · ggml-org/llama.cpp · GitHub

I added it yesterday and I’m happy to report that the GitHub team responded quickly and the issue was resolved as part of [Model] Support MiniCPM-V 4.6 by tc-mb · Pull Request #22529 · ggml-org/llama.cpp · GitHub

Discussion in the ATmosphere

Loading comments...