External Publication
Visit Post

The BPE pre-tokenizer was not recognized!

Hugging Face Forums [Unofficial] May 3, 2026
Source

Hi @John6666 @Lightcap thank you so much for your valuable feedback. I truly appreciate it!

The issue was fixed by appending the new hash to convert_hf_to_gguf.py as shown below:

if chkhsh == “1444df51289cfa8063b96f0e62b1125440111bc79a52003ea14b6eac7016fd5f”: res = “qwen2”

Discussion in the ATmosphere

Loading comments...