You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
You should use convert-hf-to-gguf.py for most models on HuggingFace. convert.py only supports Llama-like models.
However, the Viking models use a BPE tokenizer, and its pre-tokenizer uses a different regex which is not yet defined in llama.cpp. From its tokenizer.json:
Convert.py script can't make ggufs for these models:
https://huggingface.co/LumiOpen/Viking-7B
https://huggingface.co/LumiOpen/Viking-13B
https://huggingface.co/LumiOpen/Viking-33B
The text was updated successfully, but these errors were encountered: