Skip to content

Issues: ggerganov/llama.cpp

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

339 Open 2,654 Closed
339 Open 2,654 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Funny response with LLaMa 3 8B bug-unconfirmed
#7367 opened May 18, 2024 by Sewlell
llama_model_load: error loading model: unable to allocate backend buffer bug-unconfirmed
#7366 opened May 18, 2024 by phaelon74
bf16 problem
#7365 opened May 18, 2024 by Zibri
Can I handle multiple images in the same context? bug-unconfirmed
#7364 opened May 18, 2024 by Eriter555
1
[SYCL] include shared libs in sycl release enhancement New feature or request
#7361 opened May 18, 2024 by gfody
Need help on building shared libraries on Windows machine for Android x86_64 (emulator)
#7357 opened May 18, 2024 by cmpktheo
[Android/Termux] Significantly higher RAM usage with Vulkan compared to CPU only bug-unconfirmed
#7351 opened May 17, 2024 by egeoz
1
AMD ROCm: 8x22B Model Causes 100% GPU Utilization Stall bug-unconfirmed
#7344 opened May 17, 2024 by Trat8547
Flash attention implementations do not handle case where value vectors have different dimension from query vectors bug-unconfirmed
#7343 opened May 17, 2024 by fairydreaming
1
convert.py still fails on llama3 8B-Instruct downloaded directly from Meta (Huggingface works) bug-unconfirmed
#7339 opened May 17, 2024 by aleloi
2
Segmentation Fault on GPU
#7337 opened May 17, 2024 by djain-fujitsu
1
Issues: Unable for multiuser prompt
#7336 opened May 17, 2024 by OlivesHere
1
llava surgery script for new llava-arch model from Intel bug-unconfirmed
#7333 opened May 16, 2024 by KohakuBlueleaf
GGML_ASSERT(n_embd_gqa == n_embd_k_gqa) fails in models where key vector dimension is different from value vector dimension
#7331 opened May 16, 2024 by fairydreaming
Add support for multilingual Viking models, please. enhancement New feature or request
#7309 opened May 15, 2024 by JohnClaw
1
Possible performance boost with 2-pass online softmax bug-unconfirmed
#7306 opened May 15, 2024 by zixuanweeei
1
relocation R_X86_64_32 against hidden symbol `__TMC_END__' can not be used when making a shared object bug-unconfirmed
#7301 opened May 15, 2024 by asarubbo
How to quantize fine-tune LLM into GGUF format
#7299 opened May 15, 2024 by dibyendubiswas1998
2
Improve and expand Wikipedia article about llama.cpp enhancement New feature or request
#7294 opened May 15, 2024 by fffelix-jan
4 tasks done
2
Llama-3 Instruct tokenizer_config.json changes in relation to the currently fetched llama-bpe configs. enhancement New feature or request
#7289 opened May 14, 2024 by Spacellary
4 tasks done
Infinite update_slots issue on latest build (1265c67) bug-unconfirmed
#7283 opened May 14, 2024 by Leowolf93
/embeddings endpoint sometimes does not return embedding bug-unconfirmed
#7277 opened May 14, 2024 by marcingomulkiewicz
1
ThunderKittens：a simple yet faster flashattention alternative enhancement New feature or request
#7276 opened May 14, 2024 by sorasoras
1
Windows MSYS2 compilation error. [SOLVED]
#7275 opened May 14, 2024 by Zibri
3
EOT token incorrectly set for Mistral-v0.2 trained with added ChatML tokens bug-unconfirmed
#7271 opened May 14, 2024 by xzuyn
4
ProTip! Exclude everything labeled bug with -label:bug.