Skip to content

Issues: microsoft/onnxruntime-genai

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

19 Open 51 Closed
19 Open 51 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Mobile] System.DllNotFoundException "onnxruntime-genai" when debugging on Android
#496 opened May 22, 2024 by GuiOliv
Errors when running Phi-3 on NVIDIA CUDA with onnxruntime_genai
#490 opened May 21, 2024 by jackylu0124
4
Device API throws exception
#488 opened May 21, 2024 by natke
1
onnxruntime_genai.onnxruntime_genai.OrtException: Non-zero status code returned while running GroupQueryAttention node. Name:'/model/layers.0/attn/GroupQueryAttention' Status Message: cos_cache dimension 1 must be <= head_size / 2 and a multiple of 8.
#482 opened May 21, 2024 by Positronx
1
Feature Request: Specify seed in python SDK
#463 opened May 15, 2024 by Ben-Epstein
1
Model for llama-3-8B, EP: cpu, precision: int4 generated using onnxruntime-genai/src/python/py/models/builder.py has issues
#462 opened May 15, 2024 by jmopuri
4
GeneratorParams should not throw an exception enhancement New feature or request
#453 opened May 14, 2024 by skottmckay
1
How to release GPU memory after each inference? enhancement New feature or request
#446 opened May 13, 2024 by nguyenthekhoig7
1
Extensions for LLM
#442 opened May 11, 2024 by hannespreishuber
2
How to ignore EOS token when using onnxruntime-genai enhancement New feature or request
#436 opened May 10, 2024 by Tabrizian
1
Phi-3 does not load on iGPU vega 11 (Ryzen 2400g)
#403 opened May 4, 2024 by CodeI000I
@natke
2
Multi-target with .NET Standard 2.0 and .NET runtimes
#382 opened May 2, 2024 by michael-hawker
2
Querying the ids of all the DML devices and selecting a device for inference
#360 opened Apr 30, 2024 by jojo1899
@PatriceVignola
6
RTL support and other languages ?
#346 opened Apr 29, 2024 by PrestigeDevop
@natke
4
ImportError: libcudnn.so.8: cannot open shared object file: No such file or directory
#344 opened Apr 29, 2024 by xbotaria
@baijumeswani
8
Error while running Phi-3 with DML
#336 opened Apr 27, 2024 by tomas-pet
@PatriceVignola
9
Phi-3 can't deal with Japanese. How can I solve this issue?
#314 opened Apr 24, 2024 by Hideki105
@wenbingl
14
Wheel file name does not get updated for new versions
#275 opened Apr 21, 2024 by natke
@baijumeswani
2
[C# Phi-2] System.DllNotFoundException: Unable to load shared library 'onnxruntime-genai' or one of its dependencies.
#273 opened Apr 19, 2024 by luisquintanilla
8
ProTip! Updated in the last three days: updated:>2024-05-18.