Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Mobile] System.DllNotFoundException "onnxruntime-genai" when debugging on Android #496

Open
GuiOliv opened this issue May 22, 2024 · 1 comment

Comments

@GuiOliv
Copy link

GuiOliv commented May 22, 2024

I am writting an app using MAUI Blazor and I'm trying to load a mocal locally on my phone. However, everytime it hits the line var model = new Model(modelPath);, it throws the exception System.DllNotFoundException "onnxruntime-genai".

I have tried copying dll files multiple times, using them, installing the package on multiple projects but nothing worked.

To reproduce
To reproduce, you may try to load a local model by copying it to your phone and using

   string modelPath = "/storage/emulated/0/onnx/cpu_and_mobile/cpu-int4-rtn-block-32";

Then simply load the model with the line var model = new Model(modelPath);, all this while debugging with your phone via USB.

Visual Studio Community Version 17.10.0

Urgency
This is a personal project so not of much urgency but I would really appreciate if I could have any help.

Platform
Android

OS Version
14

ONNX Runtime Installation
Built from Source

Compiler Version (if 'Built from Source')
Debug / Any CPU

Package Name (if 'Released Package')
Microsoft.ML.OnnxRuntime

ONNX Runtime Version or Commit ID
Newest

ONNX Runtime API
C#

Architecture
Other / Unknown

Execution Provider
Default CPU

@BrainSlugs83
Copy link

Does it tell you which DLL it can't find?

I'm guessing you will need a different backend NuGet package for Android, but I'm not sure which one. I do see that Microsoft.ML.OnnxRuntime.Managed has some Android and iOS targets though...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants