-
-
Notifications
You must be signed in to change notification settings - Fork 728
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Windows 11+Conda: What is right version of triton to be used to work with unsloth #460
Comments
sumitshrestha
changed the title
What is right version of triton to be used to work with unsloth
Windows 11+Conda: What is right version of triton to be used to work with unsloth
May 13, 2024
Same problem... |
1 similar comment
Same problem... |
I also have the need to use unsloth in windows, so I made a docker images, you are also welcome to use. |
Apologies this slipped by me! Extreme sorry! Ye unfortunately Windows is a bit of an issue to support - (due to Triton). See #210 which might be helpful |
Very cool @Jiar !! Will check that out! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I am trying to run fine tuning on llama 3 just like others here using unsloth on my local windows 11. I have set up two virtual env one using 3.10 and other using 3.11.
when i installed the packages
conda install pytorch-cuda=<12.1/11.8> pytorch cudatoolkit xformers -c pytorch -c nvidia -c xformers
i get error. so, i installed pytorch using command provided in the official website.
when i ran the python script it failed at
from unsloth import FastLanguageModel
the error is
So, i tried installing triton using different ways but failed. This morning i downloaded the whl file and installed triton that way. here is the link to it https://pypi.org/project/triton-library/#files. When i installed i got another error related again to triton
So, what would be right version of triton i should be using with unsloth?
The text was updated successfully, but these errors were encountered: