Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to set lowvram mode on via settings? #107

Open
stubkan opened this issue Nov 27, 2023 · 0 comments
Open

How to set lowvram mode on via settings? #107

stubkan opened this issue Nov 27, 2023 · 0 comments

Comments

@stubkan
Copy link

stubkan commented Nov 27, 2023

The main readme.md says this

On systems with low VRAM you can call config.apply_low_vram_defaults() to reduce the amount of VRAM needed (at the cost of some speed and quality). The default settings use about 6.3GB of VRAM and the low VRAM settings use about 2.7GB.

But I have no idea how to do that. I dont know how to pass the --vram argument because Im using a framework to run the clip interrogator through another script

The closest I've figured out is that Config appears to be set in the clip_interrogator.py file, and is called from there, and I can see this section of it

    def apply_low_vram_defaults(self):
        self.caption_model_name = 'blip-base'
        self.caption_offload = True
        self.clip_offload = True
        self.chunk_size = 1024
        self.flavor_intermediate_count = 1024

Which looks like the settings for low vram mode, I can't see any lowvram disable or enable variable anywhere, or know where to insert one. How do I "call config.apply_low_vram_defaults()" ?

I'm just going to edit the main settings to be like those vars in low_vram, ie, setting chunk size to 1024 instead of 2048 etc, and it works with 6GB VRAM for now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant