Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Do not auto-prune instance types if there are too many #235

Merged

Conversation

cartalla
Copy link
Contributor

@cartalla cartalla commented May 17, 2024

I was previously only allowing 1 memory size/core count combination to keep the number of compute resources down and also was combining multiple instance types in one compute resource if possible.

This led to people no being able to configure the exact instance types they wanted.

So, I've reverted to my original strategy of 1 instance type per compute resource and 1 CR per queue. The compute resources can be combined into any queues that the user wants using custom slurm settings.

I had to exclude instance types in the default configuration in order to keep from exceeding the PC limits.

Resolves #220

Update ParallelCluster version in config files and docs.

Clean up security scan.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@cartalla cartalla linked an issue May 17, 2024 that may be closed by this pull request
@cartalla cartalla force-pushed the 220-reducing-number-of-compute-resources-to-aggressively branch 2 times, most recently from 1c45cc7 to d33b6df Compare May 23, 2024 18:17
I was previously only allowing 1 memory size/core count combination to keep
the number of compute resources down and also was combining multiple instance
types in one compute resource if possible.
This was to try to maximize the number of instance types that were configured.

This led to people not being able to configure the exact instance types they
wanted.
The preference is to notify the user and let them choose which instances types
to exclude or to reduce the number of included types.

So, I've reverted to my original strategy of 1 instance type per compute resource and 1 CR per queue.
The compute resources can be combined into any queues that the user wants using
custom slurm settings.

I had to exclude instance types in the default configuration in order to keep from exceeding the PC limits.

Resolves #220

Update ParallelCluster version in config files and docs.

Clean up security scan.
@cartalla cartalla force-pushed the 220-reducing-number-of-compute-resources-to-aggressively branch from d33b6df to bb9c752 Compare May 23, 2024 21:06
@cartalla cartalla merged commit 7255024 into main May 23, 2024
@cartalla cartalla deleted the 220-reducing-number-of-compute-resources-to-aggressively branch May 23, 2024 22:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

reducing number of compute resources to aggressively.
1 participant