Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Max number of CPUs per task is limited by the submission node #481

Open
ziw-liu opened this issue Sep 24, 2024 · 0 comments
Open

[BUG] Max number of CPUs per task is limited by the submission node #481

ziw-liu opened this issue Sep 24, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@ziw-liu
Copy link
Contributor

ziw-liu commented Sep 24, 2024

These lines counts the CPUs on the node where the job is submitted:

# TODO: this setting will have to be collected from SLURM?
def processes_option(default: int = None) -> Callable:
def check_processes_option(ctx, param, value):
max_processes = mp.cpu_count()
if value > max_processes:
raise click.BadParameter(
f"Maximum number of processes is {max_processes}"
)
return value

This is not needed with submitit, since SLURM will reject job submission if requested CPUs per task is more than what's available in the cluster.

@ziw-liu ziw-liu added the bug Something isn't working label Sep 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant