Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Linux_64 - rebuild September 2024 #206

Closed
wants to merge 32 commits into from
Closed

Conversation

sonelu
Copy link

@sonelu sonelu commented Aug 26, 2024

Trigger for rebuild for:

  • ros_core
  • ros_base
  • perception
  • simulation
  • desktop
  • desktop_full

Worked on a local built.

I'll follow with simulation and desktop as soon as I can.

Will also do a cleanup of the packages that are bottom in the recipe once we have all packages from the main versions.

@sonelu
Copy link
Author

sonelu commented Aug 27, 2024

This is good to go now. All build checked locally.

@sonelu sonelu changed the title Linux_64 - build 7 - ros_core, ros_base, perception Linux_64 - build 7 - ros_core, ros_base, perception, simulation, desktop, desktop_full Aug 27, 2024
@sonelu
Copy link
Author

sonelu commented Aug 27, 2024

Please also check the #207 that happened during build. Not sure if the ulimit -n 4096 needs to be setup on the build environment or is already taken care of.

@sonelu
Copy link
Author

sonelu commented Sep 1, 2024

Finished all packs above "end of package support" - they are 615 packages that are now building on my machine. I think for linux-64 this is good to go and merge it.

@sonelu
Copy link
Author

sonelu commented Sep 17, 2024

@Tobias-Fischer is this an issue with the sizing of the server, or something else?

@Tobias-Fischer
Copy link
Contributor

To be honest, I am not sure ..

If you clean up the vinca_linux_64.yaml (only bumping the build number, removing all the comments of the packages that are contained in the meta-packages), I think I'd be happy to merge.

@Tobias-Fischer
Copy link
Contributor

I just remembered - we should probably address RoboStack/ros-noetic#477 (@traversaro) and #175 before merging. @traversaro - do you know how to change the mutex build string?

@Tobias-Fischer
Copy link
Contributor

@Tobias-Fischer
Copy link
Contributor

I think I've addressed these points - @traversaro could you please take a look?

@Tobias-Fischer Tobias-Fischer changed the title Linux_64 - build 7 - ros_core, ros_base, perception, simulation, desktop, desktop_full Linux_64 - rebuld September 2024 Sep 18, 2024
@Tobias-Fischer
Copy link
Contributor

Did a cleanup - I think I'd be happy if CI is going well.

@Tobias-Fischer Tobias-Fischer changed the title Linux_64 - rebuld September 2024 Linux_64 - rebuild September 2024 Sep 18, 2024
@traversaro
Copy link
Member

I think I've addressed these points - @traversaro could you please take a look?

Everything seems fine, thanks!

@traversaro
Copy link
Member

It seems to me that a patch is outdated:

==> /usr/bin/git status <==

Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-backward-ros.patch
Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-backward-ros.patch with args:
['-Np1', '-i', '/tmp/tmp6qzbkf3o/ros-humble-backward-ros.patch.native', '--binary']
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 530, in run_build
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
    build_recipe(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
    download_source(MetaData(recipe_path, o0), interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
    _try_download(m, interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
    source.provide(m)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
    apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
    raise exception
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
    try_apply_patch(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
    check_call_env(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
    return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
    subprocess.check_call(_args, **kwargs)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np1', '-i', '/tmp/tmp6qzbkf3o/ros-humble-backward-ros.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.
Error: Process completed with exit code 1.

@traversaro
Copy link
Member

Ok, I fixed the backward_ros patch, now the following failure is on moveit:

Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-core.patch
Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-core.patch with args:
['-Np1', '-i', '/tmp/tmpex1l5e2f/ros-humble-moveit-core.patch.native', '--binary']
  File "/home/runner/micromamba/envs/testpr_env/bin/boa", line 10, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cli/boa.py", line 245, in main
    run_build(args)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 530, in run_build
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
    build_recipe(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
    download_source(MetaData(recipe_path, o0), interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
    _try_download(m, interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
    source.provide(m)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
    apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
    raise exception
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
    try_apply_patch(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
    check_call_env(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
    return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
    subprocess.check_call(_args, **kwargs)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np1', '-i', '/tmp/tmpex1l5e2f/ros-humble-moveit-core.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

@traversaro
Copy link
Member

Ok, I fixed the backward_ros patch, now the following failure is on moveit:

Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-core.patch
Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-core.patch with args:
['-Np1', '-i', '/tmp/tmpex1l5e2f/ros-humble-moveit-core.patch.native', '--binary']
  File "/home/runner/micromamba/envs/testpr_env/bin/boa", line 10, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cli/boa.py", line 245, in main
    run_build(args)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 530, in run_build
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
    build_recipe(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
    download_source(MetaData(recipe_path, o0), interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
    _try_download(m, interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
    source.provide(m)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
    apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
    raise exception
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
    try_apply_patch(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
    check_call_env(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
    return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
    subprocess.check_call(_args, **kwargs)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np1', '-i', '/tmp/tmpex1l5e2f/ros-humble-moveit-core.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

Fortunately the patch was superseded by moveit/moveit2#2399, so we can just drop it.

@traversaro
Copy link
Member

New round new failing patch:

Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch
Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch with args:
['-Np1', '-i', '/tmp/tmp0zuoh257/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch.native', '--binary']
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 530, in run_build
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
    build_recipe(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
    download_source(MetaData(recipe_path, o0), interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
    _try_download(m, interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
    source.provide(m)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
    apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
    raise exception
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
    try_apply_patch(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
    check_call_env(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
    return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
    subprocess.check_call(_args, **kwargs)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np1', '-i', '/tmp/tmp0zuoh257/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

@traversaro
Copy link
Member

New round new failing patch:

Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch
Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch with args:
['-Np1', '-i', '/tmp/tmp0zuoh257/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch.native', '--binary']
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 530, in run_build
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
    build_recipe(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
    download_source(MetaData(recipe_path, o0), interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
    _try_download(m, interactive)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
    source.provide(m)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
    apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
    raise exception
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
    try_apply_patch(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
    raise e
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
    check_call_env(
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
    return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
    subprocess.check_call(_args, **kwargs)
  File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np1', '-i', '/tmp/tmp0zuoh257/ros-humble-moveit-resources-prbt-ikfast-manipulator-plugin.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

Apparently the patch was integrated upstream in moveit/moveit2#2395, so se can drop also this one.

@traversaro
Copy link
Member

New moveit failing patch:

2024-11-28T09:46:10.6517812Z 
2024-11-28T09:46:10.6518156Z Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-simple-controller-manager.patch
2024-11-28T09:46:10.6519045Z Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-simple-controller-manager.patch with args:
2024-11-28T09:46:10.6519786Z ['-Np3', '-i', '/tmp/tmpfwmnm2gw/ros-humble-moveit-simple-controller-manager.patch.native', '--binary']
2024-11-28T09:46:10.6520232Z     raise e
2024-11-28T09:46:10.6520688Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
2024-11-28T09:46:10.6521191Z     build_recipe(
2024-11-28T09:46:10.6521661Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
2024-11-28T09:46:10.6522242Z     download_source(MetaData(recipe_path, o0), interactive)
2024-11-28T09:46:10.6522819Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
2024-11-28T09:46:10.6523335Z     _try_download(m, interactive)
2024-11-28T09:46:10.6523838Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
2024-11-28T09:46:10.6524343Z     source.provide(m)
2024-11-28T09:46:10.6524812Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
2024-11-28T09:46:10.6525398Z     apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
2024-11-28T09:46:10.6526015Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
2024-11-28T09:46:10.6526538Z     raise exception
2024-11-28T09:46:10.6527005Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
2024-11-28T09:46:10.6527523Z     try_apply_patch(
2024-11-28T09:46:10.6528000Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
2024-11-28T09:46:10.6528502Z     raise e
2024-11-28T09:46:10.6528959Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
2024-11-28T09:46:10.6529473Z     check_call_env(
2024-11-28T09:46:10.6529924Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
2024-11-28T09:46:10.6530534Z     return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
2024-11-28T09:46:10.6530922Z            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-11-28T09:46:10.6531528Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
2024-11-28T09:46:10.6532143Z     subprocess.check_call(_args, **kwargs)
2024-11-28T09:46:10.6532592Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
2024-11-28T09:46:10.6533034Z     raise CalledProcessError(retcode, cmd)
2024-11-28T09:46:10.6534182Z subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np3', '-i', '/tmp/tmpfwmnm2gw/ros-humble-moveit-simple-controller-manager.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

@traversaro
Copy link
Member

New moveit failing patch:

2024-11-28T09:46:10.6517812Z 
2024-11-28T09:46:10.6518156Z Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-simple-controller-manager.patch
2024-11-28T09:46:10.6519045Z Applying patch: /home/runner/work/ros-humble/ros-humble/patch/ros-humble-moveit-simple-controller-manager.patch with args:
2024-11-28T09:46:10.6519786Z ['-Np3', '-i', '/tmp/tmpfwmnm2gw/ros-humble-moveit-simple-controller-manager.patch.native', '--binary']
2024-11-28T09:46:10.6520232Z     raise e
2024-11-28T09:46:10.6520688Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 512, in run_build
2024-11-28T09:46:10.6521191Z     build_recipe(
2024-11-28T09:46:10.6521661Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/run_build.py", line 290, in build_recipe
2024-11-28T09:46:10.6522242Z     download_source(MetaData(recipe_path, o0), interactive)
2024-11-28T09:46:10.6522819Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 614, in download_source
2024-11-28T09:46:10.6523335Z     _try_download(m, interactive)
2024-11-28T09:46:10.6523838Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/core/build.py", line 568, in _try_download
2024-11-28T09:46:10.6524343Z     source.provide(m)
2024-11-28T09:46:10.6524812Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1114, in provide
2024-11-28T09:46:10.6525398Z     apply_one_patch(src_dir, metadata.path, patch, metadata.config, git)
2024-11-28T09:46:10.6526015Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1010, in apply_one_patch
2024-11-28T09:46:10.6526538Z     raise exception
2024-11-28T09:46:10.6527005Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 1004, in apply_one_patch
2024-11-28T09:46:10.6527523Z     try_apply_patch(
2024-11-28T09:46:10.6528000Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 945, in try_apply_patch
2024-11-28T09:46:10.6528502Z     raise e
2024-11-28T09:46:10.6528959Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/source.py", line 939, in try_apply_patch
2024-11-28T09:46:10.6529473Z     check_call_env(
2024-11-28T09:46:10.6529924Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 405, in check_call_env
2024-11-28T09:46:10.6530534Z     return _func_defaulting_env_to_os_environ("call", *popenargs, **kwargs)
2024-11-28T09:46:10.6530922Z            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-11-28T09:46:10.6531528Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/conda_build/utils.py", line 396, in _func_defaulting_env_to_os_environ
2024-11-28T09:46:10.6532143Z     subprocess.check_call(_args, **kwargs)
2024-11-28T09:46:10.6532592Z   File "/home/runner/micromamba/envs/testpr_env/lib/python3.11/subprocess.py", line 413, in check_call
2024-11-28T09:46:10.6533034Z     raise CalledProcessError(retcode, cmd)
2024-11-28T09:46:10.6534182Z subprocess.CalledProcessError: Command '['/home/runner/micromamba/envs/testpr_env/bin/patch', '--no-backup-if-mismatch', '--batch', '-Np3', '-i', '/tmp/tmpfwmnm2gw/ros-humble-moveit-simple-controller-manager.patch.native', '--binary', '--dry-run']' returned non-zero exit status 1.

Again upstreamed: https://github.com/moveit/moveit2/pull/2895/files, we can remove it.

@traversaro
Copy link
Member

Ok, now the error is:

2024-11-28T10:44:00.6863253Z Reloading output folder: /home/runner/conda-bld
2024-11-28T10:44:00.8253063Z Finalizing build for ros-humble-ament-cmake-export-definitions
2024-11-28T10:44:01.1945945Z Finalizing host for ros-humble-ament-cmake-export-definitions
2024-11-28T10:44:01.5945084Z Mamba failed to solve:
2024-11-28T10:44:01.5945535Z  - numpy 1.23.*
2024-11-28T10:44:01.5945820Z  - pip
2024-11-28T10:44:01.5946093Z  - pkg-config
2024-11-28T10:44:01.5946393Z  - python 3.11.* *_cpython
2024-11-28T10:44:01.5946764Z  - ros-humble-ament-cmake-core
2024-11-28T10:44:01.5947140Z  - ros-humble-ros-environment
2024-11-28T10:44:01.5947522Z  - ros-humble-ros-workspace
2024-11-28T10:44:01.5947885Z  - ros2-distro-mutex 0.6.* humble_*
2024-11-28T10:44:01.5948265Z  - libstdcxx >=13
2024-11-28T10:44:01.5948555Z  - libgcc >=13
2024-11-28T10:44:01.5949205Z  - libgcc >=13
2024-11-28T10:44:01.5949499Z  - __glibc >=2.17,<3.0.a0
2024-11-28T10:44:01.5949708Z 
2024-11-28T10:44:01.5949828Z with channels:
2024-11-28T10:44:01.5950010Z 
2024-11-28T10:44:01.5950142Z The reported errors are:
2024-11-28T10:44:01.5950508Z - Encountered problems while solving:
2024-11-28T10:44:01.5951004Z -   - nothing provides requested ros-humble-ros-workspace
2024-11-28T10:44:01.5951483Z - 
2024-11-28T10:44:01.5952454Z ╭───────────────────── Traceback (most recent call last) ──────────────────────╮
2024-11-28T10:44:01.5953306Z │ /home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cor │
2024-11-28T10:44:01.5954148Z │ e/run_build.py:306 in build_recipe                                           │
2024-11-28T10:44:01.5954781Z │                                                                              │
2024-11-28T10:44:01.5955294Z │   303 │   │   │                                                              │
2024-11-28T10:44:01.5955925Z │   304 │   │   │   o.config._build_id = o0.config.build_id                    │
2024-11-28T10:44:01.5956544Z │   305 │   │   │                                                              │
2024-11-28T10:44:01.5957168Z │ ❱ 306 │   │   │   o.finalize_solve(sorted_outputs)                           │
2024-11-28T10:44:01.5958066Z │   307 │   │   │                                                              │
2024-11-28T10:44:01.5958920Z │   308 │   │   │   meta = MetaData(recipe_path, o)                            │
2024-11-28T10:44:01.5959641Z │   309 │   │   │   o.set_final_build_id(meta, sorted_outputs)                 │
2024-11-28T10:44:01.5960251Z │                                                                              │
2024-11-28T10:44:01.5960976Z │ /home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cor │
2024-11-28T10:44:01.5962018Z │ e/recipe_output.py:594 in finalize_solve                                     │
2024-11-28T10:44:01.5962680Z │                                                                              │
2024-11-28T10:44:01.5963216Z │   591 │                                                                      │
2024-11-28T10:44:01.5963854Z │   592 │   def finalize_solve(self, all_outputs):                             │
2024-11-28T10:44:01.5964591Z │   593 │   │   self._solve_env("build", all_outputs)                          │
2024-11-28T10:44:01.5965293Z │ ❱ 594 │   │   self._solve_env("host", all_outputs)                           │
2024-11-28T10:44:01.5965989Z │   595 │   │   self._solve_env("run", all_outputs)                            │
2024-11-28T10:44:01.5966614Z │   596 │   │                                                                  │
2024-11-28T10:44:01.5967224Z │   597 │   │   # TODO figure out if we can avoid this?!                       │
2024-11-28T10:44:01.5967828Z │                                                                              │
2024-11-28T10:44:01.5968552Z │ /home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cor │
2024-11-28T10:44:01.5969378Z │ e/recipe_output.py:544 in _solve_env                                         │
2024-11-28T10:44:01.5970009Z │                                                                              │
2024-11-28T10:44:01.5970577Z │   541 │   │   │   elif env == "build":                                       │
2024-11-28T10:44:01.5971248Z │   542 │   │   │   │   MambaContext().target_prefix = self.config.build_prefi │
2024-11-28T10:44:01.5971993Z │   543 │   │   │   │   # solver.replace_installed(self.config.build_prefix)   │
2024-11-28T10:44:01.5972702Z │ ❱ 544 │   │   │   t = solver.solve(specs, [pkg_cache])                       │
2024-11-28T10:44:01.5973307Z │   545 │   │   │                                                              │
2024-11-28T10:44:01.5973925Z │   546 │   │   │   _, install_pkgs, _ = t.to_conda()                          │
2024-11-28T10:44:01.5974579Z │   547 │   │   │   for _, _, p in install_pkgs:                               │
2024-11-28T10:44:01.5975271Z │                                                                              │
2024-11-28T10:44:01.5975998Z │ /home/runner/micromamba/envs/testpr_env/lib/python3.11/site-packages/boa/cor │
2024-11-28T10:44:01.5976796Z │ e/solver.py:234 in solve                                                     │
2024-11-28T10:44:01.5977397Z │                                                                              │
2024-11-28T10:44:01.5978205Z │   231 │   │   │   #     error_string += f"\n\n{api_solver.explain_problems() │
2024-11-28T10:44:01.5978818Z │   232 │   │   │                                                              │
2024-11-28T10:44:01.5979412Z │   233 │   │   │   print(error_string)                                        │
2024-11-28T10:44:01.5980110Z │ ❱ 234 │   │   │   raise RuntimeError("Solver could not find solution." + err │
2024-11-28T10:44:01.5980758Z │   235 │   │                                                                  │
2024-11-28T10:44:01.5981381Z │   236 │   │   if pkg_cache_path is None:                                     │
2024-11-28T10:44:01.5982037Z │   237 │   │   │   # use values from conda                                    │
2024-11-28T10:44:01.5982724Z ╰──────────────────────────────────────────────────────────────────────────────╯
2024-11-28T10:44:01.5983334Z RuntimeError: Solver could not find solution.Mamba failed to solve:
2024-11-28T10:44:01.5983896Z  - numpy 1.23.*
2024-11-28T10:44:01.5984173Z  - pip
2024-11-28T10:44:01.5984428Z  - pkg-config
2024-11-28T10:44:01.5984727Z  - python 3.11.* *_cpython
2024-11-28T10:44:01.5985078Z  - ros-humble-ament-cmake-core
2024-11-28T10:44:01.5985453Z  - ros-humble-ros-environment
2024-11-28T10:44:01.5985807Z  - ros-humble-ros-workspace
2024-11-28T10:44:01.5986160Z  - ros2-distro-mutex 0.6.* humble_*
2024-11-28T10:44:01.5986642Z  - libstdcxx >=13
2024-11-28T10:44:01.5986927Z  - libgcc >=13
2024-11-28T10:44:01.5987230Z  - libgcc >=13
2024-11-28T10:44:01.5987510Z  - __glibc >=2.17,<3.0.a0
2024-11-28T10:44:01.5987711Z 
2024-11-28T10:44:01.5987829Z with channels:
2024-11-28T10:44:01.5988002Z 
2024-11-28T10:44:01.5988130Z The reported errors are:
2024-11-28T10:44:01.5988491Z - Encountered problems while solving:
2024-11-28T10:44:01.5988977Z -   - nothing provides requested ros-humble-ros-workspace

I vaguely remember something on a ros-workspace added as a custom recipe, but I can't remember more.

@EzraBrooks
Copy link

ros-workspace is just a little stub that installs the env-hooks that set up the ament prefix, if I recall correctly; doesn't RoboStack do some of that a bit differently?

@traversaro
Copy link
Member

Yes, I think that was defined as an additional recipe in https://github.com/sonelu/ros-humble/tree/linux-64/additional_recipes, but that is not there, I do not know if @Tobias-Fischer remembers something on that.

@traversaro
Copy link
Member

@Tobias-Fischer do you remember anything related to ros-workspace not build? No problem if not, I can look into this myself.

@Tobias-Fischer
Copy link
Contributor

No, sorry - I do remember that something fishy was going on, and that locally at some point I needed to manually build it as it wasn't built in the correct order automatically. So probably something deeper down that's wrong.

@sonelu
Copy link
Author

sonelu commented Dec 16, 2024

@traversaro I don't remember having an issue building locally, but what happens if you add back ros_workspace at the top of recipe? I think the problem is that there is no official dependency ros.index.

@traversaro
Copy link
Member

Thanks @sonelu ! Indeed adding ros_workspace explicitly in packages_select_by_deps seems to be working fine, at least locally.

@traversaro
Copy link
Member

After ~1 hour, there is a failure:

2024-12-17T22:38:33.0082499Z RuntimeError: Solver could not find solution.Mamba failed to solve:
2024-12-17T22:38:33.0083034Z  - gazebo 11.*
2024-12-17T22:38:33.0083312Z  - libabseil 20240116.*
2024-12-17T22:38:33.0083632Z  - libprotobuf 4.25.3*
2024-12-17T22:38:33.0083924Z  - numpy 1.23.*
2024-12-17T22:38:33.0084185Z  - pip
2024-12-17T22:38:33.0084430Z  - pkg-config
2024-12-17T22:38:33.0084696Z  - python 3.11.* *_cpython
2024-12-17T22:38:33.0085015Z  - ros-humble-ament-cmake
2024-12-17T22:38:33.0085347Z  - ros-humble-ros-environment
2024-12-17T22:38:33.0085710Z  - ros-humble-ros-workspace
2024-12-17T22:38:33.0086048Z  - ros2-distro-mutex 0.6.* humble_*
2024-12-17T22:38:33.0086399Z  - libstdcxx >=13
2024-12-17T22:38:33.0086669Z  - libgcc >=13
2024-12-17T22:38:33.0086916Z  - libgcc >=13
2024-12-17T22:38:33.0087282Z  - __glibc >=2.17,<3.0.a0
2024-12-17T22:38:33.0087473Z 
2024-12-17T22:38:33.0087577Z with channels:
2024-12-17T22:38:33.0087829Z 
2024-12-17T22:38:33.0087951Z The reported errors are:
2024-12-17T22:38:33.0088334Z - Encountered problems while solving:
2024-12-17T22:38:33.0088862Z -   - package gazebo-11.0.0-h2bf7b13_5 requires libprotobuf >=3.11.4,<3.12.0a0, 
2024-12-17T22:38:33.0089454Z but none of the providers can be installed

that is strange, as conda create -n gazebotest gazebo==11.* libabseil==20240116.* libprotobuf==4.25.3.* python==3.11.* can be solved without problems. From the error, it seems like boa thinks that gazebo 11.* constraint is actually gazebo==11.0.0. Unfortunately boa was archived recently (see mamba-org/boa#403) so it is a bit pointless to debug these kind of errors. The two possible options that I see at this point are:

@traversaro
Copy link
Member

As discussed in RoboStack/vinca#65, I switched this PR to use the boa vinca branch.

@traversaro
Copy link
Member

After ~1 hour, there is a failure:

2024-12-17T22:38:33.0082499Z RuntimeError: Solver could not find solution.Mamba failed to solve:
2024-12-17T22:38:33.0083034Z  - gazebo 11.*
2024-12-17T22:38:33.0083312Z  - libabseil 20240116.*
2024-12-17T22:38:33.0083632Z  - libprotobuf 4.25.3*
2024-12-17T22:38:33.0083924Z  - numpy 1.23.*
2024-12-17T22:38:33.0084185Z  - pip
2024-12-17T22:38:33.0084430Z  - pkg-config
2024-12-17T22:38:33.0084696Z  - python 3.11.* *_cpython
2024-12-17T22:38:33.0085015Z  - ros-humble-ament-cmake
2024-12-17T22:38:33.0085347Z  - ros-humble-ros-environment
2024-12-17T22:38:33.0085710Z  - ros-humble-ros-workspace
2024-12-17T22:38:33.0086048Z  - ros2-distro-mutex 0.6.* humble_*
2024-12-17T22:38:33.0086399Z  - libstdcxx >=13
2024-12-17T22:38:33.0086669Z  - libgcc >=13
2024-12-17T22:38:33.0086916Z  - libgcc >=13
2024-12-17T22:38:33.0087282Z  - __glibc >=2.17,<3.0.a0
2024-12-17T22:38:33.0087473Z 
2024-12-17T22:38:33.0087577Z with channels:
2024-12-17T22:38:33.0087829Z 
2024-12-17T22:38:33.0087951Z The reported errors are:
2024-12-17T22:38:33.0088334Z - Encountered problems while solving:
2024-12-17T22:38:33.0088862Z -   - package gazebo-11.0.0-h2bf7b13_5 requires libprotobuf >=3.11.4,<3.12.0a0, 
2024-12-17T22:38:33.0089454Z but none of the providers can be installed

that is strange, as conda create -n gazebotest gazebo==11.* libabseil==20240116.* libprotobuf==4.25.3.* python==3.11.* can be solved without problems. From the error, it seems like boa thinks that gazebo 11.* constraint is actually gazebo==11.0.0. Unfortunately boa was archived recently (see mamba-org/boa#403) so it is a bit pointless to debug these kind of errors. The two possible options that I see at this point are:

* Try to find a boa+mamba version that works fine (if @sonelu has still some environment used to build everything, we could recover a good combination from there)

* Just migrate everything to rattler-build, reusing what was done in https://github.com/RoboStack/ros-jazzy and https://github.com/RoboStack/vinca/tree/rattler-build .

Actually I may found an easier solution in f32a8cb .

@traversaro
Copy link
Member

Actually I may found an easier solution in f32a8cb .

Now, that does not work. At this point my bet is on the rattler-build migration: #229 .

@Tobias-Fischer
Copy link
Contributor

See #229

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants