No informative error message, but asv will fail to build project and import benchmark suite

[adam2392]

I have an issue running asv benchmarking and there is no informative message. The following is my input command and verbose output. Notice there is no error, or otherwise warning even. My asv.conf.json is here.

(sklearn-dev) (base) adam2392@arm64-apple-darwin20 asv_benchmarks % asv run --bench RandomForest --verbose
· Running '/usr/bin/git config init.defaultBranch'
  OUTPUT -------->
  main
· Running '/usr/bin/git rev-parse main^{commit}'
  OUTPUT -------->
  fa14001fa19a262c7eb43b2ef3c0d6b56b4c8fad
· Creating environments
·· Running '/Users/adam2392/Documents/scikit-learn/asv_benchmarks/env/f54bd330ca16e78cf44019534f1c552d/bin/python -c pass'
· Discovering benchmarks
·· Running '/usr/bin/git rev-parse main^{commit}'
   OUTPUT -------->
   fa14001fa19a262c7eb43b2ef3c0d6b56b4c8fad
·· Running '/usr/bin/git -c protocol.file.allow=always submodule deinit -f .'
·· Running '/usr/bin/git checkout -f fa14001fa19a262c7eb43b2ef3c0d6b56b4c8fad'
   OUTPUT -------->
   HEAD is now at fa14001fa DOC Link to right user guide section in `StratifiedGroupKFold` docstring (#29447)
·· Running '/usr/bin/git clean -fdx'
   OUTPUT -------->
   Removing build/
·· Running '/usr/bin/git -c protocol.file.allow=always submodule update --init --recursive'
·· Uninstalling from mamba-py3.10-cython3.0.10-joblib1.4.2-numpy1.25.2-pandas2.2.2-scipy1.13.0-setuptools-threadpoolctl3.5.0
·· Running '/Users/adam2392/Documents/scikit-learn/asv_benchmarks/env/f54bd330ca16e78cf44019534f1c552d/bin/python -mpip uninstall -y scikit-learn'
   OUTPUT -------->
   Found existing installation: scikit-learn 1.6.dev0
   Uninstalling scikit-learn-1.6.dev0:
     Successfully uninstalled scikit-learn-1.6.dev0
·· Running '/usr/bin/git name-rev --name-only --exclude=remotes/* --no-undefined fa14001fa19a262c7eb43b2ef3c0d6b56b4c8fad'
   OUTPUT -------->
   main
·· Building fa14001f <main> for mamba-py3.10-cython3.0.10-joblib1.4.2-numpy1.25.2-pandas2.2.2-scipy1.13.0-setuptools-threadpoolctl3.5.0
·· Running '/Users/adam2392/Documents/scikit-learn/asv_benchmarks/env/f54bd330ca16e78cf44019534f1c552d/bin/python -m pip install -e .'
   OUTPUT -------->
   Obtaining file:///Users/adam2392/Documents/scikit-learn/asv_benchmarks/env/f54bd330ca16e78cf44019534f1c552d/project
     Installing build dependencies: started
     Installing build dependencies: finished with status 'done'
     Checking if build backend supports build_editable: started
     Checking if build backend supports build_editable: finished with status 'done'
     Getting requirements to build editable: started
     Getting requirements to build editable: finished with status 'done'
     Preparing editable metadata (pyproject.toml): started
     Preparing editable metadata (pyproject.toml): still running...
     Preparing editable metadata (pyproject.toml): finished with status 'done'
   Requirement already satisfied: numpy>=1.19.5 in /Users/adam2392/Documents/scikit-learn/asv_benchmarks/env/f54bd330ca16e78cf44019534f1c552d/lib/python3.10/site-packages (from scikit-learn==1.6.dev0) (1.25.2)
   Requirement already satisfied: scipy>=1.6.0 in /Users/adam2392/Documents/scikit-learn/asv_benchmarks/env/f54bd330ca16e78cf44019534f1c552d/lib/python3.10/site-packages (from scikit-learn==1.6.dev0) (1.13.0)
   Requirement already satisfied: joblib>=1.2.0 in /Users/adam2392/Documents/scikit-learn/asv_benchmarks/env/f54bd330ca16e78cf44019534f1c552d/lib/python3.10/site-packages (from scikit-learn==1.6.dev0) (1.4.2)
   Requirement already satisfied: threadpoolctl>=3.1.0 in /Users/adam2392/Documents/scikit-learn/asv_benchmarks/env/f54bd330ca16e78cf44019534f1c552d/lib/python3.10/site-packages (from scikit-learn==1.6.dev0) (3.5.0)
   Building wheels for collected packages: scikit-learn

     Building editable for scikit-learn (pyproject.toml): started
     Building editable for scikit-learn (pyproject.toml): finished with status 'done'
     Created wheel for scikit-learn: filename=scikit_learn-1.6.dev0-cp310-cp310-macosx_14_0_arm64.whl size=8901 sha256=32e8af1c733ceeae4cea6c738fc035e7a6dbd56a6a6316b67a9545587ee06c55
     Stored in directory: /private/var/folders/6_/sl83qtkd68x3_mvfys07_6qm0000gn/T/pip-ephem-wheel-cache-ai289hc1/wheels/cb/20/1a/c66ee6fc37523344053f5991ce0019fbb730aeca21a6d183b3
   Successfully built scikit-learn
   Installing collected packages: scikit-learn
   Successfully installed scikit-learn-1.6.dev0
·· Running '/usr/bin/git name-rev --name-only --exclude=remotes/* --no-undefined fa14001fa19a262c7eb43b2ef3c0d6b56b4c8fad'
   OUTPUT -------->
   main
·· Installing fa14001f <main> into mamba-py3.10-cython3.0.10-joblib1.4.2-numpy1.25.2-pandas2.2.2-scipy1.13.0-setuptools-threadpoolctl3.5.0
·· Failed to build the project and import the benchmark suite.
(sklearn-dev) (base) adam2392@arm64-apple-darwin20 asv_benchmarks %

Is there anything I can do to help debug, or improve the reporting of this issue?

[jdkent]

Chiming in to say I'm dealing with the same issue, but for me reverting back to version 0.6.2 works

[catanzaromj]

I'm also dealing with the same issue but I had to revert to v0.6.1 to be error free. v0.6.2 gave the same error.