no model named 'torch' #740

DeForestDiamond · 2023-05-04T03:14:54Z

I'm really not used to using command prompt and I'm guessing this is an issue with torch but i even reinstalled it and im still getting this error. Any ideas?

(I know the absolute bare minimum about this stuff. So, please talk to me like I'm an idiot, lol)

(venv) C:\Users\Nutri>pip install -U xformers
Collecting xformers
  Using cached xformers-0.0.16.tar.gz (7.3 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [21 lines of output]
      Traceback (most recent call last):
        File "C:\Users\Nutri\venv\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 353, in <module>
          main()
        File "C:\Users\Nutri\venv\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Users\Nutri\venv\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "C:\Users\Nutri\AppData\Local\Temp\pip-build-env-w3jebqad\overlay\Lib\site-packages\setuptools\build_meta.py", line 341, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Users\Nutri\AppData\Local\Temp\pip-build-env-w3jebqad\overlay\Lib\site-packages\setuptools\build_meta.py", line 323, in _get_build_requires
          self.run_setup()
        File "C:\Users\Nutri\AppData\Local\Temp\pip-build-env-w3jebqad\overlay\Lib\site-packages\setuptools\build_meta.py", line 488, in run_setup
          self).run_setup(setup_script=setup_script)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Users\Nutri\AppData\Local\Temp\pip-build-env-w3jebqad\overlay\Lib\site-packages\setuptools\build_meta.py", line 338, in run_setup
          exec(code, locals())
        File "<string>", line 23, in <module>
      ModuleNotFoundError: No module named 'torch'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.```

danthe3rd · 2023-05-04T06:02:53Z

You should install torch before installing xFormers.

DeForestDiamond · 2023-05-04T14:01:21Z

I already had torch, I needed it to install stable diffusion.

ivanprado · 2023-05-04T14:36:10Z

I think the problem is that torch is imported in setup.py (see here https://github.com/facebookresearch/xformers/blob/main/setup.py#L23).

This is problematic when installing all the dependencies of a project from scratch in an environment. All the dependencies are resolved properly and torch is also going to be installed... but previously, the setup.py of all projects are invoked and at this stage, torch has not been installed yet. I don't know exactly the solution to that, but it seems that this breaking the contract of setup.py

The workaround I found is to install the torch dependency in advance. For example:

pip install torch
pip install -r requirements. txt

DeForestDiamond · 2023-05-04T21:41:28Z

Thank you, I'll give that a try after work :)

worthy7 · 2023-05-07T03:46:17Z

I am also getting this issue, and am unsure how to solve it.

I am adding this package inside a venv which already has the latest pytorch installed. So I can only assum ethat this "subprocess" doing something in another environment. I not a python/pip expert at all.

JosefWN · 2023-05-08T12:19:09Z

Same issue for me, torch is already installed and working but I can't install xformers. Seems specific to Windows, as I could install xformers without issues on macOS the other day.

adampauls · 2023-06-06T22:31:29Z

I'm hitting this issue with poetry on macOS.

jinmingyi1998 · 2023-06-07T06:17:05Z

I'm hitting this issue with poetry on macOS.

a trick way is to install torch correctly, you make sure yourself.
and then you just pip install xformers --no-dependencies

rkique · 2023-06-08T19:15:53Z

Yep, installing pytorch from source and then pip install xformers --no-dependencies works for me.

adampauls · 2023-06-11T23:25:29Z

@jinmingyi1998 do I understand correctly that the suggested workaround requires not putting xformers in my pyproject.toml and manually installing it instead? That's definitely not an ideal use of poetry?

Am I understanding correctly that xformers is expressly choosing to disregard the recommendation against "building packages in the destination environment" mentioned in this comment?

danthe3rd · 2023-06-12T07:18:42Z

That's definitely not a good situation, but we couldn't find a satisfying solution. The problem with not building in the destination environment is that you might end up building xFormers with a different version of Pytorch than the one in your environment, which will break everything.
We had some discussion in this PR: #743

adampauls · 2023-06-12T16:24:58Z

Yes, I saw that discussion. Is it possible to provide some pre-built wheels that build in that relationship? E.g. I could declare a dependency on xformers-pytorch-2-0-1 = "^0.0.20". It's a little annoying for the library user that they need to put the version number of pytorch twice, but it's less annoying that not be able to use poetry properly. And you could still use the base xformers dependency with custom build if you don't want to use one of the already built xformers binaries?

danthe3rd · 2023-06-12T16:35:41Z

You can also use the pypi wheels which are already built:
https://pypi.org/project/xformers/#history
As the binaries are built with a specific version of pytorch, they have that version pinned as a requirement. I hope this helps ...

adampauls · 2023-06-12T21:35:30Z

Hmm, maybe I missed something. The issue above happens when you use xformers = "^0.0.20" with poetry, which should be fetching one of those wheels. A minimal poetry project with pyproject.toml:

[tool.poetry]
name = "xformers-test"
version = "0.1.0"
description = ""
authors = []
readme = "README.md"
packages = [{include = "xformers_test"}]

[tool.poetry.dependencies]
python = "^3.11"
xformers = "^0.0.20"

[build-system]
requires = ["poetry-core"]
build-backend = "poetry.core.masonry.api"

will crash on poetry install with

  Backend subprocess exited when trying to invoke get_requires_for_build_wheel
...
  ModuleNotFoundError: No module named 'torch'

I'm using

xformers-test % poetry --version
Poetry (version 1.5.1)
xformers-test % pip3 --version
pip 22.3.1 from /opt/homebrew/lib/python3.11/site-packages/pip (python 3.11)

lynxoid · 2023-06-13T18:04:16Z

Also running into this issue. My pip requirements file has these versions:

torch==2.0.1
notebook==6.5.4
transformers==4.30.0
matplotlib==3.7.1
scikit-learn==1.2.2
pandas==2.0.2
xformers==0.0.20

and I am running in a venv with py3.10. It looks to me that either 1) xformers is uninstalling torch before its own install or 2) xformers install is ignoring venv paths and installing on the machine natively (and so it does not see an installed torch dependency).

I tried pip install --pre xformers, pip install xformers==0.0.20, pip install xformers with the same result:

Collecting xformers
  Using cached xformers-0.0.20.tar.gz (7.6 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [17 lines of output]
      Traceback (most recent call last):
        File "/Users/daryafilippova/dev/environments/pytorch_2/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/Users/daryafilippova/dev/environments/pytorch_2/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
        File "/Users/daryafilippova/dev/environments/pytorch_2/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
        File "/private/var/folders/ft/jrq7289j5d5_mvl5phb5pnlm0000gn/T/pip-build-env-jjxyy34d/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 341, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
        File "/private/var/folders/ft/jrq7289j5d5_mvl5phb5pnlm0000gn/T/pip-build-env-jjxyy34d/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 323, in _get_build_requires
          self.run_setup()
        File "/private/var/folders/ft/jrq7289j5d5_mvl5phb5pnlm0000gn/T/pip-build-env-jjxyy34d/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 487, in run_setup
          super(_BuildMetaLegacyBackend,
        File "/private/var/folders/ft/jrq7289j5d5_mvl5phb5pnlm0000gn/T/pip-build-env-jjxyy34d/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 338, in run_setup
          exec(code, locals())
        File "<string>", line 23, in <module>
      ModuleNotFoundError: No module named 'torch'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

adampauls · 2023-06-14T23:38:47Z

You can also use the pypi wheels which are already built:

I see that there are no prebuilt binaries for MacOS in PyPI, which would explain why it tries to build locally.

danthe3rd · 2023-06-15T06:35:05Z

xformers is not compatible with MacOS

drscotthawley · 2023-06-16T04:23:46Z

@danthe3rd Facebook should put that in the README in the install instructions. Would save so many of us wasted time.

(Sure it says, "Recommended, Windows & Linux", but that's much less clear than actually saying "Does not work on Mac")

adampauls · 2023-06-17T18:32:25Z

HuggingFace complains that xformers is not available. I know that's HF's fault (or maybe torch?), but it's annoying that I can't silence the warning or that the warning exists at all. I'll figure out where the warning is coming from and file an issue there.

sidhartha-roy · 2023-06-19T14:25:19Z

I am getting the same issue, I have a Mac M1 Pro chip.

I ensured that pytorch is installed before trying to install xformers.

>>> print(torch.__version__)
2.0.1

I still get the same error:

Collecting xformers
  Using cached xformers-0.0.20.tar.gz (7.6 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [21 lines of output]
      Traceback (most recent call last):
        File "/Users/sidhartharoy/research-stage/llm-databricks/env/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/Users/sidhartharoy/research-stage/llm-databricks/env/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/Users/sidhartharoy/research-stage/llm-databricks/env/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/private/var/folders/mv/wh9dwtcd2wg8x2d82s0rbstm0000gq/T/pip-build-env-j67vrkzj/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 341, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=['wheel'])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/private/var/folders/mv/wh9dwtcd2wg8x2d82s0rbstm0000gq/T/pip-build-env-j67vrkzj/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 323, in _get_build_requires
          self.run_setup()
        File "/private/var/folders/mv/wh9dwtcd2wg8x2d82s0rbstm0000gq/T/pip-build-env-j67vrkzj/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 488, in run_setup
          self).run_setup(setup_script=setup_script)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/private/var/folders/mv/wh9dwtcd2wg8x2d82s0rbstm0000gq/T/pip-build-env-j67vrkzj/overlay/lib/python3.11/site-packages/setuptools/build_meta.py", line 338, in run_setup
          exec(code, locals())
        File "<string>", line 23, in <module>
      ModuleNotFoundError: No module named 'torch'
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

I tried the following options:
pip install --pre -U xformers
pip install xformers --no-dependencies

pip install ninja
pip install -v -U git+https://github.com/facebookresearch/xformers.git@main#egg=xformers

I still get the exact same error as shown above.

DeForestDiamond · 2023-06-22T13:21:04Z

I completely forgot I started this question my bad... I ended up downloading the "A1111 WebUI Easy Installer and Launcher". It will install all dependencies and everything you need and has an option to install x-formers. Worked like a charm.

talhaanwarch · 2023-07-09T17:54:53Z

--no-dependencies

getting same on linux with torch 2.0.1

dfiru · 2023-08-03T23:08:07Z

this thread is cursed

I'm not sure if it's correct way of handling things, but correcting this string to '==0.0.20' fixes xformers install for me - and maybe for others too. Please see this thread, this is the issue I had (trying to install InvokeAI): facebookresearch/xformers#740

MichaelMalike · 2023-10-26T09:15:45Z

Here is my solution in my environment:
Firstly my server is aarch64, and maybe there is no such problem on the x86_64 platform at all.
I got the same error messages just like above when I tried to use pip install xformers:

ModuleNotFoundError: No module named 'torch'

But I already installed torch, so I followed the suggestions in this issue, I tried --no-dependencies and --pre -U, unfortunately nothing works.
Then I suddenly found I didn't install wheel yet, maybe things will change if I install it
pip install wheel
Indeed, after the wheel is installed, "ModuleNotFoundError: No module named 'torch'" is gone away, it started to compile but I got a new error message:

ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1900, in _run_ninja_build
subprocess.run(
File "/stable-diffusion-webui/runtime/python/3.10.6/lib/python3.10/subprocess.py", line 524, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

I installed ninja
pip install ninja
But still same compile errors
Then I tried to download the source code of xformers:
git clone https://github.com/facebookresearch/xformers.git
git checkout v0.0.16rc425
pip install .
Still no lucky, has same compile errors.
Then I looked the error messages again, and found a clue:

error: ‘vld1q_f32_x2’ was not declared in this scope

I searched the error, and it is said it's a problem of gcc in aarch64, and will be fixed in gcc-8.4.1-1
I just have gcc-10.3.1 at hand, so I tried it and it works!
CC=/gcc1031/bin/gcc CXX=/gcc1031/bin/c++ pip install .

Building wheels for collected packages: xformers
Building wheel for xformers (setup.py) ... done
Created wheel for xformers: filename=xformers-0.0.16+6f3c20f.d20231026-cp310-cp310-linux_aarch64.whl size=7641635 sha256=222f900bf3f4917368b6aa1108080ccdd59d1c2589e2553a2c94dea57cee86f0
Stored in directory: /tmp/pip-ephem-wheel-cache-hnw74sa9/wheels/6f/f5/81/43807df029d66aff5bf231868b0c3f7fbde0b32ed35d595fe7
Successfully built xformers
DEPRECATION: pytorch-lightning 1.7.6 has a non-standard dependency specifier torch>=1.9.. pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of pytorch-lightning or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
DEPRECATION: torchsde 0.2.5 has a non-standard dependency specifier numpy>=1.19.; python_version >= "3.7". pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of torchsde or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
Installing collected packages: xformers
Successfully installed xformers-0.0.16+6f3c20f.d20231026

carlthome · 2023-10-29T22:24:14Z

Also struggling with this issue now on macOS M1. Is there any reasonable work around? Would want to avoid running in Docker Desktop when debugging unit tests.

aurban0 · 2023-11-01T12:19:05Z

Here is my solution in my environment: Firstly my server is aarch64, and maybe there is no such problem on the x86_64 platform at all. I got the same error messages just like above when I tried to use pip install xformers:

ModuleNotFoundError: No module named 'torch'

But I already installed torch, so I followed the suggestions in this issue, I tried --no-dependencies and --pre -U, unfortunately nothing works. Then I suddenly found I didn't install wheel yet, maybe things will change if I install it pip install wheel Indeed, after the wheel is installed, "ModuleNotFoundError: No module named 'torch'" is gone away, it started to compile but I got a new error message:

ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1900, in _run_ninja_build
subprocess.run(
File "/stable-diffusion-webui/runtime/python/3.10.6/lib/python3.10/subprocess.py", line 524, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

I installed ninja pip install ninja But still same compile errors Then I tried to download the source code of xformers: git clone https://github.com/facebookresearch/xformers.git git checkout v0.0.16rc425 pip install . Still no lucky, has same compile errors. Then I looked the error messages again, and found a clue:

error: ‘vld1q_f32_x2’ was not declared in this scope

I searched the error, and it is said it's a problem of gcc in aarch64, and will be fixed in gcc-8.4.1-1 I just have gcc-10.3.1 at hand, so I tried it and it works! CC=/gcc1031/bin/gcc CXX=/gcc1031/bin/c++ pip install .

Building wheels for collected packages: xformers
Building wheel for xformers (setup.py) ... done
Created wheel for xformers: filename=xformers-0.0.16+6f3c20f.d20231026-cp310-cp310-linux_aarch64.whl size=7641635 sha256=222f900bf3f4917368b6aa1108080ccdd59d1c2589e2553a2c94dea57cee86f0
Stored in directory: /tmp/pip-ephem-wheel-cache-hnw74sa9/wheels/6f/f5/81/43807df029d66aff5bf231868b0c3f7fbde0b32ed35d595fe7
Successfully built xformers
DEPRECATION: pytorch-lightning 1.7.6 has a non-standard dependency specifier torch>=1.9.. pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of pytorch-lightning or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
DEPRECATION: torchsde 0.2.5 has a non-standard dependency specifier numpy>=1.19.; python_version >= "3.7". pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of torchsde or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
Installing collected packages: xformers
Successfully installed xformers-0.0.16+6f3c20f.d20231026

The real solution. Many thanks.

HuabeiYou · 2024-03-10T18:57:56Z

Here is my solution in my environment: Firstly my server is aarch64, and maybe there is no such problem on the x86_64 platform at all. I got the same error messages just like above when I tried to use pip install xformers:

ModuleNotFoundError: No module named 'torch'

But I already installed torch, so I followed the suggestions in this issue, I tried --no-dependencies and --pre -U, unfortunately nothing works. Then I suddenly found I didn't install wheel yet, maybe things will change if I install it pip install wheel Indeed, after the wheel is installed, "ModuleNotFoundError: No module named 'torch'" is gone away, it started to compile but I got a new error message:

ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1900, in _run_ninja_build
subprocess.run(
File "/stable-diffusion-webui/runtime/python/3.10.6/lib/python3.10/subprocess.py", line 524, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

I installed ninja pip install ninja But still same compile errors Then I tried to download the source code of xformers: git clone https://github.com/facebookresearch/xformers.git git checkout v0.0.16rc425 pip install . Still no lucky, has same compile errors. Then I looked the error messages again, and found a clue:

error: ‘vld1q_f32_x2’ was not declared in this scope

I searched the error, and it is said it's a problem of gcc in aarch64, and will be fixed in gcc-8.4.1-1 I just have gcc-10.3.1 at hand, so I tried it and it works! CC=/gcc1031/bin/gcc CXX=/gcc1031/bin/c++ pip install .

Building wheels for collected packages: xformers
Building wheel for xformers (setup.py) ... done
Created wheel for xformers: filename=xformers-0.0.16+6f3c20f.d20231026-cp310-cp310-linux_aarch64.whl size=7641635 sha256=222f900bf3f4917368b6aa1108080ccdd59d1c2589e2553a2c94dea57cee86f0
Stored in directory: /tmp/pip-ephem-wheel-cache-hnw74sa9/wheels/6f/f5/81/43807df029d66aff5bf231868b0c3f7fbde0b32ed35d595fe7
Successfully built xformers
DEPRECATION: pytorch-lightning 1.7.6 has a non-standard dependency specifier torch>=1.9.. pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of pytorch-lightning or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
DEPRECATION: torchsde 0.2.5 has a non-standard dependency specifier numpy>=1.19.; python_version >= "3.7". pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of torchsde or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
Installing collected packages: xformers
Successfully installed xformers-0.0.16+6f3c20f.d20231026

Thanks for the explanation! In my case (Apple M1, MacOS 13.6.4), after installing wheel and torch, the error I got when building wheel wasclang: error unsupported option '-fopenmp'. I did

CC=/opt/homebrew/opt/gcc/bin/gcc-13 CXX=/opt/homebrew/opt/gcc/bin/c++-13 pip install xformers

and it installed.

chintanckg · 2024-03-17T15:22:46Z

None of the provided solutions are working! Any straight way solution that works on ubuntu ec2 instance?

VictorMustin · 2024-03-21T14:55:08Z

pip install xformers --no-dependencies

Yes, it worked for me (macos m3).

I have done :

poetry run python -m pip install --upgrade pip poetry run python -m pip install --upgrade setuptools poetry run python -m pip install torch>=2.1.0 poetry run python -m pip install wheel ninja poetry run python -m pip install xformers --no-dependencies

Ugly, but it work...

Thanks a lot

Tried everything and doing things in this order worked for me (windows 11) :))

ThePowerOfElectricity · 2024-04-15T22:30:26Z

The issue still persists. Windows 10 // Torch 2.2.2
None of the solutions worked for me, I'm giving up on the project using it and moving on with life.

EDIT: Adding the pip flag --no-use-pep517 got me a different error message further downstream

shiroxxsora · 2024-04-20T15:14:17Z

Yes, it worked for me (macos m3).

I have done :

poetry run python -m pip install --upgrade pip poetry run python -m pip install --upgrade setuptools poetry run python -m pip install torch>=2.1.0 poetry run python -m pip install wheel ninja poetry run python -m pip install xformers --no-dependencies

Ugly, but it work...

Thanks a lot

thanks

631068264 · 2024-05-12T14:29:58Z

@HuabeiYou

Here is my solution in my environment: Firstly my server is aarch64, and maybe there is no such problem on the x86_64 platform at all. I got the same error messages just like above when I tried to use pip install xformers:

ModuleNotFoundError: No module named 'torch'

But I already installed torch, so I followed the suggestions in this issue, I tried --no-dependencies and --pre -U, unfortunately nothing works. Then I suddenly found I didn't install wheel yet, maybe things will change if I install it pip install wheel Indeed, after the wheel is installed, "ModuleNotFoundError: No module named 'torch'" is gone away, it started to compile but I got a new error message:

ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1900, in _run_ninja_build
subprocess.run(
File "/stable-diffusion-webui/runtime/python/3.10.6/lib/python3.10/subprocess.py", line 524, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

I installed ninja pip install ninja But still same compile errors Then I tried to download the source code of xformers: git clone https://github.com/facebookresearch/xformers.git git checkout v0.0.16rc425 pip install . Still no lucky, has same compile errors. Then I looked the error messages again, and found a clue:

error: ‘vld1q_f32_x2’ was not declared in this scope

I searched the error, and it is said it's a problem of gcc in aarch64, and will be fixed in gcc-8.4.1-1 I just have gcc-10.3.1 at hand, so I tried it and it works! CC=/gcc1031/bin/gcc CXX=/gcc1031/bin/c++ pip install .

Building wheels for collected packages: xformers
Building wheel for xformers (setup.py) ... done
Created wheel for xformers: filename=xformers-0.0.16+6f3c20f.d20231026-cp310-cp310-linux_aarch64.whl size=7641635 sha256=222f900bf3f4917368b6aa1108080ccdd59d1c2589e2553a2c94dea57cee86f0
Stored in directory: /tmp/pip-ephem-wheel-cache-hnw74sa9/wheels/6f/f5/81/43807df029d66aff5bf231868b0c3f7fbde0b32ed35d595fe7
Successfully built xformers
DEPRECATION: pytorch-lightning 1.7.6 has a non-standard dependency specifier torch>=1.9.. pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of pytorch-lightning or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
DEPRECATION: torchsde 0.2.5 has a non-standard dependency specifier numpy>=1.19.; python_version >= "3.7". pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of torchsde or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
Installing collected packages: xformers
Successfully installed xformers-0.0.16+6f3c20f.d20231026

Thanks for the explanation! In my case (Apple M1, MacOS 13.6.4), after installing wheel and torch, the error I got when building wheel wasclang: error unsupported option '-fopenmp'. I did
CC=/opt/homebrew/opt/gcc/bin/gcc-13 CXX=/opt/homebrew/opt/gcc/bin/c++-13 pip install xformers
and it installed.

@HuabeiYou How to find CC and CXX path ?

HuabeiYou · 2024-05-12T15:30:34Z

@HuabeiYou
Here is my solution in my environment: Firstly my server is aarch64, and maybe there is no such problem on the x86_64 platform at all. I got the same error messages just like above when I tried to use pip install xformers:

ModuleNotFoundError: No module named 'torch'

But I already installed torch, so I followed the suggestions in this issue, I tried --no-dependencies and --pre -U, unfortunately nothing works. Then I suddenly found I didn't install wheel yet, maybe things will change if I install it pip install wheel Indeed, after the wheel is installed, "ModuleNotFoundError: No module named 'torch'" is gone away, it started to compile but I got a new error message:

ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1900, in _run_ninja_build
subprocess.run(
File "/stable-diffusion-webui/runtime/python/3.10.6/lib/python3.10/subprocess.py", line 524, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

I installed ninja pip install ninja But still same compile errors Then I tried to download the source code of xformers: git clone https://github.com/facebookresearch/xformers.git git checkout v0.0.16rc425 pip install . Still no lucky, has same compile errors. Then I looked the error messages again, and found a clue:

error: ‘vld1q_f32_x2’ was not declared in this scope

I searched the error, and it is said it's a problem of gcc in aarch64, and will be fixed in gcc-8.4.1-1 I just have gcc-10.3.1 at hand, so I tried it and it works! CC=/gcc1031/bin/gcc CXX=/gcc1031/bin/c++ pip install .

Building wheels for collected packages: xformers
Building wheel for xformers (setup.py) ... done
Created wheel for xformers: filename=xformers-0.0.16+6f3c20f.d20231026-cp310-cp310-linux_aarch64.whl size=7641635 sha256=222f900bf3f4917368b6aa1108080ccdd59d1c2589e2553a2c94dea57cee86f0
Stored in directory: /tmp/pip-ephem-wheel-cache-hnw74sa9/wheels/6f/f5/81/43807df029d66aff5bf231868b0c3f7fbde0b32ed35d595fe7
Successfully built xformers
DEPRECATION: pytorch-lightning 1.7.6 has a non-standard dependency specifier torch>=1.9.. pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of pytorch-lightning or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
DEPRECATION: torchsde 0.2.5 has a non-standard dependency specifier numpy>=1.19.; python_version >= "3.7". pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of torchsde or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
Installing collected packages: xformers
Successfully installed xformers-0.0.16+6f3c20f.d20231026

Thanks for the explanation! In my case (Apple M1, MacOS 13.6.4), after installing wheel and torch, the error I got when building wheel wasclang: error unsupported option '-fopenmp'. I did
CC=/opt/homebrew/opt/gcc/bin/gcc-13 CXX=/opt/homebrew/opt/gcc/bin/c++-13 pip install xformers
and it installed.
@HuabeiYou How to find CC and CXX path ?

From my (very limited) understanding, the clang error was thrown because MacOS's default C compiler doesn't support some required options for compiling certain dependencies. To resolve this, we need to use an alternative compiler like gcc.

brew install gcc

After installation, you can typically find the GCC and G++ compilers under $HOMEBREW_PREFIX/bin/ or $HOMEBREW_PREFIX/opt/gcc/bin/ and you can use them as CC and CXX respectively.

631068264 · 2024-05-13T07:40:25Z

@HuabeiYou
Here is my solution in my environment: Firstly my server is aarch64, and maybe there is no such problem on the x86_64 platform at all. I got the same error messages just like above when I tried to use pip install xformers:

ModuleNotFoundError: No module named 'torch'

But I already installed torch, so I followed the suggestions in this issue, I tried --no-dependencies and --pre -U, unfortunately nothing works. Then I suddenly found I didn't install wheel yet, maybe things will change if I install it pip install wheel Indeed, after the wheel is installed, "ModuleNotFoundError: No module named 'torch'" is gone away, it started to compile but I got a new error message:

ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1900, in _run_ninja_build
subprocess.run(
File "/stable-diffusion-webui/runtime/python/3.10.6/lib/python3.10/subprocess.py", line 524, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

I installed ninja pip install ninja But still same compile errors Then I tried to download the source code of xformers: git clone https://github.com/facebookresearch/xformers.git git checkout v0.0.16rc425 pip install . Still no lucky, has same compile errors. Then I looked the error messages again, and found a clue:

error: ‘vld1q_f32_x2’ was not declared in this scope

I searched the error, and it is said it's a problem of gcc in aarch64, and will be fixed in gcc-8.4.1-1 I just have gcc-10.3.1 at hand, so I tried it and it works! CC=/gcc1031/bin/gcc CXX=/gcc1031/bin/c++ pip install .

Building wheels for collected packages: xformers
Building wheel for xformers (setup.py) ... done
Created wheel for xformers: filename=xformers-0.0.16+6f3c20f.d20231026-cp310-cp310-linux_aarch64.whl size=7641635 sha256=222f900bf3f4917368b6aa1108080ccdd59d1c2589e2553a2c94dea57cee86f0
Stored in directory: /tmp/pip-ephem-wheel-cache-hnw74sa9/wheels/6f/f5/81/43807df029d66aff5bf231868b0c3f7fbde0b32ed35d595fe7
Successfully built xformers
DEPRECATION: pytorch-lightning 1.7.6 has a non-standard dependency specifier torch>=1.9.. pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of pytorch-lightning or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
DEPRECATION: torchsde 0.2.5 has a non-standard dependency specifier numpy>=1.19.; python_version >= "3.7". pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of torchsde or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
Installing collected packages: xformers
Successfully installed xformers-0.0.16+6f3c20f.d20231026

Thanks for the explanation! In my case (Apple M1, MacOS 13.6.4), after installing wheel and torch, the error I got when building wheel wasclang: error unsupported option '-fopenmp'. I did
CC=/opt/homebrew/opt/gcc/bin/gcc-13 CXX=/opt/homebrew/opt/gcc/bin/c++-13 pip install xformers
and it installed.
@HuabeiYou How to find CC and CXX path ?
From my (very limited) understanding, the clang error was thrown because MacOS's default C compiler doesn't support some required options for compiling certain dependencies. To resolve this, we need to use an alternative compiler like gcc.
brew install gcc
After installation, you can typically find the GCC and G++ compilers under $HOMEBREW_PREFIX/bin/ or $HOMEBREW_PREFIX/opt/gcc/bin/ and you can use them as CC and CXX respectively.

Work for me . Just use brew info gcc get the path.

MurphLu · 2024-05-16T06:52:57Z

Yes, it worked for me (macos m3).

I have done :

poetry run python -m pip install --upgrade pip poetry run python -m pip install --upgrade setuptools poetry run python -m pip install torch>=2.1.0 poetry run python -m pip install wheel ninja poetry run python -m pip install xformers --no-dependencies

Ugly, but it work...

Thanks a lot

it worked for me (macos intel)

shuttie · 2024-06-04T18:36:09Z

FYI had the same issue on Ubuntu 24.04 with Python 3.12, and this trick did the install without issues:

pip install wheel ninja setuptools torch
pip install xformers --no-dependencies --no-build-isolation

jeremyxie97 · 2024-06-20T14:52:48Z

Here is my solution in my environment: Firstly my server is aarch64, and maybe there is no such problem on the x86_64 platform at all. I got the same error messages just like above when I tried to use pip install xformers:

ModuleNotFoundError: No module named 'torch'

But I already installed torch, so I followed the suggestions in this issue, I tried --no-dependencies and --pre -U, unfortunately nothing works. Then I suddenly found I didn't install wheel yet, maybe things will change if I install it pip install wheel Indeed, after the wheel is installed, "ModuleNotFoundError: No module named 'torch'" is gone away, it started to compile but I got a new error message:

ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1900, in _run_ninja_build
subprocess.run(
File "/stable-diffusion-webui/runtime/python/3.10.6/lib/python3.10/subprocess.py", line 524, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

I installed ninja pip install ninja But still same compile errors Then I tried to download the source code of xformers: git clone https://github.com/facebookresearch/xformers.git git checkout v0.0.16rc425 pip install . Still no lucky, has same compile errors. Then I looked the error messages again, and found a clue:

error: ‘vld1q_f32_x2’ was not declared in this scope

I searched the error, and it is said it's a problem of gcc in aarch64, and will be fixed in gcc-8.4.1-1 I just have gcc-10.3.1 at hand, so I tried it and it works! CC=/gcc1031/bin/gcc CXX=/gcc1031/bin/c++ pip install .

Building wheels for collected packages: xformers
Building wheel for xformers (setup.py) ... done
Created wheel for xformers: filename=xformers-0.0.16+6f3c20f.d20231026-cp310-cp310-linux_aarch64.whl size=7641635 sha256=222f900bf3f4917368b6aa1108080ccdd59d1c2589e2553a2c94dea57cee86f0
Stored in directory: /tmp/pip-ephem-wheel-cache-hnw74sa9/wheels/6f/f5/81/43807df029d66aff5bf231868b0c3f7fbde0b32ed35d595fe7
Successfully built xformers
DEPRECATION: pytorch-lightning 1.7.6 has a non-standard dependency specifier torch>=1.9.. pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of pytorch-lightning or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
DEPRECATION: torchsde 0.2.5 has a non-standard dependency specifier numpy>=1.19.; python_version >= "3.7". pip 24.0 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of torchsde or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at pypa/pip#12063
Installing collected packages: xformers
Successfully installed xformers-0.0.16+6f3c20f.d20231026

Hi, how can I install gcc on windows? thanks!!

Spacefish · 2024-06-28T23:42:49Z

pip install wheel
pip install setuptools

fixed it for me

KyleAWang · 2024-07-05T20:18:47Z

pip install setuptools
pip install xformers --no-dependencies --no-build-isolation

worked to me

aswordok · 2024-07-10T00:29:39Z

pip install ninja wheel setuptools
git clone https://github.com/facebookresearch/xformers.git
cd xformers
git submodule update --init --recursive
pip install .
Successfully installed xformers-0.0.27+66cfba7.d20240609

worked to me.

tevops · 2024-07-30T20:51:01Z

For me a solution was to install torch independently prior to installation. Now I use MacBook with M3 (os Sonoma) - the workaround was to install gcc (by the time of this comment 14) with brew and install the package via
export clang=gcc-14;python -m pip install xformers --no-dependencies. At least the errors went off (prior to that - the issue was that with native clang there was an issue of unsupported option '-fopenmp'

jayeew · 2024-08-29T02:30:20Z

pip install wheel pip install setuptools

fixed it for me

this works for me. Thank you.

pawamoy · 2024-09-08T15:23:32Z

Couldn't this project simply add a pyproject.toml with the following contents?

[build-system]
requires = ["setuptools", "torch"]
build-backend = "setuptools.build_meta"

xzkeee · 2024-09-17T14:08:12Z

pip install wheel pip install setuptools
fixed it for me

this works for me. Thank you.

same. turns out my system don't have wheel installed

atemate · 2024-09-24T10:54:46Z

TL;DR try export VIRTUALENV_SYSTEM_SITE_PACKAGES=true

See issue python-poetry/poetry#9707

itsnotoger · 2024-10-02T16:28:21Z

Windows 11 Solution

pip install wheel
Windows uses VS build tools instead of gcc for me, so install that:
https://visualstudio.microsoft.com/visual-cpp-build-tools/
Select components in the installer: Windows 11 SDK, MSVC v143 - VS 2022 build tools.
After this, it worked for me. Did not need ninja or other dependencies, and torch was found correctly.

But pay close attention to the build errors, they should tell you whether it wants gcc or another compiler.

tuxfamily · 2024-11-06T09:25:19Z

Similar issue(s) trying to install xformers on a mac studio m1 max in a conda venv.

After many attempts and different errors, this was the solution for me:

brew install libomp llvm gcc
set -gx LDFLAGS "-L/opt/homebrew/opt/llvm/lib"
set -gx LDFLAGS "-L/opt/homebrew/opt/libomp/lib"
set -gx CPPFLAGS "-I/opt/homebrew/opt/llvm/include"
set -gx CPPFLAGS "-I/opt/homebrew/opt/libomp/include"
sudo ln -s /opt/homebrew/Cellar/gcc/14.2.0_1/bin/gcc-14 /usr/local/bin/gcc
sudo ln -s /opt/homebrew/Cellar/gcc/14.2.0_1/bin/g++-14 /usr/local/bin/g++
sudo ln -s /opt/homebrew/Cellar/gcc/14.2.0_1/bin/cpp-14 /usr/local/bin/cpp
sudo ln -s /opt/homebrew/Cellar/gcc/14.2.0_1/bin/c++-14 /usr/local/bin/c++
pip install --no-build-isolation xformers

Notes:

I'm using fish, so why the set -gx instead of export
instead of ln -s, a cleaner set -gx CC ... would have probably worked too, but after build, I removed these symlinks

Now I've this warning

WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
    PyTorch 2.5.1 with CUDA None (you have 2.5.1)
    Python  3.12.2 (you have 3.12.2)
  Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers)
  Memory-efficient attention, SwiGLU, sparse and more won't be available.
  Set XFORMERS_MORE_DETAILS=1 for more details
xformers version: 0.0.28.post3

Which is normal I guess :)

EDIT: in the end, I removed xformers because it was causing issues with some ComfyUI workflows

NotImplementedError: No operator found for `memory_efficient_attention_forward` with inputs:
     query       : shape=(1, 1962, 12, 64) (torch.float32)
     key         : shape=(1, 1962, 12, 64) (torch.float32)
     value       : shape=(1, 1962, 12, 64) (torch.float32)
     attn_bias   : <class 'NoneType'>
     p           : 0.0
`ckF` is not supported because:
    device=mps (supported: {'cuda'})
    dtype=torch.float32 (supported: {torch.bfloat16, torch.float16})
    operator wasn't built - see `python -m xformers.info` for more info

Too bad... 😟

sanlares · 2024-11-13T03:25:10Z

had similar issues with torch and SentenceTransformer. solved creating a separated virtualenv just installing torch and SentenceTransformer before anything else.

jinmingyi1998 linked a pull request May 10, 2023 that will close this issue

Add pyproject toml #743

Open

10 tasks

Drun555 mentioned this issue Oct 14, 2023

xformers==0.0.20 invoke-ai/InvokeAI#4881

Merged

8 tasks

tin2tin mentioned this issue Oct 15, 2023

Torch installation - troubleshooting tin2tin/Pallaidium#40

Closed

shodanx2 mentioned this issue Mar 8, 2024

Build fails with No module named 'torch' (solution) tatsy/torchmcubes#5

Closed

xingener mentioned this issue Apr 5, 2024

pip安装依赖文件 chatchat-space/Langchain-Chatchat#3605

Closed

ThePowerOfElectricity mentioned this issue Apr 16, 2024

error:ModuleNotFoundError: No module named 'torch' LarryJane491/Lora-Training-in-Comfy#22

Open

teddykoker mentioned this issue Apr 25, 2024

Cannot install using poetry teddykoker/torchsort#58

Closed

achalddave mentioned this issue May 3, 2024

xfomers installation failed mlfoundations/open_lm#267

Closed

cryptogun mentioned this issue Jun 25, 2024

Error on pip install: ModuleNotFoundError: No module named 'torch' ridgerchu/matmulfreellm#8

Closed

CPavlis mentioned this issue Jun 29, 2024

no module named 'torch' / no module named 'hallo' tripped by inference.py line 39 fudan-generative-vision/hallo#118

Closed

atemate mentioned this issue Sep 24, 2024

Document the workaround of "ModuleNotFoundError" when setup.py depends on custom dependencies like 'torch' python-poetry/poetry#9707

Open

no model named 'torch' #740

no model named 'torch' #740

Comments

DeForestDiamond commented May 4, 2023

danthe3rd commented May 4, 2023

DeForestDiamond commented May 4, 2023

ivanprado commented May 4, 2023

DeForestDiamond commented May 4, 2023

worthy7 commented May 7, 2023

JosefWN commented May 8, 2023

adampauls commented Jun 6, 2023 • edited Loading

jinmingyi1998 commented Jun 7, 2023

rkique commented Jun 8, 2023

adampauls commented Jun 11, 2023

danthe3rd commented Jun 12, 2023

adampauls commented Jun 12, 2023 • edited Loading

danthe3rd commented Jun 12, 2023

adampauls commented Jun 12, 2023

lynxoid commented Jun 13, 2023 • edited Loading

adampauls commented Jun 14, 2023 • edited Loading

danthe3rd commented Jun 15, 2023

drscotthawley commented Jun 16, 2023

adampauls commented Jun 17, 2023

sidhartha-roy commented Jun 19, 2023

DeForestDiamond commented Jun 22, 2023

talhaanwarch commented Jul 9, 2023

dfiru commented Aug 3, 2023

MichaelMalike commented Oct 26, 2023 • edited Loading

carlthome commented Oct 29, 2023

aurban0 commented Nov 1, 2023

HuabeiYou commented Mar 10, 2024

chintanckg commented Mar 17, 2024

VictorMustin commented Mar 21, 2024

ThePowerOfElectricity commented Apr 15, 2024 • edited Loading

shiroxxsora commented Apr 20, 2024

631068264 commented May 12, 2024

HuabeiYou commented May 12, 2024

631068264 commented May 13, 2024

MurphLu commented May 16, 2024

shuttie commented Jun 4, 2024

jeremyxie97 commented Jun 20, 2024

Spacefish commented Jun 28, 2024 • edited Loading

KyleAWang commented Jul 5, 2024 • edited Loading

aswordok commented Jul 10, 2024

tevops commented Jul 30, 2024 • edited Loading

jayeew commented Aug 29, 2024

pawamoy commented Sep 8, 2024

xzkeee commented Sep 17, 2024

atemate commented Sep 24, 2024 • edited Loading

itsnotoger commented Oct 2, 2024 • edited Loading

Windows 11 Solution

tuxfamily commented Nov 6, 2024 • edited Loading

sanlares commented Nov 13, 2024

adampauls commented Jun 6, 2023 •

edited

Loading

adampauls commented Jun 12, 2023 •

edited

Loading

lynxoid commented Jun 13, 2023 •

edited

Loading

adampauls commented Jun 14, 2023 •

edited

Loading

MichaelMalike commented Oct 26, 2023 •

edited

Loading

ThePowerOfElectricity commented Apr 15, 2024 •

edited

Loading

Spacefish commented Jun 28, 2024 •

edited

Loading

KyleAWang commented Jul 5, 2024 •

edited

Loading

tevops commented Jul 30, 2024 •

edited

Loading

atemate commented Sep 24, 2024 •

edited

Loading

itsnotoger commented Oct 2, 2024 •

edited

Loading

tuxfamily commented Nov 6, 2024 •

edited

Loading