Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Could not find any implementation for node {ForeignNode[/transformer/attention_4/Slice_4_output_0[Constant].../transformer/Reshape_6]}. #3972

Open
sushe2111 opened this issue Jun 27, 2024 · 1 comment

Comments

@sushe2111
Copy link

sushe2111 commented Jun 27, 2024

Description

I tried to convert model to int8, but it fails with the error blow
[E] Error[10]: Error Code: 10: Could not find any implementation for node {ForeignNode[/transformer/attention_4/Slice_4_output_0[Constant].../transformer/Reshape_6]}.

It is ok when i use fp16 or bf16 : trtexec --onnx=model.onnx --fp16 --exportLayerInfo=layer.info --saveEngine=t16.trt.

How to fix it in int8.

Environment

TensorRT Version: 10.1

NVIDIA GPU: A100

NVIDIA Driver Version: 535.104.05

CUDA Version: 12.3

CUDNN Version:

PYTHON Version: 3.10.0

TORCH Version: 2.3.0

onnx-opset: 17

Operating System: Linux version 5.15.0-92-generic

Commands or scripts: trtexec --onnx=model.onnx --int8 --exportLayerInfo=layer.info --saveEngine=t8.trt

@lix19937
Copy link

lix19937 commented Jul 1, 2024

Can you upload full log with trtexec --onnx=model.onnx --int8 --exportLayerInfo=layer.info --saveEngine=t16.trt --verbose 2>&1 | tee build.log ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants