You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I tried to convert model to int8, but it fails with the error blow
[E] Error[10]: Error Code: 10: Could not find any implementation for node {ForeignNode[/transformer/attention_4/Slice_4_output_0[Constant].../transformer/Reshape_6]}.
It is ok when i use fp16 or bf16 : trtexec --onnx=model.onnx --fp16 --exportLayerInfo=layer.info --saveEngine=t16.trt.
How to fix it in int8.
Environment
TensorRT Version: 10.1
NVIDIA GPU: A100
NVIDIA Driver Version: 535.104.05
CUDA Version: 12.3
CUDNN Version:
PYTHON Version: 3.10.0
TORCH Version: 2.3.0
onnx-opset: 17
Operating System: Linux version 5.15.0-92-generic
Commands or scripts: trtexec --onnx=model.onnx --int8 --exportLayerInfo=layer.info --saveEngine=t8.trt
The text was updated successfully, but these errors were encountered:
Description
I tried to convert model to int8, but it fails with the error blow
[E] Error[10]: Error Code: 10: Could not find any implementation for node {ForeignNode[/transformer/attention_4/Slice_4_output_0[Constant].../transformer/Reshape_6]}.
It is ok when i use fp16 or bf16 : trtexec --onnx=model.onnx --fp16 --exportLayerInfo=layer.info --saveEngine=t16.trt.
How to fix it in int8.
Environment
TensorRT Version: 10.1
NVIDIA GPU: A100
NVIDIA Driver Version: 535.104.05
CUDA Version: 12.3
CUDNN Version:
PYTHON Version: 3.10.0
TORCH Version: 2.3.0
onnx-opset: 17
Operating System: Linux version 5.15.0-92-generic
Commands or scripts: trtexec --onnx=model.onnx --int8 --exportLayerInfo=layer.info --saveEngine=t8.trt
The text was updated successfully, but these errors were encountered: