Skip to content

Issues: NVIDIA/TensorRT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

263 Open 3,291 Closed
263 Open 3,291 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

TensorRT8.6.1.6 Inference cost too much time
#3993 opened Jul 9, 2024 by kaixiangjin
Error[3]: [executionContext.cpp::nvinfer1::rt::ExecutionContext::enqueueV3::2666] Error Code 3: API Usage Error (Parameter check failed at: executionContext.cpp::nvinfer1::rt::ExecutionContext::enqueueV3::2666, condition: mContext.profileObliviousBindings.at(profileObliviousIndex) || getPtrOrNull(mOutputAllocators, profileObliviousIndex)
#3992 opened Jul 9, 2024 by Leonjr98
Do get_binding_shape(binding), get_binding_dtype(binding) and binding_is_input(binding) have an equivalent in TensorRT 10.2?
#3991 opened Jul 9, 2024 by AriannST
1
XXX failure of TensorRT X.Y when running XXX on GPU XXX
#3990 opened Jul 8, 2024 by ndeep27
1
pycuda._driver.LogicError: cuMemHostAlloc failed: OS call failed or operation not supported on this OS
#3989 opened Jul 8, 2024 by kukugpt
1
How to enable FP8 convolution in TensorRT 10.2
#3987 opened Jul 7, 2024 by junstar92
1
[ONNX Graph Surgeon] Sequence/map types are not handled
#3986 opened Jul 6, 2024 by DeltaEpsilon7787
4
UINT8-to-FLOAT cast after transpose breaks the graph.
#3985 opened Jul 5, 2024 by srasmussenvl
5
SDXL int8 Failure of TensorRT 10 when running txt2img_xl.py on GPU A100
#3984 opened Jul 5, 2024 by 13301338176
4
Engine building failure of TensorRT 10.2.0 (pip install) when building a custom diffusion model on RTX 4090
#3983 opened Jul 4, 2024 by ifeherva
12
How can I use the trex tool to analyze the engine generated by trtllm
#3982 opened Jul 4, 2024 by BugCrown
8
TensorRT for SDXL demo not work well than use diffusers only ，consumes a lot of memory
#3981 opened Jul 4, 2024 by 631068264
1
How to make PTQ calibration for a Hybrid Quantization model (int8 & fp16)
#3978 opened Jul 3, 2024 by renshujiajia
3
TensorRT is encountering issues with models quantized using pytorch-quantization.
#3976 opened Jul 1, 2024 by wjx10210
1
ICudaEngine API error
#3973 opened Jun 28, 2024 by hch-baobei
1
Could not find any implementation for node {ForeignNode[/transformer/attention_4/Slice_4_output_0[Constant].../transformer/Reshape_6]}.
#3972 opened Jun 27, 2024 by sushe2111
1
Question about container image
#3970 opened Jun 26, 2024 by geraldstanje
GEMM failure of TensorRT 10.X when running Segment Anything Model on GPU 3090
#3969 opened Jun 26, 2024 by summelon
4
The yolov5 model has an error in the detection result of tensorrt7.1
#3968 opened Jun 26, 2024 by Monlter
7
Concurrent inference failure of TensorRT 8.6.1 when running open_clip visual model tensorrt engine on GPU A100
#3967 opened Jun 26, 2024 by AmazDeng
3
How do you use" build_engine"?
#3965 opened Jun 25, 2024 by kimsoomin415
1
TRT Unet support for Juggernaut ?
#3964 opened Jun 25, 2024 by ChuRuaNh0
4
Does TensorRT have plugin for onnx's DynamicQuantizeLinear?
#3963 opened Jun 25, 2024 by myunuro
3
TensorRT 10 slower than TensorRT 8.6 for models with Instance Normalization layers
#3962 opened Jun 24, 2024 by david-PHR
4
对Yolov8n.pt转wts后，再序列化构建时，addResize()函数返回值为空，应如何解决？
#3961 opened Jun 24, 2024 by retioa11
7
ProTip! Find all open issues with in progress development work with linked:pr.