Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Encryption does not work with trt_dump_ep_context_model #23289

Open
BengtGustafsson opened this issue Jan 8, 2025 · 1 comment
Open

Encryption does not work with trt_dump_ep_context_model #23289

BengtGustafsson opened this issue Jan 8, 2025 · 1 comment
Labels
ep:TensorRT issues related to TensorRT execution provider

Comments

@BengtGustafsson
Copy link
Contributor

Describe the issue

If trt_dump_ep_context_model is set to optimize setup performance the decryption step is not done, the code in Status TensorRTCacheModelHandler::GetEpContextFromGraph(const GraphViewer& graph_viewer) only looks for the unencrypted file, while if encryption is enabled and an encryption library is provided its encrypt function is called to encrypt the function (and the .encrypted extension added).

To reproduce

Set the trt_dump_ep_context_model flag and set up encryption, you get an encrypted file but when read back the code only looks for the unencrypted file.

Urgency

We have already given up on being able to use your encryption for our next release, so it is not that urgent for us.

Platform

Windows

OS Version

10 & 11

ONNX Runtime Installation

Built from Source

ONNX Runtime Version or Commit ID

1.20

ONNX Runtime API

C++

Architecture

X64

Execution Provider

TensorRT

Execution Provider Library Version

CUDA 11.8, TrT 10.4.0.26

@yuslepukhin yuslepukhin added the ep:TensorRT issues related to TensorRT execution provider label Jan 8, 2025
@jingyanwangms
Copy link
Contributor

jingyanwangms commented Jan 9, 2025

Hi @BengtGustafsson thanks for reporting this. Can you please share a reproducible example? Especially what's the engine_decryption_lib_path_ do you use

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:TensorRT issues related to TensorRT execution provider
Projects
None yet
Development

No branches or pull requests

3 participants