Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question aboutf use QuantizeLinear Node with my custom op #112

Open
AnnaTrainingG opened this issue Dec 10, 2024 · 1 comment
Open

Question aboutf use QuantizeLinear Node with my custom op #112

AnnaTrainingG opened this issue Dec 10, 2024 · 1 comment

Comments

@AnnaTrainingG
Copy link

how to fuse QuantizeLinear Node with my custom op when convert onnx to trtengine
I find that the QuantizeLinear will be called like:
Image
it cost long time, How to fuse it with my custom kernel before QuantizeLinear node. the compute in QuantizeLinear is what
like:
my_custom_op - Q -- DQ --- Conv. fuse to => my_custom_op_with_Q --- (DQ_Conv)

1.what the format of QuantizeLinear's output in this image
2.the compute is QuantizeLinear Kernel is that clamp((input*scale).round, -127, 127) ?

@cjluo-omniml
Copy link
Collaborator

Is this question in the context of trt engine building phase?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants