Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support grouping of Transformer Architecture Encoder-Decoder building blocks #822

Closed
GeorgeS2019 opened this issue Oct 9, 2021 · 1 comment
Labels

Comments

@GeorgeS2019
Copy link

GeorgeS2019 commented Oct 9, 2021

The more complex transformer architecture (e.g. from ONNX) consists of a stacking of either encoder or decoder building blocks. It will help if the Netron community can feedback how to make such complex graph network more intuitive to visualize with an overview of these building blocks.

Ideally these higher level building blocks are defined within the ONNX during export.

Is there graph layout methods that can help in identifying these building blocks?

Recently, a Work-In-Progress attempt has been made on such feature. Here is a WIP output using gpt2.onnx

image

@lutzroeder
Copy link
Owner

Duplicate of #68

lutzroeder added a commit that referenced this issue Oct 10, 2021
lutzroeder added a commit that referenced this issue Oct 10, 2021
lutzroeder added a commit that referenced this issue Oct 11, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants