Is the model in code matches what is described in the paper?

[YuanTingHsieh]

In the first attention block,
You get hidden features using a filter AttnW to conv. with state outputs,
I believe that's the formula W h_k,
BUT you also have state outputs pass through a linear layer and get y
Then you add y and hidden features then pass through an tanh then multiply by a matrix

In the paper, I only see tanh(W h_k)

Also in your code there is AttnV,
where I can't find corresponding description in the paper.

The paper only has gate V and gate W

Could you kindly explain this?
I am really confusing.
Thank you!

[nwy2010]

Yes, I have the same doubts