# Issue facing in multihead attention

**URL:** <https://discuss.ai.google.dev/t/issue-facing-in-multihead-attention/29986>\
**Category:** Keras\
**Tags:** issues, tensorflow\
**Created:** [April 22, 2024, 6:05pm UTC](https://discuss.ai.google.dev/t/issue-facing-in-multihead-attention/29986 "2024-04-22T18:05:15Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Satish\_Hiremath](https://d1dlmcr85iqnpo.cloudfront.net/user_avatar/discuss.ai.google.dev/satish_hiremath/32/17905_2.png) [@Satish\_Hiremath](https://discuss.ai.google.dev/u/Satish_Hiremath)\
**Post date:** [April 22, 2024, 6:05pm UTC](https://discuss.ai.google.dev/t/issue-facing-in-multihead-attention/29986/1 "2024-04-22T18:05:15Z")

</div>

Hi I am facing some issues with tensorflow multihead attention.

Even though the input shape is consistent. It’s still throwing an error saying incorrect input dimension.

Can any one help please.

I am creating a local transformer that also single layer

---

<div class="post-metadata">

**Author:** ![Aniket\_Dubey](https://d1dlmcr85iqnpo.cloudfront.net/user_avatar/discuss.ai.google.dev/aniket_dubey/32/16664_2.png) [@Aniket\_Dubey](https://discuss.ai.google.dev/u/Aniket_Dubey)\
**Post date:** [May 7, 2024, 9:07am UTC](https://discuss.ai.google.dev/t/issue-facing-in-multihead-attention/29986/3 "2024-05-07T09:07:54Z")

</div>

Hi @Satish_Hiremath Welcome to the Tensorflow Forum ,

Could you provide more details about your implementation and the specific error message you’re encountering? This will help me understand the issue better and assist you more effectively.

Thank You !