Implementing DeepMind's new Perceiver Model

TensorFlow Show and Tell
,
1

I am glad to present an implementation of DeepMind’s new “Perceiver: General Perception with Iterative Attention” Model which builds on top of Transformers but solves the quadratic scaling problem without making any assumptions of the data like the previous approaches in TensorFlow. This means you can use the same model on images, audio, videos, etc! This model also achieves state-of-the-art for some tasks!

Find it here:

5 Likes
2

Nice, we have also a tutorial/example for image classification with Perceiver on the Keras doc website

If you have any feedback/PR to improve the tutorial it is very appreciated.

4 Likes
3

i need to develop network