How does multi-head attention on "multiple attention axes" works ?

Hello, I would like to apply an self-attention mechanism on a multichannel audio spectrogram, so a 3D tensor. In the original Transformer paper, self-attention is applied on vectors (embedded...

08 April 2021 5,960 1 View