Giorgio Roffo

3 Questions 10 Answers 0 Followers

Questions related from Giorgio Roffo

Can Self-Attention Be Seen as Dynamic Feature Selection?

1) Can self-attention be reframed as a dynamic instance-specific feature selection mechanism, and how might this perspective inform the development of more interpretable or efficient Transformer...

21 July 2025 6,529 2 View

What are Convolutional Neural Networks (CNN) weakness?

Convolutional neural networks like any neural network model are computationally expensive. But, that is more of a drawback than a weakness. This can be overcome with better computing hardware such...

11 January 2016 8,191 12 View

Can Feature Selection Gates Enable Smarter Attention Routing in Transformers Across Vision Tasks?

We've proposed Feature Selection Gates (FSG) — a lightweight, plug-in module that injects differentiable attention gates into Vision Transformers (ViT). It learns instance-specific token relevance...

01 January 1970 3,843 1 View