Actually, I am doing research in data science, where I want to explore the new classifiers based on attention mechanisms and transformers for classification. I read a lot of stuff regarding the same. can anybody please suggest some recent research papers on the transformer NN model for classification?
Dear Rashi Jaiswal
These articles and links might be useful, have a look:
1. https://wiki.pathmind.com/attention-mechanism-memory-network
2. https://buomsoo-kim.github.io/attention/2020/01/01/Attention-mechanism-1.md/
3. https://medium.com/analytics-vidhya/https-medium-com-understanding-attention-mechanism-natural-language-processing-9744ab6aed6a
4. https://matthewmcateer.me/blog/getting-started-with-attention-for-classification/
5. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7313068/
6. https://link.springer.com/article/10.1007/s00521-019-04620-z
Kind Regards
Qamar Ul Islam
hi.,
Refer this link:
Article Attention-Mechanism-Containing Neural Networks for High-Reso...
https://www.quora.com/How-does-an-attention-mechanism-work-in-deep-learning
Above link you have look, Maybe will get some ideas.@Rashi
- Badges
- Science topic
- Similar topics
- Methodology
- Research Methodology
- Research Papers