Are there any survey papers on word embedding in NLP which covers the whole history of word embedding from simple topics like one-hot encoding to complex topics like w2v model?
Here is a good review paper for word embedding and neural networks applied to information retrieval:
Article Neural Information Retrieval: A Literature Review
Hi Surya,
I don't know of a single paper that covers all of what you call 'embeddings'. The term 'embeddings' normally refers to the approaches following Bengio or Collobert and Weston, but it doesn't normally refer to other distributional methods for creating semantic vectors which rely on counting co-occurence.
A good comparison of the two styles is Baroni's Don't Coun't Predict (http://www.aclweb.org/anthology/P14-1023). Sebastian Ruder also has a nice blog post on the history of embeddings (http://ruder.io/word-embeddings-1/index.html). I hope that helps a bit.
Here is a good review paper for word embedding and neural networks applied to information retrieval:
Article Neural Information Retrieval: A Literature Review
Lots of paper is available on the internet,
what do you want to do with word embedding?
I want to see the advancement in textual data representation methods through time.
Try these
Mikolov, Tomas, Wen-tau Yih, and Geoffrey Zweig. "Linguistic regularities in continuous space word representations." Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2013.
Li, Jiwei, et al. "Visualizing and understanding neural models in NLP." arXiv preprint arXiv:1506.01066 (2015).
Levy, Omer, and Yoav Goldberg. "Dependency-based word embeddings." Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Vol. 2. 2014.
Symbolic, Distributed and Distributional Representations for Natural Language Processing in the Era of Deep Learning: a Survey
https://arxiv.org/pdf/1702.00764.pdf
For recent trends in word embeddings, you can refer this link
http://ruder.io/word-embeddings-2017/
Surya Prakash Sahu
This is a recently published (Jan 2019) survey paper on word embeddings.
Preprint Word Embeddings: A Survey
This is a survey paper focused on word embeddings for clinical text data.
Preprint A survey of word embeddings for clinical text
Comparative study of word embeddings models and their usage in Arabic language applications
This is a survey paper focused on all types of embeddings in clinical natural language processing.
Preprint SECNLP: A Survey of Embeddings in Clinical Natural Language Processing
Our paper on word embedding:
Evaluating word embedding models: methods and experimental results
https://www.cambridge.org/core/journals/apsipa-transactions-on-signal-and-information-processing/article/evaluating-word-embedding-models-methods-and-experimental-results/EDF43F837150B94E71DBB36B28B85E79
- Badges
- Science topic
- Similar topics
- Computer Science