Hello,
Can someone give me an idea on how deep learning applied in the analysis of open-ended survey questions?
My intuition is that applying deep learning models for analyzing the vast majority of survey questions is infeasible since most of survey data are regarded as "small", that does not fit into the "big data" category that we normally talk about in natural language processing or deep learning. For example, I just think that it is impossible to train a state-of-the-art neural NLP models like Transformers, RNN, LSTM from a pool of survey data.
However, I see several private companies which claim that they use deep learning methods to analyze survey data (for sentiment analysis, thematic analysis, etc). So I am just curious in what general manner deep learning models are applied in analysis of open-ended survey questions. (Certainly these private companies are not using anything like Transformer to do sentiment analysis on their client's survey data? or do these survey consulting companies tend to deal with very large survey data that is often not available in public?)
Thank you,