Currently I am working on a big .XML file from where I am retrieving useful data and discarding unnecessary data. But doing so is taking a lot of time.
So is there any instance where use of parallel programming(e.g., CUDA) is done to reduce time used to complete such task; in my case text preprocessing?
Panchatcharam Mariappan
For word processing word2vec would be useful. Have a glance at this paper. You may get a few idea after viewing the github word2vec.cu file. I believe it may not be hard for you to extend this to your .XML file.
Conference Paper Acceleration of Word2vec Using GPUs
https://github.com/kinchi22/word2vec-acc-cuda
0 votes
0 thanks
Joachim Pimiskern
- - Use a SAX type parser rather than a DOM type one.
- - Create an index / lookup data structure for fast navigation in an XML file.
- - Split the XML file into smaller files.
Regards,
Joachim
1 votes
0 thanks
- Badges
- Science topic
- Similar topics
- Mathematics
- Algebra
- Matrix
More Surya Prakash Sahu's questions See All
Similar questions and discussions