I would like to identify certain processes in my study and what leads up to each one. I would like to extract this information from email messages. In order to automate the process, I am using regular expression matching but would like to explore a more robust approach .
I think identifying sample sentences and trying to match its semantics with sentences in email messages would be a good start.
I have been through and ran sample java code for stemming, pos, lemmatizing and similarity. However I am now looking for some basic code which integrates all this
approaches in one program/project. I am hoping it also includes tokenisation and word sense disambiguation as well. Importantly it should have an approach of calculating sentence similarity as well. I am sure some one has done this.
I am particularly looking for java, standford core nlp and wordnet approach which integrates tokenising, stemming, pos, lemmatizing, word sense disambiguation and an approach of calculating sentence similarity as well
Try the STS task Winner 2012's system, it does what you want (but is a bit of a beast to install):
https://www.ukp.tu-darmstadt.de/software/dkpro-similarity/
https://www.ukp.tu-darmstadt.de/publications/details/?no_cache=1&tx_bibtex_pi1[pub_id]=TUD-CS-2012-0089
Thanks. Let me have a look and I will get back to you if I have any queries.
I was looking for a simpler project - not a full blown one. Anyone else knowing any such program or project, please let me know.
Hi Mr. Sharma,
Maybe you could try WS4J (http://ws4jdemo.appspot.com/) for calculate similarity using WordNet (include tokenizing, stemming). But If you also want WSD process you could try http://wn-similarity.sourceforge.net/ . This project is very good for conducting some experiment.
Thanks,
Dear Pankajeshwara,
I recommend the SML tool, it provides a wide range of syntactic and semantic processing.
http://www.semantic-measures-library.org/
https://github.com/sharispe/slib/tree/master/slib-tools/slib-tools-sml-toolkit
I recommend NLTK api with python for best results in Word Sense Disambiguation.
- Badges
- Science topic