Because the paper Tweet Segmentation and its Application to
Named Entity Recognition it does not tell how the meaningful phrases are splitted
Iris Steenhout
Do you just need the sentences split up? You can use Python's NLTK for that:
Code:
from nltk.tokenize import sent_tokenize
text = "You rule. It's the truth! Someone should have said that before."
phrases_list = sent_tokenize(text)
phrases_list
Result:
["You rule.", "It's the truth!", "someone should have said that before"]
0 votes
0 thanks
- Badges
- Science topic
- Similar topics
- Computer Science
- Data Mining
More Aleena Boban's questions See All
Similar questions and discussions