I have a file containing a Persian sentence, a tab and then an English word. I have to delete stop words and punctuation in the file. I wrote the code in python 3, but because in some words the punctuation attaches to the word, and it is counted as a part of the word and not punctuation, it can't be deleted. So I need to use regular expression to delete stop words. I tried to use that in the code below, but I couldn't. How can I change the code below that it works correctly? (in fact, what should I write exactly?) thanks.
In your code you're trying to remove stop words and then delete punctuation from the remaining string.
If this is exactly what you want to achieve I would start with removing punctuation:
some_text.translate(None, string.punctuation)
and then simply:
' '.join([word for word in some_text.split() if word not in StopWords])
- Badges
- Science topic
- Similar topics
- Computer Science and Engineering
- Programming Languages
- Python