my code:
#building tf-idf
from sklearn.feature_extraction.text import TfidfVectorizer
vectorizer = TfidfVectorizer(analyzer = message_cleaning)
#X = vectorizer.fit_transform(corpus)
X = vectorizer.fit_transform(corpus)
#converting the result to array causes the prolem
X = pd.DataFrame(x.toarray())
Sarah Crosby
Which operating system are you using? This might be an overcommitting memory issue.
Check this for some possible workarounds:
https://stackoverflow.com/questions/57507832/unable-to-allocate-array-with-shape-and-data-type
0 votes
0 thanks
Mohamed Elhadad
Dear Mohammad Fadlallah,
It depends on the memory allocated for the browser you are using. Try to apply Apache-Spark, instead.
0 votes
0 thanks
- Badges
- Science topic
- Similar topics
- Computer Science and Engineering
- Programming Languages
- Python
Similar questions and discussions