I am using a function for removing duplicated text, but I get an error type KeyError: ['text'] when I call the function using my datasets. I am wondering if anyone can help provide any guidance as to where I am going wrong or recommendation. Please see the attached screenshots for the sample code, function call and error.
Any advice will be greatly appreciated!
Thanks.
In your function_Call_With_TestData (1).png code, you have renamed your column to Text (capital T). However, removeDuplicates function expecting the column name as text (t is small here). Perhaps, this is the reason.
Use the drop_duplicates function in pandas. This function will remove rows that have duplicate values in one or more columns, and keep the first occurrence of each unique row.
just run,
df = df.drop_duplicates()
https://pandas.pydata.org/docs/reference/api/pandas.DataFrame.drop_duplicates.html
- Badges
- Science topic