In most cases this not necessary. It depends on whether the publisher of the journal allows to have online preprint versions of the published papers. Most publishers (e.g. Springer) do not have objections, and you do not have to remove the preprint version of your paper from arXiv. This holds not only for preprints at arXiv, but also for such at ResearchGate and similar platforms.
As Wolfgang R. Dick mentioned, in general, it is not necessary. However, you may want to review the journal's copyright policy as each outlet may be somewhat unique. Personally, I have always posted everything and had an issue only once. And it helps with citations!
I don't think that arXiv is a venue for ephemeral publication. As can be seen from the arXiv-page "To withdraw an article" ( https://arxiv.org/help/withdraw ):
"It is not appropriate to withdraw a paper because it is published or submitted to a journal. Instead you could submit a journal-ref."