Einstein is probably suggesting the heuristic notion that scientific writing be parsimonious (see also Occam's Razor). Scientific reasoning , in explaining any phenomenon, should be as simple as necessary. Likewise, this should be reflected in scientific discourse. From a pragmatic perspective, your peers just don't have time to try to figure out a convoluted theory, much less have time to read about it. Likewise, funders generally are not scientists in your discipline and need things made clear and simple.
Yes, you are right. He said this sentence probably for the construction of scientific-abstract models of our physical reality. But some other writers (for example: Hilary Glasman-Deal) use this known sentence in "Scientific Writing" point of view, which probably means that Scientific Writing should be as simple as possible without any ambiguity or complexity.
If you can delete a word, and it makes no difference to the sense, do so.
If you can delete a phrase, and it makes no difference to the sense, do so.
If you can delete a sentence, and it makes no difference to the sense, do so.
If you can delete a paragraph, and it makes no difference to the sense, do so.
If you can delete a figure or table, and it makes no difference to the sense, do so.
[Kennedy, I.G., Public communication, https://www.researchgate.net/post/What_does_this_sentence_mean_in_Scientific_Writing_Things_should_be_made_as_simple_as_possible_but_not_any_simpler?