It should not make much difference apart from enriching the media. But if you want to avoid such situation, dilute this media with the same volume of LB lacking YE in order to get usual LB.
There are other growth media for E.coli containing higher dose of YE so it may not make any considerable different just in case mark the plates to avoid further use rather than the experiment you concern.