Give a simple experience. Place a magnet on the table. Take a paper clip in your hand and bring it to the magnet. Release the clip. It will accelerate to the magnet. Who transferred energy to the clip to speed up? The magnet has nothing to lose, it does not have excess energy. Only one source remains - the external environment of the electromagnetic field.