Make sure you deleted the first addition from the analysis, as this is usually not of sufficient quality. Then, see whether it is a reproducible phenomenon. If so, then consider the possibility that either the ligand or the protein is a mixture or, in the case of the protein, not homogeneous. For example, run the protein through a gel filtration column to remove aggregated protein.