PDMS is a flexible polymer and when you deposit ITO thin film on the top, a small deformation of PDMS can lead to crack formation in your ITO thin film, turning it to a non-conductive film. During the annealing process, thermal expansion of PDMS is much larger that ITO thin film. Therefore, larger surface deformation of PDMS on the annealing process again results in fracture of your thin film.