That should be fine.  I have frozen both restriction digests and fragments after gel purification and then gotten ligations to work many times.  Ligations certainly don't work all the time, however.

The fragments would work well. Just don't forget to clean up your fragments before ligation.

It will work beter if pcr cleaned prior to freezing.