1. Out of RAM issue can be solved if we somehow reduce the number of tetrahedron. If you reduce the size of radiation box (if possible), a large number of tetrahedron can be reduced.
2. If 3D geometry is used to draw the ground plane, make it a 2D object, instead of 3D. It will also reduce the number of tetrahedron
3. Repeat this process to other object if possible (i.e. convert 3D to 2D, if possible)
4. Open task manager and delete unnecessary process. Windows XP and windows 7 can run with 24 and 49 (45 to 54 avg) number of process respectively. Try to obtain this number first, then open your HFSS and run the simulation.
5. If the problem is still not solve, try to use lower version of HFSS and draw your geometry therein and apply steps 1 to 4.
This kind of problem usually occurs in student version of software.
If the limit of number of meshes exceeds (Student version is having limited support) then the error occurs.
If you still want to remove it then try to use lower frequency as your solution frequency. 2D structure instead of 3D. Reduce your radiation box size. Restrict your frequency range for results.
You can also follow the steps suggested by Smrity Dwivedi Madam for solving the issue.