R would be my first choice. It is available from the CRAN website at no charge. I have attached a link to my favorite R book for statisticians. Simply google R statistical language to get started. Instructions are also in the book. There are a ton of other books now as well. Best wishes.
This depends largely on what you plan to do with it.
If using R, consider using the Rcmdr package to help you get going - as otherwise it does not fit the bill for "SPSS like". the general support for R is not for its user-friendliness but for its wide range of capacities.
For many purposes PAST is excellent.
JASP has limited functions but again may fit what you are looking for.
Last but not necessarily least PSPP is quite SPSS like but not yet complete so this again depends on what you wish to do.
Regarding the suggestion of the R language, specifically look into the R-library 'R commander'. It gives a GUI based interface (similar to SPSS) that will help you do the basic statistics (standard graphs, simple hypothesis tests, linear regression, ANOVA) by point and click. I haven't kept up with the development over the years so I am unaware of its current capability.
I agree with Drs Booth and Walsh regarding the R program. I first used SPSS for all my multivariate statistical analysis projects but now use the R program exclusively.