Hello Aleksandar -

I do not know your application, but in general, an adequate random sample size, n, does need to become larger with a larger finite population size, N.  However, the fraction n/N becomes smaller with larger N.  An important factor in this is standard deviation. 

Perhaps you can estimate variance to see when your results seem adequate. 

 Cheers - Jim