are you doing orthotopic or sub cutaneous? If sub cutaneous the growth rate is very slow and sometimes no tumours grow without the matrigel. For orthotopic, tumours should grow, as they are in the site of origin.
In my opinion, MDA-MB-231 is one cell line that grows very slow after mixing with matrigel and SC injection to nude mice, let alone only media without matrigel.