Perform dose response by MTT assay on cancer cell lines of your interest using the aqueous/alcoholic extract of your medicinal plant of interest. Be sure to include a non cancerous cell line as a control to check the general toxicity of your plant extract. [For example if am going to check the effect of a medicinal plant extract against liver cancer. I will perform dose response in HepG2, Huh7 (both of them tumorigenic) and Chang liver cells (non-tumorigenic)].
After you are done with dose response whichever medicinal plant is very effective and selective against the tumorigenic cells you can choose that for further mechanistic studies such as cell cycle analysis by propidium iodide staining, AnnexinV-FITC for apoptotis analysis etc.