Previously, phytochemicals test were done to analyse the chemical nature /types but now the quantity is less to use. So need any feasibility details available on instrument.
Depends on your compounds. Gcms works great for mono-, sesqui-, and di-terpenoids. Dr Robert Adams compiled a database to allow ID of 2200 cmpds. Wiley sells a database with even more cmpds than that. Mere nanograms can be enough to get a signal and a positive ID in some cases.
Depends on the purity of your sample(s). If you have a relatively pure sample (>90% pure), H-NMR and 13C-NMR along with 2D experiments will give you information on the type of compound, structure and stereochemistry. If you have a mixture such as crude extracts, partially purified extracts or column fractions, the choice is HPLC-MS or better HPLC-DAD-MS. For essential oils and other mixtures of volatile compounds GC-MS is the election.
When quantities are small, I would prefer HPLC(or UPLC) hyphenated with Photo Diode Array Detector (PDA) - Mass spectral detector (ESI-MS/MS for example) that will provide UV spectra, possible molecular mass and fragmentation patterns (by MS/MS. Such information will be useful for possible identification.