Here is an hypothesis. Specialist herbivores, generally host-specific parasites, are sensitive to some specific volatile substance produced by the host species. Generalist herbivores are probably responding multiple cues that vary widely across the plant community.
I can't cite a paper at the moment but there is a literature on the cues that host-specific parasites respond to. You might try to query those terms in "Google Scholar".