If your material is P-type, so it has more free hole density than the free electron density. If I understand you correctly, and you want to increase the hole density by doping, so you need to use an acceptor dopant with the fermi level near above the valance band of your material. By this, the electrons from the valance band of your material can jump into the vacant level of acceptor dopant which results in developing of holes within the valance band of your material.