When you create a temperature gradient in your sample, diffusion of majority carriers from the hot end to the cold end appears. So if you want the voltage sign to be equal to the majority carriers sign, you should connect the positive terminal of the voltmeter to the cold end of the sample.