The existing metrics are not matched with visual understanding. Although the spatial and spectral error maps can provide useful information about the performance of the fusion algorithm, the current state-of-the-art metrics are not satisfactory.
Visual findings can be different from the metric results. Each quality metric evaluates the spectral and spatial quality of the pansharpened images in different ways, which is why there is not a standard protocol to quantitatively evaluate the pansharpening results. So, I recommend you to make use of a few quality metrics to examine the overall trend among the metric values. This will provide a general overview about the spectral and spatial fidelity of the pansharpening results.