If possible, search the literature on similar electrodes or devices as yours, and check what temperature the authors used. This step will help you to estimate what potential window your setup could be, but the estimation needs to be verified experimentally.
How? Simple. Scan your device either using cyclic voltammogram (CV) or constant-current charge-discharge (GCP) method. For CV, within the potential window you select, the curve should exhibit no sharp increase in current at both limits of the potential window. For GCP, your device should be able to charge and discharge without significant deviation from a sloping profile within the window you choose. If electrolyte decomposition does happen, you will find the charging or discharging curve plateau at the upper or lower limits.