Potential window is a potential range in which no faradic reaction take place, which means that your material and electrolyte are stable when you applied the potential in this range.
Potential window depends on the material and electrolyte, usually you can not choose it. You can get the potential window of your material by slow CV or LSV measurement, the range between hydrogen and oxygen evolution is the potential window of your material.