Pk+1|k = A Pk|k AT + Q is one of the update equations in Kalman filter, which is same as the iterative Lyapunov equation for discrete systems. The convergence of P is guaranteed only is case where A has stable eigen values.
Also, what is the effect of unstable A matrix on,
ek = (A-KkCA)ek-1
i.e the error dynamics, looking to the covariance estimate equation given above?
Also in the attachment:
In the unstable case see that the co-variance is steady state but the estimation error is boundlessly increasing.