Currently, I'm trying to fit a linear factor model to a particular time series in finance. For the sake of discussion, let's assume it has the following form:
Y= \mu + \sigma X + \epsilon. Y is the time series, X is the (unobservable) factor(s), \epsilon is white noise. Goal: estimate \sigma and X (case 1: their dimensions are given; case 2: search for the optimal dimension).
However, I'm quite sure that the white noise in the data might have a very large std deviation (compared to the factor's std deviation itself). When the time series contains many data points across a very long time, the "loud" white noise is not an issue. However, especially in financial data, heteroscesdasticity kicks in naturally when the data is very long.
The change in structure is something that occurs naturally in financial data, in contrast to nature science. So, it's unavoidable to limit the data availability (to some extent). When confronted with "short" time series and "loud" white noise, finding the pattern of the factor is very challenging.