Perhaps you may be referring to the distinction between deterministic and stochastic models. The difference would be that a stochastic or statistical model includes random error. You could research the term "random variable."
Mathematical models can be deterministic (fixed outcomes) or stochastic (involving randomness) depending on the system, while Statistical models are generally stochastic, as they account for uncertainty and randomness in data.
Neither mathematical, nor statistical thinking and modelling can exist one without other when try to understand and apply new ideas in reality ! Sciences and researches as human and virtuos activities implies to think and speak both statistical and mathematical. But do not forget the physicists way of modelling too! This is the best and profound way of modelling in my opinion, as statistician !