Hello. I imagine that it depends what you mean by abnormal event. From my point of view, this type of problem takes two forms. The first is an image processing problem where you look in a single frame for an object with a certain feature. This can be reduced to a parameter estimation problem. The second way is to view the problem as one of change detection, i.e., the abnormal event corresponds to a change in the dynamics of the underlying system (think of you car engine when something inside it breaks). There is a large literature on change detection, which can be approached in many ways. My experience of this type of problem is from the area of manoeuvring target tracking. Hopefully you can find some useful references for your work as quite a lot has been done in this area (see link), although the sensor is usually a radar system rather than a video sequence.
Technical Report A Survey of Manoeuvring Target Tracking Methods
I think the following survey paper by Popuula on Video-based Abnormal Human Behavior Recognition is what I looked for. Hope it could help you as it helped me. But please add the answer if there are more valuable references to know.