Terrorism & global security are one of the major issues worlds facing today. We have seen in recent terrorist attacks involving some suspicious bags which are left unattended at railway stations, shopping malls, airports etc. The most challenging task in video surveillance system is to detect such kind of suspicious bags. So, for that purpose it is necessary to have an efficient threat detection system which can detect & recognize strongly dangerous situations and which gives alert to the authorities in order to take appropriate action.