Method for non-static foreground feature extraction and classification

The present invention provides a method for processing videos captured through a stereo camera, the videos having a plurality of frames, each frames includes at least a left and a right images. The method includes acquiring videos captured by the pair of stereo cameras (101) and acceleration information of the stereo camera (101) detected through the accelerometer (102); extracting feature points in the right and left images of a current frame; matching the feature points between the right and left images, wherein disparity value of each feature point is computed; clustering the feature points on a current frame into one or more clouds based on their appearance and distance; determining a correspondence between the clouds of the current frame and previous frame; classifying the clouds through estimating statistical disparity distribution of each cloud to identify if the respective clouds are new clouds, existing clouds or unknown clouds; and merging the clouds that are determined to be a same object based on the tracking information and changes of disparity of the clouds over time. A system carrying out the above method is also provided herein.