Abstract: In order to realize the object tracking in complex situation such as occlusions， partial and full changing illuminations， appearance change or fast motion， a novel object tracking framework was proposed by adopting the method that combined standard object tracking with object detection. The tracking algorithm based on the error of the evaluation standard two-way consistency was put forward to improve the reliability of the tracking point. The target detection algorithm based on random fern plexus was able to initialize objective to again track object， when the object was sheltered and disappear， failure to track. The proposed object tracking algorithm was proved to be able to achieve the goal of long-term tracking and be very robust.

Key words: random ferns, object detection, optical flow method, object tracking, error evaluation