Video multi-target tracking is an important problem in the field of computer vision. In order to solve the problem where the target is easy to lose due to target scaling,rotation,distortion and occlusion,this paper proposed a multi-target tracking algorithm based on ORB feature point . First,the "moving edge growth" algorithm was used to obtain target blocks. Next,targets were associated by matching the ORB features of target blocks with feature templates. The matching process enables target templates to be updated in the real time by eliminating the old feature information from the noise and adding new feature information. In this way,effectiveness of feature template is guaranteed in the real time,resulting in greater reliability of matching during the tracking process. Experimental results demonstrate the ability of the proposed algorithm to robustly track targets even if the targets are deformed or partially occluded.