Abstract: A new method,based on the differential image sequence processing,was proposed,in which the complex backgrounds were converted into relatively simpler ones and thus the moving targets could be best segmented. Then the multi targets detection & recognition algorithm was introduced, which can process the differential IR image sequence in real time, with the positions of moving targets acquired.Also, the computer simulation results of the proposed method were given.