Abstract: Regarding the appearance of black speckles and cell like stripes in the IR images of an IR observation system introduced by errors in assembly, environment, and nonuniformity in correction methods etc. after correction of the images for nonuniformity, an algorithm of nonuniformity correction based on neural network is proposed. A real time video signal processing system based on DSP and programmable devices is described in detail. Experimentation with the IR observation system showed that the algorithm is able to despeckle images adaptively and can be realized real time in the hardware system as proposed in this paper.