Abstract: Describes the characteristics and requirements of bandwidth, delay and loss in the transmission of real time video signals over the Internet. Studies the QoS control method of the application layer. Gives the improvement on the architecture of the real time video transmission. Introduces the proxy caching technique in the architecture, which alleviates the loads on the server and the network congestion, and enhances the quality of the video playback.