Abstract: In order to realize the image matching of three-dimensional object under different perspective, a method which is robust to affine transformation is proposed. Based on the fully affine invariant image comparison method, named Affine-SIFT (ASIFT), mASIFT (multi ASIFT) was put forward, in which a geometric transformation constraint method named mRANSAC(multi-plane RANSAC) was used to extract the right matching points from the coarse matches. It is corroborated that, compared to the singular homography constraint, the multi-plane constraint excluding mismatching method is more proper to the multi-plane characteristics of 3D objects. It could increase the number of matching pairs up to 5~9 times of ASIFT under the same condition. Further, the mutual error threshold of every homography would lower 3 pixels or 2 pixels. As a result, the proposed method could remove mismatches more efficiently, calculate out more accurate transformations and obtain more exact matching.