A Hypergraph Matching Framework for Refining Multi-source Feature Correspondences
In this paper, we develop a hypergraph matching framework which enables feature correspondence refinement for multi-source images. For images obtained from different sources (e.g., RGB images and infrared images), we first extract feature points by using one feature extraction scheme. We then establish feature point correspondences in terms of feature similarities. In this scenario, mismatches tend to occur because the feature extraction scheme may exhibit certain ambiguity in characterizing feature similarities for multi-source images. To eliminate this ineffectiveness, we establish an association hypergraph based on the feature point correspondences, where one vertex represents a feature point pair resulted from the feature matching and one hyperedge reflects the higher-order structural similarity among feature point tuples. We then reject the mismatches by identifying outlier vertices of the hypergraph through higher order clustering. Our method is invariant to scale variation of objects because of its capability for characterizing higher order structure. Furthermore, our method is computationally more efficient than existing hypergraph matching methods because the feature matching heavily reduces the enumeration of possible point tuples for establishing hypergraph models. Experimental results show the effectiveness of our method for refining feature matching.
KeywordsHypergraph matching Feature matching Multi-source image processing
Unable to display preview. Download preview PDF.
- 3.Brown, M., Lowe, D.G.: Recognising panoramas. In: Internat. Conf. on Computer Vision (ICCV), vol. 2, pp. 1218–1225 (2003)Google Scholar
- 6.Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: Internat. Conf. on Computer Vision (ICCV), pp. 2564–2571 (2011)Google Scholar
- 7.Yan, Q., Shen, X., Xu, L., Zhuo, S., Zhang, X., Shen, L., Jia, J.: Cross-field joint image restoration via scale map. In: Internat. Conf. on Computer Vision (ICCV), pp. 1537–1544 (2013)Google Scholar
- 8.Lowe, D.G.: Object Recognition from Local Scale-Invariant Features. In: Internat. Conf. on Computer Vision (ICCV), vol. 2, pp. 1150–1157 (1999)Google Scholar