Spatial Similarity Measure of Visual Phrases for Image Retrieval

Spatial information plays an essential role in accurate matching of local features in applications, e.g., image retrieval. Despite of previous work, it remains a challenging problem to extract appropriate spatial information. We propose an image retrieval framework based on visual phrase. By encoding the spatial information into the similarity measure of visual phrases, our approach is able to capture accurate spatial information between visual words. Furthermore, the image-specific visual phrase selection process helps to reduce large number of redundant visual phrases. We have conducted experiments on two datasets: UKbench and TRECVID, which shows that our ideas significantly improve the performance in image retrieval application.