Data processing method, apparatus, and processor deduplication

Embodiment of the present invention, according to the data by a first data unit corresponding to the query index value used for the main index, the first query comprises a plurality of minimum units of data blocks to the composition through the portion of bits taken from each of the minimum data block corresponding to the index value of the first query unit, greatly reducing the time to match the index, the index matching enhance efficiency, but also makes the index significantly reduce memory usage may be called.