De-duplication

De-Duplication (“De-Duping”) is the process of comparing electronic records based on their characteristics and removing or marking duplicate records within the data set. The definition of “duplicate records” should be agreed upon, i.e., whether an exact copy from a different location (such as a different mailbox, server tapes, etc.) is considered to be a duplicate. De-duplication can be selective, depending on the agreed-upon criteria. See also Case De-Duplication, Content Comparison, Cross- Custodian De-Duplication, Custodian De-Duplication, Data Verification, Digital Fingerprint, File Level Binary Comparison, Hash Coding, Horizontal De-Duplication, Metadata Comparison, and Production De-Duplication.."