Find and Remove Redundant Emails

AutoDeduplicate™ addin for Microsoft Outlook®

Introduction
Deleting duplicate emails and email content contained in other emails shrinks the mountain of data your legal team has to look at. This kind of deduplication is often referred to as "inclusive email identification". Inclusive email identification finds the minimum set of emails needed to preserve all unique conversational content. If an email includes the full quoted text of all earlier emails in the thread, you don't need to review those earlier emails separately — unless they contain unique content, attachments, or metadata that matters. Less data means fewer billable hours spent reading the same message threads over and over. It speeds up the entire investigation, cuts down your legal bills, and keeps lawyers from making mistakes on repetitive files.
What is AutoDeduplicate™ for Outlook®?
AutoDeduplicate is an add-in for Classic Microsoft Outlook, one of the world's most widely used email applications. It analyzes the contents of Outlook email folders to identify redundant messages, including duplicate emails and emails whose content is fully contained within other messages in the same conversation (inclusive email identification).
Use this software to perform the following tasks:
  • Find redundant emails whose content is fully contained within other messages (dethreading)
  • Find duplicate and near duplicate emails
  • Move redundant emails into a separate folder.
  • Assign duplicate (redundant) emails to a special “category” to provide a visual guidance.
  • Export email metadata into a spreadsheet-ready CSV file.
  • Run statistical analysis on email folders.
What kind of Duplicates are Detected?
The software can detect the following kind of duplicate emails:
  • Identical emails recived from the same or different sources
  • Emails that are contained in other emails (threads)
  • Near-duplicate emails that differ only by punctuation and/or text case
  • Near-duplicate emails that differ only by custom keywords
Real-World Results
In everyday use, email deduplication can produce immediate, measurable improvements. For example, after processing a technical support mailbox, approximately 35% of the messages were identified as redundant and safely archived. As a result, support engineers spent less time navigating lengthy conversations, searches returned fewer irrelevant results, and mailbox backups and exports became smaller and faster to process.
For litigation and eDiscovery professionals, reducing redundant emails also decreases the volume of material that must be reviewed, helping to lower review costs while ensuring that all unique communications are retained. This directly translates into huge time savings when converting large email archives into PDF files, potentially saving hours or even days of work.
How Deduplication Works?
The software scans your selected email folders to detect duplicate and near-duplicate messages through an advanced dethreading process. If earlier emails in a thread are fully contained within later replies, they are flagged as redundant. Once the scan is complete, you can review and validate the results. Verified duplicates can then be automatically moved to a designated folder (such as Trash) or assigned a 'Duplicate' category for easy visual identification.
See the step-by-step deduplication tutorial for detailed instructions.
Exporting Email Metadata
The software allows you to export comprehensive email metadata for any custom date range directly into CSV or HTML table formats. This generated metadata captures all critical details for each message—including fields such as To, From, Date, Subject, Message Text, CC, BCC, Importance, Sensitivity, Size, Attachment Info, and Email Headers. Whether you need to generate clean HTML reports for quick review or export raw CSV data into Excel for advanced analysis, the tool gives you complete control over your email data reporting.
System Requirements
  • "Classic" Microsoft Outlook for Windows - versions 2013/2016/2019/Office 365
  • Microsoft Windows 10/11
  • IMPORTANT: This software is not designed for "new" Outlook that does not provide necessary functionality
Download Trial Software
Click here to download a trial version of the AutoDeduplicate™ for Outlook®. The trial version limits moving duplicates to 1,000 emails.
Once you exceed this 1,000-email limit, the software remains fully functional for scanning and analysis. You can still use it to find and view duplicate emails across your folders. However, the automated cleanup feature will be locked.The software will disable the feature that automatically moves detected duplicates into your specified destination folder. To restore unlimited automated moving and processing, you will need to upgrade to the full version.