Your company employs a proprietary system to transmit inventory data to a cloud-based data ingestion service at 6-hour intervals. Each transmitted dataset comprises multiple fields and includes a timestamp indicating the exact time of transmission. In instances where doubts arise concerning a transmission's accuracy or integrity, the system is designed to resend the data. Given this context, what is the most efficient method to deduplicate the transmitted data?