Each of these has broken a cocoa programme somewhere. They are worth putting to any vendor you evaluate, including this one.
The same farm arrives from two systems
Resolved on ingestThe field tool holds a farmer ID, the ERP a vendor code, the cooperative spreadsheet a name spelled three ways. A plot is unique per supplier by its external identifier, so the second arrival updates the first instead of creating a duplicate nobody notices until a statement names both.
A sync runs twice, or the source pages overlap
IdempotentRecords land in a raw staging table keyed on their identity, and a re-run over unchanged or overlapping source data collapses to a single row, last occurrence wins. Without it, everything downstream would process the duplicates as real deliveries.
A column means something different this month
Re-mappableMappings are versioned configuration. A source that renames a column, or starts sending hectares where it used to send acres, needs one change to the mapping and no migration.
The data is simply incomplete
Surfaced earlyThe common case, and not a parsing problem. Incomplete origin data surfaces as a supplier whose plot coverage is short and an order that cannot yet be filed, months ahead of the submission window instead of inside it.