Designing integrations that survive failure
Retry, idempotency, dead-letter handling and reprocessing — the patterns that separate a production interface from a demonstration.
Read moreIntegration is where most organizations lose time quietly: exports, uploads, re-keying and reconciliation that nobody counts as a project. Replacing those handoffs with monitored, resilient interfaces removes the manual work and the errors that come with it.
Usually not in the connection itself, but in everything around it.
Exports, manual edits and uploads happen on a schedule that lives in someone's calendar. Errors are found downstream, days later, by a confused customer.
Something breaks, nothing alerts, and the problem is discovered when a report looks wrong or an order does not arrive. Recovery then requires archaeology.
Point-to-point connections built at different times by different people, with no consistent pattern, monitoring or documentation.
The same customer, product or account exists differently in each system, so synchronization propagates inconsistency faster rather than resolving it.
The question is not whether systems can be connected. It is whether anyone will know within minutes when a connection fails — which is the difference between an integration and a liability. It is whether anyone will know within minutes when a connection fails
Baselined against your current manual handling effort and error rates.
Typical reduction in export, re-key and reconciliation effort once interfaces replace spreadsheet handoffs.
Time from an interface failure to an alert reaching a named owner, replacing discovery by downstream complaint.
Target successful transaction rate with retry, dead-letter handling and reprocessing designed in rather than added after incidents.
Every interface monitored with alerting and a defined owner, so nothing fails quietly in the background.
Clear system of record per data domain with agreed synchronization direction, ending the conflicts that manual reconciliation papers over.
Interface specifications, error handling and runbooks documented, so integrations do not depend on the person who built them.
How to read these: the figures above are typical ranges we plan and measure against, not guarantees. In your first engagement we agree the baseline, the target and the measurement method in writing, then report against them.
Individual interfaces, integration platform design, or fixing an estate that grew by accident.
An architecture with consistent patterns, error handling and monitoring, rather than another point-to-point connection added to the pile.
Interfaces built with the resilience that production demands: retry, idempotency, dead-letter handling and reprocessing.
Monitoring, alerting and support so failures are detected and handled before they reach a customer.
Scoped individually. The integration inventory is a useful first step even if nothing else follows.
Documenting every interface including the manual ones, with volume, frequency, owner, failure history and business impact.
Establishing consistent patterns, authentication, error handling and monitoring standards so future interfaces are built the same way.
Building interfaces using Azure Integration Services, Power Platform connectors or custom APIs, chosen on fit rather than habit.
Mapping, transformation and synchronization rules with clear direction of authority for each field and conflict handling defined.
Idempotency, retry policy, dead-letter queues and documented reprocessing runbooks, so recovery does not require the original developer.
Interface health monitoring with alerting to named owners, plus dashboards showing throughput, latency and failure rates.
Where scheduled exports and uploads have become load-bearing: analysis, prioritization by risk and volume, then staged replacement with monitored interfaces.
Healthcare interoperability standards, financial services messaging, EDI with trading partners, and public sector data-sharing agreements with their own audit requirements.
Inventory first, then the interfaces carrying the most risk and volume.
Inventory every interface including manual transfers, with volume, frequency, owner and failure history.
Agree the system of record for each data domain and prioritize interfaces by business risk and manual effort.
Integration patterns, error handling, monitoring and security designed once and applied consistently.
Build and test with realistic volumes and deliberate failure scenarios, not just the happy path.
Monitor in production, tune throughput and retry behaviour, and extend the pattern to remaining interfaces.
We test failure deliberately. Interfaces are tested by breaking them: network interruption, malformed data, duplicate messages and downstream outage. Anything that only works when everything else works is not finished.
Integration is invisible when it works and extremely visible when it does not.
Retry, idempotency and dead-letter handling are part of the build. We assume connections will fail, because they do.
Interface specifications, error handling and runbooks are delivered as part of the work. Nothing depends on us remaining involved.
Because we implement Microsoft business applications and manage infrastructure, we are rarely integrating two systems we do not understand.
Every interface we build is monitored with alerting to a named owner. Silent failure is not an acceptable design outcome.
Illustrative engagements, written in the structure we use for real case studies.
Data moved between three systems by scheduled export and manual upload. Building proper integrations removed the reconciliation burden entirely.
Production data was entered twice, once on the floor and once in the ERP. A monitored interface removed the duplication and the disagreements.
Demo content: the organizations and measurements above are illustrative placeholders written to show the structure of a real story. Replace them with verified client results and approved references before publishing.
Material for teams whose systems do not talk, or talk unreliably.
Retry, idempotency, dead-letter handling and reprocessing — the patterns that separate a production interface from a demonstration.
Read moreWhy documenting every interface, including the manual ones, is the highest-value first step in any integration programme.
Read moreSystem of record, data ownership, volumes, failure handling, monitoring and support responsibilities to agree before building.
Read moreAn integration inventory usually reveals more manual handling than anyone expected, and a clear order in which to remove it.
Describe the situation in your own words.