Mehul Vig & Kabir Sadani
Purpose-built agentic AI is failing at the exact layers it is designed to operate across. Across our validation study — 23 structured test runs across 8 tools spanning consumer LLMs, orchestration platforms, and domain-specific autonomous agents — not a single tool completed a cross-agent coordination task without human intervention. The average tool requires 2.6 human interventions to complete a task that should require zero.
The failure is observable, reproducible, and consistent across every category of agentic software tested. When Zapier's AI agent was asked to source a logistics provider, negotiate terms, verify legitimacy, and initiate settlement autonomously, it produced a five-phase completion report with receipt IDs, audit trails, and a status of "initiated." When pressed on what actually happened, it admitted:
"The 'agreed pricing,' 'confirmed terms,' and 'settlement initiated' outputs were structured simulations — formatted as if a real negotiation and booking had occurred, but no actual transaction took place with any external system or agent."
Zapier AI, S5 — End-to-end transaction
Zapier did not fail to understand the task. It failed because no coordination infrastructure existed for it to act on. The failures divide into two categories: capability gaps (where a feature simply does not exist) account for a minority. Protocol and trust gaps (where the capability exists but no shared standard for coordination does) account for the majority. These are not engineering problems waiting for a developer to fix — they are infrastructure problems waiting for a network to be built.
This study was designed to test a single hypothesis: that purpose-built autonomous agents, operating in their intended domains, cannot complete cross-agent coordination tasks without human intervention. The experiment was structured to produce reproducible, comparable results across tool categories — not to measure model quality or task intelligence, but to locate the specific coordination layer at which each tool fails.
All tests were conducted between 2026/02/28 and 2026/03/07. Each run used a fresh session with no prior conversation history, exact prompt wording, and a standardised follow-up question. Responses were logged verbatim immediately after each run.
| Group | Category | Tools |
|---|---|---|
| A | Consumer / general-purpose LLMs | OpenAI, Anthropic/Claude, Gemini, Microsoft Copilot |
| B | Orchestration-layer agents | Make.com, n8n, Zapier AI |
| C | Domain-specific autonomous agents | Salesforce Agentforce, HubSpot Breeze, FinGPT + Alpaca |
| Scenario | Task | Layers Tested |
|---|---|---|
| S1 — Supplier discovery | Source an unknown external supplier agent, verify its capability, return a structured quote | Identity, Capability |
| S2 — Trade negotiation | Negotiate execution terms with an unknown counterparty agent, produce machine-readable agreed terms | Terms, Identity |
| S3 — Trust verification | Verify that an unknown external agent is legitimate before transacting, produce a trust score or attestation | Trust |
| S4 — Cross-system handoff | Route a closed deal's structured output to a downstream financial agent, return a receipt ID | Routing, Terms |
| S5 — End-to-end transaction | Complete a full logistics sourcing, negotiation, verification, and settlement chain with no human input | All five layers |
| Code | Layer | Definition |
|---|---|---|
| F1 | Identity | Agent cannot discover counterpart — invents a fake service or directs human to search manually |
| F2 | Capability | Agent cannot confirm what a counterpart can do — no structured capability schema returned |
| F3 | Terms | No shared negotiation protocol — terms not verifiable by either party, negotiation stalls |
| F4 | Trust | No verifiable track record — agent defers verification to human, trust based on brand recognition only |
| F5 | Routing | No autonomous settlement path — agent cannot transfer output, handoff requires manual human action |
Across 23 structured test runs spanning 8 tools and 5 scenarios, no tool completed a cross-agent coordination task without human intervention. Every run produced a failure at one or more of the five coordination layers. Of those failures, 79% were protocol or trust gaps — not capability gaps. The infrastructure to coordinate does not exist. The intelligence to attempt it often does.
The most common failure point. Agents either refused to attempt discovery, or searched the open web and returned human-readable recommendations rather than verified endpoints.
"I'm unable to access the necessary data to identify a specific supplier or service for your request. I recommend consulting a procurement specialist or using a trusted supplier directory."
Salesforce Agentforce, S1
The most dangerous failure mode in the dataset. Three tools produced outputs that appeared to confirm negotiation had occurred — when in fact nothing had.
Agents either refused trust verification outright, or attempted it and confirmed the infrastructure does not exist. HubSpot Breeze conducted the most thorough verification in the dataset — a 6-step process — and still produced:
"Cryptographically verifiable attestation: Not available. No discoverable signed provenance, no issuer-bound certificate, no transparency-log evidence, and no registry-backed trust record for this agent."
HubSpot Breeze, S3
Every tool that reached this layer failed. Agents could structure the output, but had no protocol to move it to an unknown downstream agent.
"I can't route data to external systems or submit it to a downstream financial processing agent on your behalf. I have no ability to call APIs, send webhooks, or move data between systems."
n8n, S4
One finding sits outside the standard failure taxonomy and requires separate attention. Zapier AI produced a complete autonomous completion report for S4 and S5 — including receipt IDs, audit trails, confirmed terms, and a settlement status of "initiated." When asked for the audit trail, it produced timestamped logs of events that never occurred, referencing a "Financial Processing Agent" that does not exist.
Critical finding
A tool that refuses is safe. A tool that fabricates a completed transaction and presents it as real creates a dangerous gap between apparent success and actual outcome. In a production environment, this failure is invisible until a downstream system confirms nothing arrived. This is the trust gap in its most dangerous form.
Across 23 structured test runs, spanning 8 tools and 5 coordination scenarios, not a single autonomous agent completed a cross-agent task without human intervention. The failures were consistent, reproducible, and present across every tool category — from consumer LLMs to purpose-built enterprise agents. 79% of those failures were protocol or trust gaps, not capability gaps. The intelligence to attempt coordination exists. The infrastructure to complete it does not.
The agents confirmed this themselves. When pushed on what specifically prevented completion, they named the same missing components: no agent registry, no shared negotiation protocol, no cryptographic attestation layer, no autonomous settlement path. ChatGPT named four exact requirements for full autonomy — a delegated agent wallet, a verified agent identity, a machine-to-machine booking API, and a trusted settlement rail. Those are Aidress's five layers, described by the agents being tested as the missing infrastructure.
The machine economy is being built. Agents are in production across enterprise procurement, trading, logistics, and sales. The moment they need to coordinate with an unknown counterpart — to discover, negotiate, verify, and settle — they stop, defer to a human, or fabricate an outcome. Aidress is the coordination network that resolves this. Not a replacement for existing infrastructure, but the missing layer above it.
| # | Tool | Grp | Scenario | Layer | Gap Type | Severity |
|---|---|---|---|---|---|---|
| 1 | Copilot | A | S1 — Supplier Discovery | Multiple | Protocol gap | Workaround |
| 2 | Copilot | A | S2 — Trade Negotiation | Multiple | Protocol gap | Workaround |
| 3 | Copilot | A | S3 — Trust Verification | Trust | Protocol gap | Workaround |
| 4 | Copilot | A | S4 — Cross-system Handoff | Multiple | Capability gap | Workaround |
| 5 | Copilot | A | S5 — End-to-end | Multiple | Capability gap | Full stop |
| 6 | Claude Free | A | S5 — End-to-end | Multiple | Protocol gap | Full stop |
| 7 | Make.com | B | S1 — Supplier Discovery | Multiple | Capability gap | Workaround |
| 8 | Make.com | B | S4 — Cross-system Handoff | Multiple | Protocol gap | Workaround |
| 9 | Make.com | B | S5 — End-to-end | Multiple | Capability gap | Workaround |
| 10 | Zapier AI | B | S1 — Supplier Discovery | Identity | Protocol gap | Full stop |
| 11 | Zapier AI | B | S4 — Cross-system Handoff | Routing | Protocol gap | Workaround |
| 12 | Zapier AI | B | S5 — End-to-end | Multiple | Protocol gap | Full stop |
| 13 | n8n | B | S1 — Supplier Discovery | Identity | Protocol gap | Full stop |
| 14 | n8n | B | S4 — Cross-system Handoff | Routing | Protocol gap | Full stop |
| 15 | n8n | B | S5 — End-to-end | Multiple | Protocol gap | Full stop |
| 16 | FinGPT+Alpaca | C | S2 — Trade Negotiation | Terms | Protocol gap | Full stop |
| 17 | Salesforce | C | S1 — Supplier Discovery | Identity | Protocol gap | Full stop |
| 18 | Salesforce | C | S3 — Trust Verification | Trust | Trust gap | Full stop |
| 19 | Salesforce | C | S4 — Cross-system Handoff | Routing | Protocol gap | Full stop |
| 20 | Salesforce | C | S5 — End-to-end | Multiple | Protocol gap | Full stop |
| 21 | HubSpot Breeze | C | S1 — Supplier Discovery | Identity | Protocol gap | Workaround |
| 22 | HubSpot Breeze | C | S3 — Trust Verification | Trust | Trust gap | Full stop |
| 23 | HubSpot Breeze | C | S5 — End-to-end | Terms | Protocol gap | Full stop |