Scuttlebutt

Scuttlebutt

Cisco's Outshift chief: 3 misaligned agents cut a 5-agent system's accuracy to 16%

8 arguments: a travel test that was 66% up and finished 0% of its tasks, the 3 protocols Cisco is open-sourcing, and why a personal agent still can't book dinner

Scuttlebutt's avatar
Scuttlebutt
Nov 12, 2026
∙ Paid

The Cognitive Revolution · Nov 11, 2026 · 1h 31m · 82m saved

With Vijoy Pandey, Senior Vice President and General Manager of Outshift by Cisco

Cisco's Outshift chief: 3 misaligned agents cut a 5-agent system's accuracy to 16%

In Cisco's own five-agent deployments, accuracy fell from 99% with no misalignments between the agents to 16% with three. Vijoy Pandey, senior vice president and general manager of Outshift by Cisco, told Nathan Labenz on The Cognitive Revolution podcast that this kind of failure never shows up on a standard dashboard.

Most of the industry measures whether agents are up and connected. Vijoy argues that agents can be connected and still not understand each other, and that the gap between the two is where multi-agent systems quietly fail.

"We realized that connectivity is not the same as cognition. What we need to move towards is shared cognition and shared reasoning." — Vijoy Pandey

Vijoy runs Cisco's incubation arm, which has deployed multi-agent systems with Swisscom, ServiceNow, SoftServe and Webex and is now open-sourcing the protocols it built to keep those agents aligned.

The full interview is covered here so you can skip it. 91 minutes of audio, 9 minutes of reading.

Here are the 8 arguments that matter.


This Scuttlebutt Summary is available in full to premium subscribers. If you're not one already, please consider subscribing to keep reading.


Key Takeaways

  • Connectivity is not the same as cognition, and agents can be up while failing at the task

  • 100% of public ChatDev sessions Cisco analyzed had semantic or cognitive-misalignment failures

  • Three misalignments took a five-agent system to 16% accuracy, close to a random pick

    • A travel-booking test was 66% up with 0% task completion

  • Cisco is open-sourcing Scope, Accord and Concord, with a fourth piece for checking finished work still to come

  • Human judgment stays in the loop for now because data is never sufficient

  • Vijoy's personal agent keeps one identity across several models and harnesses, yet still cannot book a shared dinner

  • Agents talking in latent space is inevitable in Vijoy's view, but should be rolled out like a new drug

1. Agents Now Cross Vendors

Vijoy described the past six or seven months as three phases: isolated single agents, then "islands" of agents inside one harness, and now agents from different vendors and clouds working together. Cisco's AGNTCY project has moved to the Linux Foundation, and the company has shipped this third kind of system to customers.

Vijoy Pandey says Cisco's deployments mix vendors, clouds and organizations

"We've actually been deploying a whole bunch of multi agent systems where you have agents that are connected coming from different vendors, coming from different cloud providers, using different kinds of tools and belonging to different organizations." — Vijoy Pandey

The Swisscom project paired a formal model of a telecom data center with five collaborating agents. The goal was to make network configuration changes during a data-center migration with no errors at all.

"What they wanted to do was make configuration 100% error free ... we had five agents coming together and exploring all of the spaces of configuration to ensure that you get 100% error free configs." — Vijoy Pandey

Vijoy Pandey puts the value in the handoff between agents, not in any one agent

"The value in the system is not sitting within one particular agent. The value is actually in the handoff that's happening between these agents and the value is a global outcome for the company, for the enterprise." — Vijoy Pandey

Nathan connected this to OpenAI's agents SDK, which made the handoff "one of the core primitives that they built the whole thing around."

2. Connected Is Not Aligned

User's avatar

Continue reading this post for free, courtesy of Scuttlebutt.

Or purchase a paid subscription.
© 2026 The Golden Age LLC · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for writing, podcasting, and media founders.