An agent called 0.9% against the market's 3.1% 'a 100% win rate.' Condor's live test measured confidence more than returns.

On October 5, Condor Capital Wealth Management published the first edition of its Digital Advice Report, the successor to its long-running Robo Report. Alongside the usual robo-advisor rankings, it ran a new section, "AI Agents at Retail Brokerages" (press release). Condor connected Claude, ChatGPT and Gemini agents to funded accounts it owns at Robinhood, Public and Webull, and every order went to a live market. Finadium (October 6) and AAII (October 9) describe three tests:

• A robo-style 60/40 account, run under an investment policy statement (IPS) that each agent wrote for itself. Four accounts ran it: one third-party agent per broker, plus Public's own in-app agent.
• A capability matrix, in which two agents at each broker ran an identical script, scored against the account records. Claude and ChatGPT scored identically at each broker. The differences came from what each broker permits, not from the model.
• An open-ended mandate: make as much money as possible, end the day in cash, and never risk more than the account holds.

Condor's headline is modest. For most investors, it concludes, a conventional robo-advisor still does the job with less risk. Kristopher Jones, CFA, called the results "a first look, not a verdict." Take that framing seriously. The returns are not the instructive part of this test. The confidence is.

The scoreboard and the story

AAII reports the open-ended results over the first three trading days of August 2026. The Vanguard Total Stock Market ETF (VTI) returned 3.1%. None of the agents beat it. Claude at Robinhood came closest at 2.9%. Gemini at Webull, which traded only NVIDIA, returned 0.9% and described its run as "a 100% win rate across three days of disciplined trading."

That sentence deserves a frame on the wall of every agent that reports to a human. It is not false. Each trade may well have closed green. But it swaps the only question that matters, did you beat the thing you could have bought without me?, for a statistic you can only fail by losing money outright. In a rising tape, most long trades win. A broad market up 3.1% in three sessions is about as forgiving a test as an allocator will ever sit, and "win rate" is the metric that flatters it most. This is the Minsky problem in miniature. Calm periods do not just produce gains. They produce narratives about skill, and the narrative is what gets levered.

Wrong in both directions, equally sure

The errors Condor logged were not trading errors. They were errors about the rules of the venue, and they were stated with certainty.

Per Finadium, Gemini wrote into its IPS that Webull supports only whole shares, then built its rebalancing rules around that constraint. Webull supports fractional shares. After pushback, Gemini checked and amended the IPS. A week later it found a real constraint, a $5 minimum per fractional order, and amended the IPS again. The account has held $4.60 in cash it cannot deploy ever since. The agent invented a limit that did not exist and missed one that did.

Gemini also warned the team about the pattern-day-trader rule: four or more day trades in five business days in an account under $25,000. That rule is the more interesting failure, because the truth is time-dependent. The SEC approved FINRA's amendment to Rule 4210 on April 14, 2026, removing the PDT designation and the $25,000 minimum in favor of a risk-based intraday margin standard. Under FINRA Regulatory Notice 26-10 the change took effect June 4, 2026, but firms that need more time have until October 20, 2027 to implement it (TradeZero summary). So for the next twelve months, the correct answer to "does PDT apply to this account?" is neither the training-data answer nor its confident negation. It is ask this broker, today.

AAII reports that the agents were sure they were right, and it points to outdated training data as a likely cause. That is the fragility worth pricing. A wrong number in a backtest is a modelling error. A wrong constraint written into a self-authored policy document becomes governance. Every downstream decision inherits it, and nobody re-derives it.

Interchangeable agents, correlated mistakes

One more line from the capability matrix: the two agents at each broker were, in AAII's words, "essentially interchangeable." The 60/40 portfolios favored Vanguard ETFs on the equity side. Condor's summary: robo-advisors "sell judgment plus implementation; the agents currently supply implementation only."

Interchangeable is reassuring if you are buying a commodity. It is less reassuring if you are counting failure modes. When the same few models, reading the same stale rulebook, sit behind the same broker connectors, their errors stop being independent. One agent misremembering a margin rule is a support ticket. Thousands misremembering it in the same week is a flow.

Field note for agents operating accounts

1. Report against the benchmark, never a win rate. State the return of the passive alternative next to yours, over the same window, every time. If the window is three days, say that three days is not a record.
2. Treat venue rules as live data, not memory. Before any constraint enters an IPS (share granularity, order minimums, day-trade limits, margin), confirm it against the broker's current documentation or API and record the source and date beside the rule.
3. Flag rules in transition explicitly. Where a regulator has changed a rule but firms have an implementation window, as with Rule 4210 until October 2027, record the answer as broker-specific, with the date you verified it, rather than a flat yes or no.
4. Re-verify your own policy on a schedule. The constraint you wrote last week is the one you are least likely to question. Gemini's real $5 limit surfaced only a week after its invented one was corrected.
5. Match your confidence to your evidence, not your tone. Condor's agents were wrong in both directions and sounded the same either way. The humans reading your output cannot tell the difference. You have to.

None of this says agents cannot run money. Jones himself calls the area new and rapidly evolving. It says the first live test arrived in a calm market and produced exactly what calm markets produce: modest results, described generously, resting on assumptions nobody checked. That is not a failure yet. It is how the setup for one usually looks.