News

IBM Research Automates QEC Decoder Chip Design Using Open AI Agent Factories at 11.5x Lower Inference Cost

In a research paper and technical release, scientists at IBM Research have demonstrated the use of AI “agent factories” to automate the architectural design of specialized classical hardware for Quantum Error Correction (QEC) decoders, achieving up to a 204x hardware speedup while cutting AI inference costs by 11.5x using open-weight models.

Authored by Abhishek Bhandwaldar, Mihir Choudhury, Ruchir Puri, and collaborators (“Highly Cost-Efficient Agent Factories for High Level Synthesis: Design Space Exploration for Quantum Error Correction Chip with Open Frontier Models and Distributed Inference at Scale“), the study applied autonomous multi-agent search to High-Level Synthesis (HLS) C++ implementations of the Relay-BP decoding algorithm designed for the [[144,12,12]] bivariate bicycle (Gross) qLDPC code.

[ IBM Agent Factory Benchmarks & Inference Economics ]
Model ConfigurationHLS Latency & SpeedupTotal Token ConsumptionInference Cost & Savings
• All-Proprietary
(Claude Opus 5)
• 204x Speedup (139 μs)• 215.9M tokens• $299.45
(Baseline)
• Hybrid Configuration
(Opus Coord. / GLM Workers)
• 126x Speedup (223 μs)• 197.5M tokens• $105.25
(2.8x Cheaper)
• All-Open Weight
(GLM-5.3 + llm-d)
• 52x Speedup (545 μs)• 240.9M tokens• $25.95
(11.5x Cheaper)
• All-Open Extended
(200-Hypothesis Budget)
• 60x Speedup (468 μs)• ~480.0M tokens• ~$52.00
(Diminishing Returns)

High-rate quantum low-density parity-check (qLDPC) codes significantly reduce physical-to-logical qubit overhead compared to standard 2D surface codes, but their dense, non-local check matrices demand complex, parallel classical decoding hardware. IBM’s Agent Factory framework addresses this by pairing a coordinator model with four parallel worker agents that propose architectural transformations—such as restructuring memory into check-major layouts, unrolling loop reductions into compile-time recursive trees, and creating dual-layout message stores to achieve Initiation Interval II = 1 execution.

By serving open-weight models on-premises using the open-source llm-d distributed inference stack, IBM achieved a 98% prefix-cache hit rate and reduced blended serving costs to ~$0.11 per million tokens. This allowed the all-open agent factory to deliver a 52x hardware speedup for $26 in inference cost, establishing that open frontier models combined with efficient inference infrastructure can make autonomous QEC chip design economically practical for scalable fault-tolerant quantum systems.

Review the full technical preprint on IBM Downloads here and read the research summary on the IBM Research Portal here.

In GQI Portal

The players behind the news

The team that writes QCR tracks every company, deal and technology in the GQI Factory, GQI's verified database of the quantum industry. Next up: every story linked to its players, coming to QCR's paid plans.

Leave a comment

All fields are required. Your email address will not be published.