AI 编程 · 工具竞争

OpenSquilla自我验证
AI编码进入证据链时代

OpenSquilla Self-Verification
AI Coding Enters the Evidence Chain Era

红绿回归测试三关全过才交付,AI编码评判标准从"它声称改对了"转向"它能否自证改对了"。常规场景成本直降60-80%。

Red-green-regression: all three gates must pass before delivery. The standard for judging AI code is shifting from "it claims it's fixed" to "can it prove it's fixed." Routine scenario costs plummet 60-80%.

No.007 2026.07.02 约 5 分钟阅读 ~5 min read

"我改好了,你看看。"

过去一年,每个用AI写代码的开发者都听过太多次这句话。Agent运行两分钟,信心满满提交结果,你拉下来一看——编译不过、测试全红、边缘情况完全没考虑。"能写"不等于"能信",这是AI编码至今无法真正无人值守、规模化进入生产环境的核心瓶颈。

7月1日,开源AI Agent项目OpenSquilla发布0.4.0版本,给出了一个直接的解决方案:AI不再止步于"我改好了"的口头交付,而是在交回结果前,先用测试为自己跑出一份可复核的证据链。

红绿回归三关,过不了自动重改

OpenSquilla的"自我验证"机制是一条独立的红绿回归证据链,分三步走。

第一关:红测试定性。AI先写一个注定失败的测试,精准复现要修复的bug或要新增的功能。这个测试跑不过,才说明它真的理解了问题所在,而不是在瞎改。第二关:绿测试验证。AI实现功能或修复bug,让刚才写的测试从红转绿,证明问题确实被解决了。第三关:回归测试兜底。跑一遍项目原有测试套件,确认新改动没有弄坏其他地方。

三关全过才算交付,任一不过直接打回自动重改,直到通过为止。配套机制还包括隔离施工——所有改动都在隔离副本里进行,验收合格才落回源码,避免Agent手滑删了你的生产代码。

官方演示用了Andrej Karpathy的micrograd项目做例子:AI需要给这个极简自动微分库新增"计算正确梯度"的功能——而梯度算错不会报错也不会崩溃,只会让模型悄悄越学越偏,是最难靠肉眼发现的那类bug。OpenSquilla走完红→绿→回归三关后,团队把结果和PyTorch在同一道题上并排比对,前向值与每一个梯度小数点后10位完全一致。不是"AI自己说对",而是"它和官方标准答案分毫不差"。

成本降9倍,Agent Harness赛道升温

除了自我验证,OpenSquilla主打的另一个卖点是性价比。在主流Agent框架普遍推高模型调用、token成本节节攀升的背景下,它通过本地智能路由——按任务复杂度自动选模型、技能按需加载、记忆按需检索、工具结果预处理——在"调用前"就压降成本。

官方数据显示,其智能路由相比通用网关OpenRouter,路由精度高约4.4个百分点、成本低约75%;与旗舰模型跑同类任务质量基本持平、成本相差约9倍。常规场景内测综合成本可下降60-80%。上线数周内GitHub star增至数千量级,公司成立数月即完成首轮融资。

OpenSquilla不是孤例。过去三个月,Agent Harness——即"给Agent提供执行环境、验证机制、工具链的基础设施层"——正在成为AI编程赛道的新热点。从Cursor的Agent模式到Claude Code的命令行工具,从Devin的全自动DevOps到各类开源Agent框架,大家都在解决同一个问题:怎么让Agent在没有人盯着的情况下,可靠地完成真实世界的工程任务

Hacker News当天登上首页的Senior SWE-Bench也在指向同一个方向——新的基准测试不再考Agent解决LeetCode题目的能力,而是评估它作为"高级工程师"在真实代码库中的表现。这意味着行业的评判标准已经从"生成质量"转向了"交付可靠性"。

AI编程工具战争打到2026年下半年,单纯拼模型能力已经不够了。谁能建立起可靠的验证闭环、谁能把幻觉和错误率压到生产可用的水平、谁能在保证质量的前提下把成本打下来——谁才是真正能帮开发者干活的工具,而不是一个需要人随时盯着擦屁股的"实习生"。

"I fixed it, take a look."

Over the past year, every developer using AI to write code has heard this line one too many times. The Agent runs for two minutes, confidently submits results, you pull the code -- it doesn't compile, tests are all red, edge cases completely ignored. "Can write" doesn't mean "can trust" -- that's the core bottleneck preventing AI coding from achieving true lights-out, production-scale deployment.

On July 1, the open-source AI Agent project OpenSquilla shipped version 0.4.0 with a direct answer: AI no longer stops at the verbal delivery of "I fixed it." Before handing back results, it first runs tests to produce a verifiable evidence chain for itself.

Red-Green-Regression: Three Gates, Fail Any and Auto-Retry

OpenSquilla's "self-verification" mechanism is an independent red-green-regression evidence chain, executed in three steps.

Gate one: Red test characterization. The AI first writes a test guaranteed to fail, precisely reproducing the bug to fix or the feature to add. Only if this test fails does it prove the AI actually understands the problem, rather than making random changes. Gate two: Green test verification. The AI implements the feature or fixes the bug, turning the test from red to green, proving the problem is genuinely solved. Gate three: Regression safety net. Run the project's existing test suite to confirm the new changes didn't break anything else.

All three gates must pass for delivery; fail any and it gets sent back for automatic revision until it passes. Supporting mechanisms include isolated execution -- all changes happen in an isolated copy, only merged back to source after passing acceptance, preventing Agents from accidentally deleting your production code.

The official demo used Andrej Karpathy's micrograd project: the AI needed to add "correct gradient computation" to this minimalist autodiff library -- and miscalculated gradients don't throw errors or crash; they silently make the model learn worse, the kind of bug hardest to spot by eye. After OpenSquilla completed the red -> green -> regression sequence, the team compared the results side-by-side with PyTorch on the same problem and found forward values and every single gradient matched to 10 decimal places. Not "the AI says it's right," but "it matches the authoritative answer exactly."

Costs Drop 9x, the Agent Harness Race Heats Up

Beyond self-verification, OpenSquilla's other selling point is cost efficiency. Against a backdrop where mainstream Agent frameworks are driving up model calls and token costs keep climbing, it uses local intelligent routing -- automatically selecting models by task complexity, loading skills on demand, retrieving memory on demand, preprocessing tool results -- to crush costs before the call is even made.

Official data shows its intelligent routing beats the general-purpose gateway OpenRouter by approximately 4.4 percentage points in routing accuracy while costing roughly 75% less; quality is on par with flagship models on comparable tasks while costing roughly 9x less. Internal testing shows 60-80% comprehensive cost reduction on routine scenarios. Within weeks of launch, GitHub stars surged to the thousands, and the company closed its first funding round just months after founding.

OpenSquilla isn't alone. Over the past three months, Agent Harness -- the infrastructure layer that provides execution environments, verification mechanisms, and toolchains for Agents -- has become the new hotspot in AI coding. From Cursor's Agent mode to Claude Code's CLI tool, from Devin's fully automated DevOps to various open-source Agent frameworks, everyone is solving the same problem: how to let Agents reliably complete real-world engineering tasks without a human babysitter.

Senior SWE-Bench, which hit the Hacker News front page the same day, points in the same direction -- the new benchmark doesn't test Agents on LeetCode problems; it evaluates their performance as "senior engineers" in real codebases. This means the industry's judging standard has shifted from "generation quality" to "delivery reliability."

As the AI coding tool wars rage into the second half of 2026, simply competing on model capability is no longer enough. Whoever builds a reliable verification loop, whoever drives hallucinations and error rates down to production-grade levels, whoever crushes costs while maintaining quality -- that's the tool that actually helps developers get work done, rather than an "intern" you have to constantly watch and clean up after.

多数编码Agent改完即交,对错仍要人逐行复核。把验证内化进Agent自身,意味着行业评判AI编码的标准正在改变。

—— OpenSquilla团队

Most coding Agents hand in their changes and move on, leaving humans to verify correctness line by line. Internalizing verification into the Agent itself means the industry's standard for judging AI coding is changing.

-- The OpenSquilla Team
OpenSquilla 0.4.0 · 自我验证 · 红绿测试 · AI编程 · Agent Harness · 成本优化
OpenSquilla 0.4.0 · Self-Verification · Red-Green Testing · AI Coding · Agent Harness · Cost Optimization
Sources · 信源 Sources

本文基于 Dawn Vision 认知引擎处理的 8 个源信号生成,经编辑部人工审核。素材来源:量子位、InfoQ中文、Hacker News。

Generated by Dawn Vision's cognitive engine from 8 source signals, with editorial review. Sources: QbitAI, InfoQ China, Hacker News.