具身智能 · 机器人

蚂蚁开源空间原生视觉基模
机器人视觉底座重构

Ant Open-Sources Space-Native Vision Foundation Model
Rebuilding Robotic Vision from the Ground Up

10亿参数ViT在密集空间任务上匹敌70亿DINOv3,0.3B学生模型精度相当但参数量少23倍。首个空间原生具身视觉基模开源,机器人终于能看准透明杯子了。

A 1B-parameter ViT matches 7B DINOv3 on dense spatial tasks; a 0.3B student model hits comparable accuracy with 23x fewer parameters. The first space-native embodied vision foundation model is open-source — robots can finally see transparent cups correctly.

No.010 2026.07.07 约 5 分钟阅读 ~5 min read

香槟塔上的透明玻璃杯壁,在传统深度相机眼里是破碎、空洞、与背景融为一体的;在LingBot-Depth 2.0眼里,杯子的边界、层级、开口方向,甚至连从壶嘴流出的透明水柱都清晰可见。

7月7日,蚂蚁集团旗下具身智能公司灵波科技正式发布空间感知模型LingBot-Depth 2.0,并同步开源了视觉基座模型LingBot-Vision——这是业界首个面向机器人真实任务的空间原生视觉基模。在12个深度补全benchmark上,LingBot-Depth 2.0拿下全部领先结果;更关键的是,它的底座LingBot-Vision用10亿参数,在NYU-Depth v2等密集空间任务上匹敌或超过了参数量约7倍的通用视觉基础模型(包括7B DINOv3)。

为什么机器人视觉需要"空间原生"?

过去几年,具身智能公司习惯了"拿来主义":把计算机视觉领域的通用基础模型(如DINOv3、CLIP、SAM)直接拿来给机器人用。这些模型在图像分类、语义分割、目标检测上表现很好,但一到机器人场景就掉链子。

为什么?因为通用视觉模型的训练目标是"这是什么"——识别猫、狗、汽车、行人。但机器人需要的视觉能力不只是识别,而是"它在哪里、边界在哪、离我多远、能不能抓、走过去会不会撞"。这是两套完全不同的视觉理解逻辑。

灵波团队发现了一个关键突破口:边界。边界不只是物体轮廓,它同时意味着深度突变、遮挡关系、空间分割和可交互区域。杯口的边缘决定了机械臂能不能伸进杯子里,门框的边线决定了机器人能不能通过,桌面的轮廓决定了物体放上去会不会掉。

于是团队提出了masked boundary modeling(掩码边界建模)——一种专门让模型学习边界和几何结构的自监督训练方式。普通的掩码建模是随机遮住图像的一块让模型猜,但随机遮住的可能是墙面、天空等信息密度低的区域。LingBot-Vision的做法更"狠":让教师模型在线发现图像里的边界token,强制把这些边界token加入掩码,让学生模型必须去学会重建那些最难、最有空间信息量的区域。

这就是boundary-forcing机制。模型不只要学"这是什么",还要学"它的边界在哪、形状如何、和周围空间是什么关系"。

从实验室到真实场景的四个难题

机器人视觉在真实场景中最怕四类场景,LingBot-Depth 2.0给出的答卷相当亮眼。

第一类是透明和反光材质。这是机器人视觉的噩梦——玻璃杯、香槟塔、镜面、光面金属在RGB画面里能看到,但深度传感器在这些区域经常返回空洞或错误距离。LingBot-Depth 2.0通过LingBot-Vision底座学到的几何先验,能稳定保持杯口、杯壁、杯身之间的几何关系,让机械臂知道从哪里下手抓不会碰碎旁边的杯子。

第二类是小目标和远距离目标。移动机器人往前走时,不能等到障碍物贴脸才反应,需要提前看到远处的人、宠物、路障。LingBot-Depth 2.0在户外场景中能稳定识别远处的网球(比狗还小的目标),地面、墙体、树木、动物之间的空间层次保留完整。

第三类是室内复杂场景。家里的玻璃门、窗帘、电视柜、阳台杂物,加上光照随镜头移动不断变化,传统模型经常在玻璃、强光、阴影交界处出现大片破碎。LingBot-Depth 2.0输出的深度图更连续,墙面、门框、桌面边缘更完整。

第四类是端侧部署。LingBot-Vision的0.3B蒸馏学生模型,在NYU-Depth v2上能达到与7B DINOv3相当的精度,参数量大约少23倍。这意味着不需要背一个巨大的模型到处跑,普通机器人的边缘计算芯片就能跑得动。

商业化层面,LingBot-Depth 2.0已通过奥比中光深度视觉实验室认证,双方围绕EGO-RGBD数采设备、SDK和后续一体化相机产品展开合作。模型权重已在HuggingFace和ModelScope开源,代码在GitHub上可用。

过去一年具身智能的竞争焦点主要在"身体"(电机、关节、运动控制)和"大脑"(大模型接入、任务规划)。蚂蚁灵波这次开源提醒行业:视觉感知是机器人与物理世界交互的第一道关口,看得见但看不准,后面的规划和控制都是空中楼阁。从英伟达ASPIRE的技能库到灵波的视觉基模,具身智能正在从"demo好看"走向"真能干活"。

明天见。

The walls of a transparent glass on a champagne tower look shattered, hollow, and merged with the background to a traditional depth camera. To LingBot-Depth 2.0, the cup's boundaries, layers, opening direction — even the transparent stream of water pouring from a spout — are crystal clear.

On July 7, Ant Group's embodied AI subsidiary LingBot Tech officially released the spatial perception model LingBot-Depth 2.0, and simultaneously open-sourced the vision foundation model LingBot-Vision — the industry's first space-native vision foundation model built for real robotic tasks. Across 12 depth completion benchmarks, LingBot-Depth 2.0 took top results across the board. More critically, its backbone LingBot-Vision, with 1 billion parameters, matches or outperforms general-purpose vision foundation models roughly 7x its size (including 7B DINOv3) on dense spatial tasks like NYU-Depth v2.

Why Does Robotic Vision Need "Space-Native"?

For the past few years, embodied AI companies have relied on a "borrow-and-use" approach: taking general-purpose computer vision foundation models (like DINOv3, CLIP, SAM) and applying them directly to robots. These models excel at image classification, semantic segmentation, and object detection — but they fall apart in robotic scenarios.

Why? Because general vision models are trained to answer "what is this?" — recognizing cats, dogs, cars, pedestrians. But robots need vision that does more than recognize; they need to know "where is it, where are its boundaries, how far away is it, can I grasp it, will I crash if I walk there?" These are two completely different visual understanding paradigms.

The LingBot team found a critical breakthrough: boundaries. A boundary isn't just an object outline — it simultaneously signals depth discontinuity, occlusion relationships, spatial segmentation, and interactable zones. The rim of a cup determines whether a robotic arm can reach inside; the edges of a doorframe determine whether a robot can pass through; the contour of a tabletop determines whether objects placed on it will fall.

So the team proposed masked boundary modeling — a self-supervised training method specifically designed to make models learn boundaries and geometric structure. Standard masked modeling randomly masks patches of an image and has the model predict them, but random masking can hit low-information-density regions like walls or sky. LingBot-Vision takes a more aggressive approach: a teacher model identifies boundary tokens in the image online, forces these boundary tokens into the mask, and makes the student model learn to reconstruct the hardest, most spatially informative regions.

This is the boundary-forcing mechanism. The model doesn't just learn "what is this" — it learns "where are its boundaries, what's its shape, how does it relate to the surrounding space?"

Four Challenges from Lab to Real World

Robotic vision in real scenarios fears four types of scenes, and LingBot-Depth 2.0 delivers impressive results on all of them.

The first is transparent and reflective materials. This is robotic vision's worst nightmare — glass cups, champagne towers, mirrors, polished metal are visible in RGB, but depth sensors frequently return voids or incorrect distances in these areas. Through geometric priors learned by the LingBot-Vision backbone, LingBot-Depth 2.0 stably preserves geometric relationships among rims, walls, and bodies of cups, letting robotic arms know where to reach without shattering adjacent glassware.

The second is small and distant objects. As a mobile robot moves forward, it can't wait until obstacles are inches away to react — it needs to see distant people, pets, and barriers early. In outdoor scenes, LingBot-Depth 2.0 stably identifies distant tennis balls (objects smaller than a dog), with spatial layers among ground, walls, trees, and animals preserved intact.

The third is complex indoor scenes. Glass doors, curtains, TV stands, balcony clutter at home — combined with constantly changing lighting as the camera moves, traditional models often produce large broken patches at boundaries between glass, bright light, and shadow. The depth maps output by LingBot-Depth 2.0 are more continuous; walls, doorframes, and tabletop edges are more complete.

The fourth is edge deployment. LingBot-Vision's 0.3B distilled student model achieves accuracy comparable to 7B DINOv3 on NYU-Depth v2, with roughly 23x fewer parameters. That means no need to haul around a massive model — it can run on ordinary robot edge computing chips.

On the commercial side, LingBot-Depth 2.0 has been certified by Orbbec's Depth Vision Lab, and the two are collaborating on EGO-RGBD data capture devices, SDKs, and future integrated camera products. Model weights are open-sourced on HuggingFace and ModelScope; code is available on GitHub.

Over the past year, the embodied AI race has primarily focused on "bodies" (motors, joints, motion control) and "brains" (LLM integration, task planning). Ant LingBot's open-source release reminds the industry: visual perception is the first gateway through which robots interact with the physical world. Seeing without seeing accurately means all downstream planning and control is a house of cards. From Nvidia's ASPIRE skill library to LingBot's vision foundation model, embodied AI is moving from "impressive demos" to "actually getting work done."

See you tomorrow.

通用视觉模型学的是'这是什么',机器人需要的是'它在哪、边界在哪、能不能抓'——这是两套完全不同的视觉逻辑。

—— 灵波科技技术团队

General vision models learn 'what is this'; robots need to know 'where is it, where are its edges, can I grab it' — these are two fundamentally different visual paradigms.

— LingBot Tech Team
LingBot-Vision · 蚂蚁灵波 · 具身智能 · 视觉基模 · 空间原生 · 边界建模 · 深度估计 · DINOv3 · 机器人视觉 · 开源
LingBot-Vision · Ant LingBot · embodied AI · vision foundation model · space-native · boundary modeling · depth estimation · DINOv3 · robotic vision · open source
Sources · 信源 Sources

本文基于 Dawn Vision 认知引擎处理的 11 个源信号生成,经编辑部人工审核。素材来源:量子位、新浪财经、科创板日报、GitHub、HuggingFace。

This article was generated by the Dawn Vision cognitive engine processing 11 source signals, with human editorial review. Sources: QbitAI, Sina Finance, Science and Technology Innovation Board Daily, GitHub, HuggingFace.