Humyn Labs 正在将人类体验转化为机器人训练数据,解决机器人无法像 LLM 那样从互联网直接抓取数据的问题。其数据样本将人类活动与 IMU、立体深度、6-DoF 头部姿态、21 点手部关键点、手腕追踪、物体追踪和密集动作标签等信号配对,部分采集还同步头部摄像头、双腕摄像头和独立 IMU 流。
LLMs got the internet. Robots have to build their own internet.
That is the data problem Humyn Labs is going after.
@humynlabs is turning human experience into synchronized training data that robotics cannot readily scrape from the web.
A useful robotics dataset cannot just be hours of first-person video.
Humyn's samples pair human activity with signals such as IMU (inertial measurement unit), stereo depth, 6-DoF head pose, 21-point hand keypoints, wrist tracking, object tracking and dense action labels.
Some captures even synchronize a head camera with both wrist cameras and separate IMU streams.
So Humyn is trying to preserve enough structure around those human-demonstrations to make them useful: egocentric video, inertial measurements, hand and head pose, object trajectories, depth, narration and synchronized multi-camera views.
来源:@rohanpaul_ai · x.com