中文 | English
EgoExplorer 采集与处理指南:从硬件、佩戴、主机设置、采集和标定,到原始数据 → SMPL-X → 30 Hz 统一导出 → 三联校验 → LeRobot v3.0。内容依据实际使用的代码和参数整理,整条处理管线在一台机器上就能完成。
代码:InternRobotics/egoexplorer-toolkit · 网页版:https://internrobotics.github.io/EgoExplorer-Guidelines/
佩戴 5 个 VIVE Ultimate Tracker + 手套(MANUS 或 Wuji)+ GoPro HERO13(头部,与头部 tracker 刚性相连)
标定 每次佩戴录一段 01–17 标定动作 → calibrate-subject → subject_profile.json
采集 每条录制 5 个文件:mp4 / video.npz / npz / tracker.npz / session.json
处理 左右检查与修正 → 投影 → 手部融合 → 30 Hz 导出 → 三联校验页与总览页(scripts/run_pipeline.sh all)
发布 LeRobot v3.0:30 Hz,四元数 xyzw,+Y 向上(scripts/build_lerobot_dataset.py)
A guide to capturing and processing EgoExplorer data: hardware, wearing, host setup, capture and calibration, then raw data → SMPL-X → unified 30 Hz export → three-pane review → LeRobot v3.0. Everything follows the code and parameters we actually use, and the whole processing pipeline runs on one machine. Code: InternRobotics/egoexplorer-toolkit. Use the table above or the navigation bar.
Wear 5 VIVE Ultimate Trackers + gloves (MANUS or Wuji) + GoPro HERO13 (on the head, rigid to the head tracker)
Calibrate per donning: record the 01–17 protocol → calibrate-subject → subject_profile.json
Capture 5 files per recording: mp4 / video.npz / npz / tracker.npz / session.json
Process L/R checks and fixes → projection → hand fusion → 30 Hz export → review pages and gallery (scripts/run_pipeline.sh all)
Release LeRobot v3.0: 30 Hz, xyzw quaternions, +Y up (scripts/build_lerobot_dataset.py)