Aria MuJoCo Teleoperation
Real-time teleoperation of a MuJoCo-simulated Franka Panda using Meta Aria hand tracking
Overview
Aria MuJoCo Teleoperation is a real-time system that enables control of a MuJoCo-simulated Franka Panda robot using hand tracking from Meta Aria glasses. The system streams hand pose data from the Aria device and uses inverse kinematics to make the robot’s end-effector follow your hand movements in real time.
Highlights
- Real-time hand tracking stream to robot control
- Damped least squares inverse kinematics
- Auto-calibrated finger/gripper control
Tech
- Python, MuJoCo
Repo
- https://github.com/QingyuanYuu/aria_mujoco_teleop