Keywords: Augmented Reality, Robotics
This page contains showcases of some works in progress where I make use of Hololens 2 for Robotics.
In this video, I use the Unity Robotics Hub’s Pick And Place package for Hololens 2. I had to make the apple ridiculously small to fit Niryo One’s gripper. And I added a small pressable button to publish the joint data of the robot. The apple and the plate are both grabbable and can be moved around. I can’t move the table and the robot itself yet since its base is fixed. I’m using ROS Noetic, running on a Ubuntu 20 virtual machine.
In this video, I control a robot in Hololens 2. This is part of a tutorial by Microsoft’s team at IROS 2020. The code at github wasn’t actually working, so after fixing a few things and submitting a pull request I got it working. I still haven’t figured out the ASA anchors, but here is the intermediary