Sim-on-Wheels

Let autonomous vehicles wear “AR glasses” while operating in the real world

Co-authored a novel research work, Sim-on-Wheels, that implements a new way to evaluate autonomous vehicles in safety-critical scenarios using an augmented reality approach. Led the integration of multiple software modules to run our system in realtime at ~10fps on a real-world autonomy platform. Presented at the 2025 IEEE International Conference for Robotics and Automation(ICRA) in Yokohama, Japan in both oral and poster formats to large audiences. Checkout this work on our project page for more info.

The left shows a third person view, the middle shows the Sim-on-wheels simulation and a bird’s eye view animation for the car and obstacles, and the right shows the driver's in-cabin view.