Interacting with Distant Objects in XR

⊲ UploadVR ⊳ Researchers from Google and the University of Minnesota have proposed a new concept called “proxies” to improve how we interact with physical objects using mixed reality headsets. Their system, Reality Proxy, combines headset cameras with AI to create small-scale digital versions of real-world items, allowing users to select and interact with them easily, even if they are out of reach. This could simplify tasks like grabbing a book from a shelf or managing drones in a virtual space. The approach aims to enhance user interaction by making it more intuitive and precise.
⊲ Image – UploadVR ⊳