Expect to see more mixed reality apps in the future, at least for Oculus Quest 2. WinFuture notes that Oculus has unveiled a set of tools, the Passthrough API Experimental, which will make it relatively easy to “seamlessly” merge VR with the real-world image from Quest 2’s cameras.
You can project images on flat surfaces, create composite layers floating in space, and even apply visual styles (similar to social media filters) to real-world scenes. For example, you can give yourself a virtual screen that you can use with your keyboard, or turn your home into a psychedelic dream landscape by turning on a virtual switch.
Privacy should not be an issue, Oculus argued. The API only processes raw camera footage on the device, and apps cannot access, store or view photos of the world around you. A junk app should not transmit video of your home, to put it another way.
Oculus expects to deliver the framework to Unity engine developers with its next software development kit release. It will take a while before ready-made apps appear, but do not be surprised if mixed reality games and productivity tools become relatively common as a result of Oculus̵
All products recommended by Engadget are selected by our editorial staff, regardless of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we can earn an affiliate commission.