In 2017 Apple acquired a German company by the name of SensoMotoric Instruments (SMI) who was a leader in eye tracking technology. In 2016, SMI had already created glasses that used eye tracking. While the technology seemed a bit science fiction at the time, it s now one of the key technologies behind Apple s coming Vision Pro Spatial Computing headset.
Today the US Patent & Trademark Office published a patent application from Apple that relates to a method for providing information about a user behavior of a user with regard to at least one reference object, especially a virtual reference object, via a network from smartglasses or MR HMD to a second device such as a Mac or iPhone/iPad. The invention also covers a system for providing information about a user s behavior in a particular virtual scene. The invention applies to Mixed Reality Environments that could be used in gaming, flight simulation training and much more.