Rumors that Apple is working on augmented reality glasses have been growing for some time, and a patent application published today shows how the same approach might be adapted to both a smartphone screen and smart glasses. It also describes how the two devices might be used in tandem.
This embodiment is particularly useful when using a head-mounted display comprising the camera and the screen. For example, the head-mounted display is a video-see-through head-mounted display (HMD). It is typically not possible for the user to touch the head-mounted screen in a manner like a touchscreen. However, the camera that captures an image of the real environment may also be used to detect image positions of the user’s finger in the image. The image positions of the user’s finger could be equivalent to touching points touched by the user’s finger on the touchscreen …
more…