How many of you have tried to use the Kinect sensor to maneuver around your Xbox One home screen and found it to be a bit frustrating? It can be difficult to select and activate objects in a graphical user interface (GUI) using a natural user input, such as the Kinect. According to Microsoft, users tend to naturally be inclined to perform a pressing gesture to select and activate an object on-screen. Sometimes this will cause the wrong object to be selected and pressed. Microsoft, which we discovered in a patent filing today, wants to improve this.
Microsoft suggests that the Kinect sensor be utilized to model the user via the Kinect’s depth camera. Once this process is complete, the cursor on the GUI will move based on the position of a joint of the virtual skeleton created by the Kinect sensor. In other words, the user’s physical movements can be interpreted as controls and can be used to operate a cursor. The user can also select and activate information presented in a pressable user interface.
“A cursor in a user interface is moved based on the position of a joint of the virtual skeleton. The user interface includes an object pressable in a pressing mode but not in a targeting mode. If a cursor position engages the object, and all immediately-previous cursor positions within a mode-testing period are located within a timing boundary centered around the cursor position, operation transitions to the pressing mode. If a cursor position engages the object but one or more immediately-previous cursor positions within the mode-testing period are located outside of the timing boundary, operation continues in the targeting mode,” the patent application explains.
The pressing gesture may get the job done, especially on the Xbox One with a Kinect, but it isn’t always accurate and can sometimes be frustrating. We’ve embedded a video below showcasing how gesture controls are used on the Xbox One using the Kinect. Hopefully Microsoft follows through with this idea, which will allow Xbox One owners the ability to better control an on-screen cursor using the Kinect sensor.
