Microsoft Kinect One / Kinect for Windows 2

The body tracking of the Microsoft Kinect One or 2 has been improved compared to the Xbox 360/Kinect. Although the functionality is largely the same, you will get better results with the new Kinect.

Kinect can be combined with Oculus Rift to get full body tracking.
Important Note: the combination of Kinect with HTC Vive is supported but will lead to major tracking issues for the HTC Vive because the IR beam from the Kinect will interfere with the IR signals coming from the lighthouses.

Prerequisites

InstantVR

Microsoft Kinect 2 is supported in InstantVR Advanced and Edge version 3.0 and higher.

Humanoid Control

Microsoft Kinect 2 is supported in the Humanoid Control VR+ and Pro packages. It can also be obtained as a separate extension for Humanoid Control VR.

Hardware

Microsoft Kinect for Windows 2 and Microsoft Kinect One using the applicable adapter are supported.

Operating System

Microsoft Kinect 2 requires Microsoft Windows 10 or higher.

SDK

The Kinect for Windows SDK v2 is required for the Microsoft Kinect 2 support. It can be downloaded from the Microsoft Download Center.

Setup

InstantVR

Microsoft Kinect support needs to be enabled in Edit Menu->Preferences->InstantVR->Kinect Support.

The script IVR_Kinect2 should be added to the character’s GameObject. Make sure this script is listed higher than any IVR_Traditional or IVR_Animator script.

Humanoid Control

Microsoft Kinect support needs to be enabled in Edit Menu->Preferences->Humanoid->Kinect Support.

Disabling Kinect Support ensures that no code related to Kinect is included in the build.

Targets

To enable tracking for an avatar with Kinect, Microsoft Kinect 2 needs to be enabled in the Humanoid Control component.

The Microsoft Kinect 2 (Transform) is a reference to the Transform in the scene representing the Kinect Sensor. This GameObject is found as a child of the Real World GameObject and is only visible in the scene when Humanoid Control->Settings->Show Real Objects has been enabled.

The Microsoft Kinect 2 (Transform) can be used to changethe position of the tracking relative to the player in the scene.

When the Kinect 2 is used in combination with the Oculus Rift  in a higher position, the position of the Microsoft Kinect 2 (Transform) is automatically determined.

Head Target

Head tracking, face tracking and audio input can be enabled separately on the head target. Face Tracking is only available in Humanoid Control Pro, which supports Face Tracking.

Two options are available for rotational head tracking:

  • XY: which only rotates the head around the X and Y axis and therefore keeps the horizon horizontal
  • XYZ: full three degrees of freedom tracking.

In both options, full positional tracking of the head within the range of the camera is supported.

Hand Targets

Positional and limited rotation tracking is supported. Due to the limitation of the Kinect, only the X and Y rotation axis are supported.

Hand movement input is limited to closing, opening the hand and the ‘ lasso’ position: index and middle finger pointing, all other fingers closed.

Hip Target

Only positional tracking is supported.

Foot Targets

Only positional tracking is possible.