vr-space-station

Assignment for RMIT Mixed Reality in 2020

8.2 KiB

Raw Blame History

Daydream SDK for VRTK

Jonathan Linowes (@linojon)

The Daydream SDK for VRTK integrates the Daydream platform with VRTK. It can use Unity's built-in VR supported Camera with Daydream support.

Daydream controllers are signficantly limited compared with positionally tracked hand controllers like HTC Vive Lighthouse and Oculus Rift Touch. The Daydream controller hardware provides 3 DOF (x y z axis rotation) and accellerometer. However, some (limited) 3-space positioning can be simulated. The Google VR (Gvr) SDK provides an Arm Model that simulates transforms for shoulder, elbow, wrist and pointer joints. Your application can still use these with VRTK, just supply an object with the GvrArmModelOffsets component to the VRTK_LinkedObjects, VRTK_SimplerPointer or other appropriate component.

Further, this VRTK Daydream SDK provides a DaydreamReach component to facilitate reaching out to touch and grab. It uses the touchpad to push the controller position out in front of user along the current orientation plane or pointer axis.

Pre-requisites

For first time users, see the Unity docs Getting started with Android development and Google documentation Get Started Guides for Android Daydream. In particular,

Use a version of Unity that natively support Google VR with Daydream (as of Jan 30, 2017, 5.4.2f2-GVR13 Daydream technical preview. Note Unity 5.6.0b4 build is not stable with thie SDK). Install with "Android Build Support"
If this is your first time developing Android applications in Unity, follow Unity's Android SDK setup
Download the Google VR SDK for Unity
You'll need Daydream hardware to run your app, including a Daydream-ready phone and Daydream headset (Note, I use a Nexus 6P running Nougat, although not offically Daydream ready, it does work with some complaining)
A second Android phone with the Controller Emulator

Setup

Instructions for setting up your Unity project for Daydream with VRTK. Uses the integrated support for Google Daydream VR camera object.

Open a new or existing project in Unity (5.4.2f2-GVR13 or other version with Daydream integration)
Import asset package GoogleVRForUnity you downloaded from Google
Build Settings:
- Target platform: Android
Player settings:
- Virtual Reality Supported > Daydream
- API Level: Nougat
- Bundle Identifier and other settings you'd use to run on Android
In Hierarchy, create empty, named "DaydreamCameraRig"
- Move or create a Camera as child of DaydreamCameraRig, reset its transform (position 0,0,0)
- Add GvrControllerPointer prefab from Assets/GoogleVR/Prefabs/UI
- Add GvrControllerMain prefab from Assets/GoogleVR/Prefabs/Controller/
- Add GvrViewerMain prefab (enables view in editor play mode)
Disable Daydream's native pointer tools
- To the Camera object, disable or remove GvrPointerPhysicsRaycaster component, if present
- To the GvrControllerPointer/Laser, disable or delete

Setup VRTK Components

In Hierarchy, create an Empty named "[VRTK]"
Add component VRTK_SDKManager
Add a child Empty named "RightController"
Note, Daydream supports only one controller, LeftController will not be used. If present, can be disabled or deleted.
SDK Selection
- In Inspector, choose Quick Select SDK: Daydream
- that should populate the four SDKs,
- In Player Settings, ensure Scripting Define Symbols: VRTK_SDK_DAYDREAM
Linked Objects:
- Click "Auto Populate Linked Objects", that should set:
- Actual Boundaries: DaydreamCameraRig
- Actual Headset: DaydreamCameraRig/Camera
- Actual Left Controller: empty
- Actual Right Controller: DaydreamCameraRig/GvrControllerPointer/Controller
Controler Aliases:
- Model Alias Left Controller: empty
- Model Alias Right Controller: DaydreamCameraRig/GvrControllerPoints/Controller
- Script Alias Left Controller: empty
- Script Alias Right Controller: [VRTK]/RightController

Tips

Note, we're using the name "RightController" to follow VRTK convention. However, it's a Daydream device setting whether the controller is rendered as held in the player's right or left hand. But normally players will have just one controller.
I recommend enabling Use Accelerometer in GrvControllerMain for more natural hand tracking.
You can change the Controller's GvrArmModelOffsets Joint to Elbow for more exaggerated (amplified) motions
Optionally, in Hierarchy add the following prefabs,
- GvrFPSCanvas (to see the frames per second rate)
- DemoInputManager (to see the controller connection status)

VRTK Controller Components

Depending on which components you're using on the [VRTK]/RightController, you might want to make the following adjustments.

VRTK_ControllerEvents: suggested Action Alias Buttons:
- Pointer Toggle Button: Touchpad_Touch
- Pointer Set Button: Touchpad_Touch
- Grab Toggle Button: Touchpad_Press
- Use Toggle Button: Touchpad_Press
- UI Click Button: Touchpad_Press
- Menu Toggle Button: Button_One_Press
VRTK_SimplePointer:
- PointOriginTransform: drag in the GvrControllerPointer/Laser object, which has the Point joint (instead of Controller which has the Wrist joint) or other object using Pointer joint
- (Note: Pointer Tilt Angle is set in GvrControllerMain's GvrArmModel component)

VRTK Event Support

The following shows the events supported directly by the VRTK Daydream SDK. Other events, such as Trigger_Press, if needed should be set in the controller Action Alias Buttons.

Supported

Touchpad_Touch
Touchpad_Press
Button_One_Press

Ignored

Trigger_Hairline
Trigger_Touch
Trigger_Press
Trigger_Click
Grip_Hairline
Grip_Touch
Grip_Press
Grip_Click
Button_One_Touch
Button_Two_Touch
Button_One_Press
Start_Menu_Press

VRTK SDK Support

The following shows the API methods supported directly by the VRTK Daydream SDK.