3. Function

3.1 Mixed Reality Capture

Mixed Reality Capture (MRC) lets you record and share VR content. Step directly into a virtual scene, take the place of an avatar and interact seamlessly with the VR world around you.

The principles of MRC

3.1.1 Function Introduction

QIYU MRC Prefab provides the following functions in the inspector:

• Only Back: Record the rear view only. If you do not need the front camera, you can check it. The default setting is unchecked.
• FrontLayerMask: Select the layers of foreground camera rendering. "Everything" is the default setting, which means rendering all the objects.
• BackLayerMask: Select the layers of background camera rendering. "Everything" is the default setting, which means rendering all the objects.

3.1.2 How to Use

1. Enable MRC: Drag the QiyuMRC prefab as the child object of Camera Offset in each XR Rig (only drag once if there is one XR Rig in the project), and please set the same level with the Main Camera.

2. Build, install and launch the APP on QIYU devices.

3.1.3 Preview

1. Preparation

1. A QIYU VR headset

   a. The OS version is v5.1.41 or above.

   b. Install the MRC APP on the QIYU device. (MRCLocater-release.apk, please click here (opens new window) to download.)

   c. Install a game that has integrated the Tools SDK and supports recording MR (Mixed Reality) videos.

2. A smartphone (It's better if the phone is set with a tripod)

   a. Apple phone: for iOS 11 and above, please search for "奇遇VR" in the AppStore, download and install it.

   b. Android phone: click here (opens new window) to download and install "奇遇VR" App.

3. Please make sure that the QIYU device and mobile phone are connected to the same WiFi. Go to "我的” page click “混合现实录制” to start recording.

2. Calibration

1. Set the mobile phone on the tripod and make sure it keeps vertical. Please do not move the phone during the calibrating.
2. Keep the right controller within the headset's frontal cameras' tracking range, then put the controller's tracking ring upright and press it against your smartphone's rear camera(s). Once done, tap the A button on the controller to calibrate the smartphone's position.

3. Face towards the rear side of your smartphone and move backward for about 1.5 meters, then you can see a red layer in the headset. After that, adjust the controllers' position and put their tracking rings upright in the layer. Once done, press the A button on the right controller to confirm.

4. Set the position of virtual controllers on the phone same as the position of real controllers to finish the calibration.

3. Recording

1. Press the start button for recording on the QIYU device, and then it will back to the Home automatically, pressing the Quit button, and start the MRC game.
2. Pressing the start button on the mobile phone to record the MRC video, press the stop button to complete the recording, and save the video file.

3.1.4 Known Issues

1. Compositor Layers are not supported.
2. Vulkan is not supported
3. 3Dof is not supported
4. When the application is paused (pressing the Home button or over the boundary), the view of the phone will be stopped at the last frame.
5. MRC cannot be used with the casting or recording function at the same time.
6. The frame will be dropped by about 15 to 20 frames during using the MRC function.