ZED Plugin for Unity v2.4.0

New Features

Editor

• Introduced new import settings that improves the AR experience. Most notably MSAA x4 and Linear color space are now enabled by default when importing the package.
• Updated camera saturation and contrast settings in ZED_Rig_Stereo prefab to improve stereo pass-through in HTC Vive. This compensates the Vive's display brightness and makes real-world images more realistic.
• The camera can now be reconnected at runtime if disconnected.
• Added runtime configuration of ZEDManager parameters.
• Moved scanned meshes, SVOs, greenscreen configuration files and .area files to /Assets/ folder by default rather than in the root project folder. This makes them accessible in the Project tab of Unity.

Helpers

• Introduced multiple HitTest support functions to simplify collisions between real and virtual objects when no spatial mapping is involved (beta).
• Introduced ZEDPlaneDetectionManager.cs script to detect horizontal and vertical planes in a scene. ZEDPlaneDetectionManager inherits from MonoBehavior and must be used to have access to plane detection in Unity Scene.
• Introduced DetectPlaneAtHit() function to get the plane detected at a user-specified screen position.
• Introduced DetectFloorPlane() function to get the floor plane in the image.
• Introduced ZEDPlaneGameObject.cs to store the plane information such as its position, rotation, boundaries, etc. It also creates a GameObject representation of the plane that supports collisions and rendering.
• Introduced ZEDPlaneRenderer.cs script to display the planes detected in a scene by ZEDPlaneDetectionManager.
• Renamed getDepthAt*() and getDistanceAt*() support functions to getForwardDistanceAt*() and getEuclideanDistanceAt*() for a better understanding.

Bug Fixes

• Fixed bug with normals transformation to world frame that could lead to unstable object placement results.
• Fixed incorrect report of bandwidth issue when using 1080p and 2K resolutions.
• Fixed bug with the depth occlusion option in ZEDManager that could only be changed at runtime and applied to the left eye in stereo mode.
• Fixed the camera stream not properly closing if ZEDManager was disabled or destroyed when stopping a scene. This would result in problems reconnecting to the camera unless the device is unplugged and reconnected.
• Removed the rendering planes of ZED_Rig_Stereo prefab from the scene view when it is not played.
• Fixed bug causing the loading screen to be heavily pixelated in stereo mode.
• Fixed bug that would make error messages flash during camera loading.
• Fixed alerts about missing motion sensor during camera loading.
• Updated broken prefab references in Spatial Mapping sample and prefabs.
• Updated error message when a scene is started without the ZED SDK installed.
• Removed missing SDK window popup when play/pause is pressed. This window now only shows up when Unity is started.
• Fixed broken pause button in ZEDSVOManager.
• Specifying an invalid .area file for spatial memory no longer causes tracking to be disabled. The invalid file is now ignored.
• Fixed directional light on Object Placement scene.

Examples

• Updated lighting, animations and navigation of ZomBunny prefab to make it appear more realistic.
• PlaceOnScreen.cs (Object Placement) now instantiates new objects on click rather than moving the pre-existing object.

Compatibility

• Updated Oculus Package detection ("OVR" is now "Oculus") in ZEDOculusControllerManager.cs.
• Compatible with ZED SDK 2.4.0, CUDA 9.0 or 9.1.

ZED Plugin for Unity v2.3.3

New Features

• Improved Video Async Reprojection (VAR) when using ZED Mini with HTC Vive for stereo pass-through.
• Updated ZEDCamera.cs script to use the ZED Mini inertial sensors to improve reprojection.

Bug Fixes

• Fixed camera FPS value when the camera is disconnected.

Known Issues

• On certain configurations, VRCompositor in SteamVR can freeze when using HTC Vive and ZED. Updating Nvidia drivers to 390.77 can fix the issue. Read more.
• An optimal stereo pass-through experience can be obtained using ZED Mini on Oculus Rift. The greater vertical field of view of HTC Vive can lead some users to report a "box" feeling when using stereo video pass-through.
• When using HTC Vive and ZED Mini for pass-through, make sure to stay in the play space and that different Lighthouse systems do not interfere. Video Async Reprojection uses Lighthouse tracking to reduce rotational latency and tracking losses can create video jumps in the headset.

ZED Plugin for Unity v2.3.2

New Features

• Added Camera FPS, Engine FPS, Tracking Status, HMD and Plugin version in ZED Manager panel. These status will help developes see where the application's bottlenecks are.
  A Camera FPS below 60FPS indicates a USB bandwidth issue. An Engine FPS below 90FPS indicates that rendering is the limiting factor. Both will induce drop frames.
  Note that building and running your application greatly improves performance compared to playing the scene in Unity Editor.

• Added automatic detection of OVR package to avoid having to manually define "ZED_OCULUS" in project settings when using ZEDOculusControllerManager.

• Added compression settings (RAW, LOSSLESS, LOSSY) in ZEDSVOManager.cs script.

• Updated ZEDCamera.cs script to include setIMUPrior(sl::Transform) function used for video pass-through.

Bug Fixes

• Fixed initial camera position when using ZED Mini and an HMD. This had an impact on virtual objects created with physical gravity up and spatial mapping mesh origin.
• Fixed ZED Manager instance creation to respect MonoBehavior implementation. Only one ZED manager instance is available at a time for an application.
• Fixed enable/disable depth occlusions settings in Deferred rendering mode.
• Fixed resize of halo effect in the Planetarium example.
• Fixed garbage matte behavior in GreenScreen example that displayed anchor spheres in the scene after loading a matte.
• Fixed Loading message when ZED tries to open.
• Remove BallLauncher message instruction, as it was not used.

ZED Plugin for Unity v2.3.1

Minor Fixes and Updates

• Added plugin version in ZEDCamera.cs.
• Fixed GreenScreen prefab in Canvas.
• Fixed default spatial memory path when enableTracking is true. Could throw an exception when tracking was activated in green screen prefab.
• Fixed missing but unused script in Planetarium prefab.

ZED Plugin for Unity v2.3

Plugin

• Added support for ZED Mini.
• Introduced stereo passthrough feature for mixed-reality applications in VR headsets.
• Added support for Unity 2017.3.

Prefabs

• Added ZED_Rig_Stereo prefab, with stereo capture and passthrough rendering in VR headsets (beta version).
• Renamed ZED_Rig_Left into ZED_Rig_Mono, for better monoscopic/stereoscopic prefab distinction.

Scripts

• Updated ZED Manager with new settings to control real-world brightness and enable/disable AR occlusions using depth.
• Added ZEDSupportFunctions.cs to help users retrieve depth and normals at screen or world position. Some of these functions are used in the Object Placement sample.
• Added ZEDMixedRealityPlugin.cs to handle stereo passthrough in Oculus Rift and HTC Vive Headset.
• Renamed ZEDTextureOverlay.cs into ZEDRenderingPlane.cs.
• Fixed bugs.

Examples

• Added Planetarium scene to demonstrate how to create a solar system in mixed-reality. This is a simplified version of the ZED World app built with Unreal Engine.
• Added Object Placement scene to demonstrate how to place an object in the real world without using Spatial Mapping.
• Added Dark Room scene to demonstrate how to decrease the brightness of the real world using the Camera Brightness settings in ZEDManager.cs.

ZED Plugin for Unity v2.2

• Refactored plugin organization and architecture.
• Added Spatial Mapping module to allow physical interactions between the virtual and real-world.
• Improved chroma key in Green Screen sample. Matte edges are now much cleaner and sharper.
• Improved PBS lighting in forward rendering mode.
• Added AR post-processing shaders to enable realistic integration of virtual objects in video.
• Added OpenGL support.
• Added camera loading screen with error reporting.
• Added callbacks reporting the camera status.
• Fixed SVO reading speed when playing back recorded videos in Unity.
• Fixed multithreading issue leading to crashes on computers with low resources.

ZED Plugin for Unity v2.1

• Plugin now supports Unity 5.6 and 2017 Beta.
• Added Vive tracker support.
• Added Oculus Rift and Oculus Touch support in Green Screen MR sample (through SteamVR only).
• Added Lighting script to allow for light interactions between the real and virtual world in Mixed-reality and Green Screen samples.
• Added Garbage Matte script to extend the virtual world beyond green screen boundaries in the Green Screen MR sample.
• Added a semi-automated Calibration application to help users align the real and virtual world in the Green Screen MR sample.

ZED Plugin for Unity v2.0

• Refactored plugin to ensure compatibility with ZED SDK 2.0 and Unity 5.5.
• Improved overall stability and performance.
• Added Positional Tracking for VR sample.
• Added Green Screen VR Capture sample.
• Added Simple Mixed Reality sample.