VR & AR

Holo Lens With Open CV For Unity Example

HoloLens With OpenCVForUnity Example

What’s new

  • Performance of ArUco example improved.
  • By using the “HoloLensCameraStream” asset, video capture can now be executed faster.

Demo Video (old version)

Demo Hololens App

Environment

Setup

  1. Download the latest release unitypackage. HoloLensWithOpenCVForUnityExample.unitypackage
  2. Create a new project. (HoloLensWithOpenCVForUnityExample)
  3. Import the HoloToolkit-Unity-2017.4.0.0.unitypackage.
    • Setup the HoloToolKit. (Mixed Reality ToolKit > Configure > Apply Mixed Reality Project Setting)
  4. Import the OpenCVForUnity.
    • Setup the OpenCVForUnity. (Tools > OpenCV for Unity > Set Plugin Import Settings)
    • Move the “OpenCVForUnity/StreamingAssets/haarcascade_frontalface_alt.xml” and “OpenCVForUnity/StreamingAssets/lbpcascade_frontalface.xml” to the “Assets/StreamingAssets/” folder.
  5. Clone HoloLensCameraStream repository.
    • Copy the “HoloLensCameraStream/HoloLensVideoCaptureExample/Assets/CamStream/” folder to the “Assets/” folder.
  6. Import the HoloLensWithOpenCVForUnityExample.unitypackage.
  7. Add the “Assets/HoloLensWithOpenCVForUnityExample/*.unity” files to the “Scenes In Build” list in the “Build Settings” window.
  8. Set “.NET” to “Other Settings > Configuration > Scripting Backend” selector in the “Player Settings” window. (HoloLensCameraStream doesn’t support IL2CPP backend)
  9. Add “WebCam” to “Publishing Settings > Capabilities” checklist in the “Player Settings” window.
  10. Build and Deploy to HoloLens. (See https://developer.microsoft.com/en-us/windows/holographic/holograms_100)
    • (Print the AR marker “ArUcoMarker_DICT_6X6_250_ID1.pdf” on an A4 size paper)
Assets Buld Settings
buildsetting01.jpg buildsetting02.jpg

ScreenShot (old version)

screenshot01.jpg

screenshot02.jpg

screenshot03.jpg

screenshot04.jpg

screenshot05.jpg

Light_Frame.png