Skip to content
This repository has been archived by the owner on Sep 13, 2023. It is now read-only.

This tutorial covers training an object detector with the IceVision library and implementing it in a Unity game engine project using the OpenVINO Toolkit.

License

Notifications You must be signed in to change notification settings

cj-mills/icevision-openvino-unity-tutorial

Repository files navigation

IceVision → OpenVINO → Unity Tutorial

⚠️ ARCHIVED REPOSITORY ⚠️

This tutorial code will no longer receive updates as the IceVision library no longer appears in development. For the latest and improved version of this tutorial that uses PyTorch directly, please visit the new tutorial repositories linked below:


Tutorial Links

  • Part 1: Train a YOLOX model using IceVision and export it to OpenVINO.
  • Part 2: Create a dynamic link library (DLL) file in Visual Studio to perform object detection with a YOLOX model using OpenVINO.
  • Part 3: Perform object detection in a Unity project with OpenVINO.
  • Follow up: Use ONNX Runtime and DirectML instead of OpenVINO.

Demo Video

HaGRID_demo.mp4

Training Code

Jupyter Notebook Colab         Kaggle        
GitHub Repository Open In Colab Kaggle

Note: Training on the free GPU tier for Google Colab takes approximately 11 minutes per epoch, while training on the free GPU tier for Kaggle Notebooks takes around 15 minutes per epoch.

Kaggle Datasets

Reference Images


Class Image
call call
dislike dislike
fist  fist
four four
like  like
mute  mute
ok  ok
one  one
palm  palm
peace peace
peace_inverted peace_inverted
rock rock
stop stop
stop_inverted stop_inverted
three three
three2 three2
two_up  two_up
two_up_inverted two_up_inverted

About

This tutorial covers training an object detector with the IceVision library and implementing it in a Unity game engine project using the OpenVINO Toolkit.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published