HandCapturAR

Introduction

This repository contains a Unity3D project which allows capturing, replay, and saving of hand tracking data on the HoloLens 2. It is based on the MRTK3 and uses the built-in QR-Code tracking to spatially reference the hand tracking data. Tracking data is saved in .json format.

Usage

• Initialization: Press "Start" to begin the application workflow. You will be prompted to scan an arbitrary QR-Code. Use a QR-Code which is at least 5cm in width and height. Wait for the QR-Code to be tracked stably, indicated by a green outline
• Start capturing: Press the "Capture" button on the main panel or simply say "start". If an existing recording exists (which has not been saved yet), you will be prompted to save the data or confirm recapture which will overwrite your unsaved data
• Stop capturing: Say "stop". If the recording is not stopped manually, it will terminate after x-seconds (currently set to 5).
• Save data: Press the "Save" button. You will be prompted to enter a filename. If this name already exists, the filename will be altered to be unique. Data is saved in the local application folder
• Access data: Connect your HoloLens 2 to your PC via USB and access local storage in your file explorer. Alternatively, connect your HoloLens 2 and PC to the same network and access the local app storage via the Windows Device Portal
• Replay data: Press the "Replay" button to start playing the captured hand tracking. Press the "Pause" button to pause the replay
• Change language: Say "English" or "Deutsch" to switch between languages

Installation

1. Clone this repository (or download and unpack .zip)
2. Add project to UnityHub and set specified Unity version (used: 6000.03.23f1) and UWP as target platform
3. Open project. This will take some time as necessary packages will be installed automatically

Build

1. Open project build settings (File -> Build Settings)
2. Switch platform to Universal Windows if not already selected
3. Set Architecture to ARM 64-bit
4. Set Build and Run to Local Machine or Remote Device depending on your preference
5. Set Build Configuration to Master
6. Build (and run) project on HoloLens 2

License

This project is licensed under the MIT License. See LICENSE.md for further details.