Register now After registration you will be able to apply for this opportunity online.
This opportunity is not published. No applications will be accepted.
Floating Hands
The idea of the "Floating Hands" project is to allow one to create holographic tutorials easily. The application then provides holographic instructions for users of the HoloLens performing a specific task. This could be thought of as the HoloLens version of YouTube How-To videos.
Keywords: Computer Vision, 3D Scene Understanding, Action Understanding, HoloLens
Microsoft Dynamics 365 Guides can help to reduce errors, standardize skills, close knowledge gaps, and improve both training and ongoing process with on-the-job guidance. However, to create such a guidance, an expert should create step-by-step instructions, which can be time consuming. In this project, the goal is to ease this step, by capturing the expert while performing the task using HoloLens. We then augment the hands of the expert carrying out the task on instructional tutorials on HoloLens in the form of 3D holographic videos. This can be further combined with:
- Object Segmentation
- Object 6D Pose Estimation
- Object Classification/Fine-grained Object classification
- Action Understanding (to move automatically to the next step in the process once an action is correctly completed)
**Qualifications**
- Experience in Python or C++/C#
- Interest in Mixed Reality
- Interest in Machin Learning and Computer Vision
- Experience in Unity is a plus.
Microsoft Dynamics 365 Guides can help to reduce errors, standardize skills, close knowledge gaps, and improve both training and ongoing process with on-the-job guidance. However, to create such a guidance, an expert should create step-by-step instructions, which can be time consuming. In this project, the goal is to ease this step, by capturing the expert while performing the task using HoloLens. We then augment the hands of the expert carrying out the task on instructional tutorials on HoloLens in the form of 3D holographic videos. This can be further combined with: