Dance Health Phase 1: with Wearables and 3D Cameras
About our Project - Abstract
Problem Statement
The students at Arthur Murray Dance Centers wanted to improve their fitness through dance. However, there is currently no software on the market specifically designed to do so.
Solution
Our solution was to create software for the Kinect 2 Camera and the Apple Watch using the depth camera and skeletal tracking as well as Apple HealthKit data to evaluate health metrics.
This technology aims to help students at Arthur Murray follow a health journey and track their improvements throughout the course of their lessons. It allows them to gain the best experience possible and quantify the health benefits they are receiving.
Achievement and Impact
We have achieved to create such a software. We have used the Apple Watch to track the number of spins, distance travelled, min/average/max heart rate and numbe rof calories burrned. With the Kinect, we track the maximum heiight of differernt limbs and average distance moved by certain joints along with being able to display the user dancing with skeletals overlaid.
We have then combined these health statistics on a single integrated dashboard.
Key Features
Some of our key features include:
- Tracking of health statistics with the Apple Watch
- Tracking of health statistics with the Kinect
- Displaying a skeletal over the user in the video
- We have an integrated dashboard showing the aggregated data
Our Team
Jan Kolarik
Team Leader and iOS Developer
Jan is our amazing team leader. He has been working tirelessly on the AppleWatch integration, and it was his idea to use the integrated gyroscope and accelerometer on the Watch to pull more accurate health data.
Yide Fan
Kinect Developer
Our wonderful team-member Yide has been developing skeletal tracking for the Kinect and a function to get the coordinates of joints to extrapolate posture data and compare it to a healthy standard.
Nathalie Alexandra "Alex" Tcherdakoff
Kinect Developer
Our lovely team-member Alex has also been working on the Kinect integration, especially in getting the video to display and save with skeletals overlaid, and working on the calibration.