Appendices

  1. Home
  2. Appendices

Deployment Manual

General Prerequesites: You will need both the code for the Apple Watch, and the .exe file (or the Visual Studio solution) for the Kinect.
Go to our github repository to find these.

Apple Watch App

Prerequisites: A Mac computer running MacOS with Xcode installed [an iPhone with an Apple ID Account and an Apple Watch]. All devices used must be updated to the latest software.

  1. Open the project in Xcode.
  2. If you don't have an Apple Watch, you can run it in the simulator (without having to do any of the following signings): just open the project in Xcode, then at the top left corner of Xcode instead of Generic watchOS device, select a specific simulator WatchOS device. Select your device and click the run button on the top left; the code should install in approximately one minute.Dance Health Tracking app will be ready on the Apple Watch simulator.
  3. If you do have an Apple Watch:
  4. On the top left of Xcode, click on the navigator called ‘DanceHealthTracking’ with the blue blueprint icon on its left.
  5. In the signing & capabilities tab in the top middle part of you screen, click on the ‘automatically manage signing’ and select you ‘Team’ to your Apple ID. In case it is not there automatically, click on ‘add account’ and add your account.
  6. Connect your iPhone device to your mac via a charging cable and leave the iPhone unlocked. On the iPhone it might ask you if you ‘trust this computer’. Please press yes.
  7. On the top left corner of Xcode instead of ‘Generic watchOS device’, you should be able to select you Apple Watch device.
  8. Select your device and click the run button on the top left; the code should install in approximately one minute.
  9. Once this is completed, feel free to disconnect any devices and the Dance Health Tracking app will be ready on your Apple Watch.
  10. At first initialization, it will ask you to grant it certain permissions.
  11. After accepting these permissions, press the start button and start dancing!

Kinect 2 App

Prerequisites: A Kinect 2 (for Windows) with all the appropriate cables to connect to your computer, and a computer with the latest version of Windows installed, and/or the appropriate drivers for the Kinect 2. Maybe: the latest version of Microsoft Visual Studio.

  1. Plug the Kinect into your computer.
  2. Open the .exe file to start your program.
  3. Alternatively, open the solution (.sln) file with Visual Studio and run (under Release x64).
  4. On the pop up window, follow the instruction and enter an appropriate session ID.
  5. To end the Analysis and Video, stand out of the frame for 7 seconds and the program will stop automatically.
  6. The Video recorded will be stored locally with

User Manual

  • Once you've deployed/installed the software, you might want to use it!
  • Start by opening the application on both of your devices.
  • Both will prompt for a session ID
  • The session ID is recommended to follow the convention: start with your first name e.g. "Mike", followed by the number of the seesion you have done today e.g. if it's this is the second session you have done today, enter "2", so the result session ID should be "mike2".
  • The session ID is used for merging the data sent from Kinect and Apple Watch, so please make sure you enter the same ID on both device for each session (this is very important).
  • This convention is used to make sure each session ID is unique on that day, you can also define your own convention.
  • Once you've input the session ID, the Kinect will open a start window with instructions on how to end the session, and a required telemetry and data collection consent message.
  • The Apple Watch will display the metrics that will be measured, and "Start Dancing" button,
  • Start your session by clicking both the "start" button on the Kinect interface, and the "Start Dancing" button on the Apple Watch interface.
  • You can end the session on the Kinect by leaving frame for 7 seconds or more, or pressing the "End Session" button, which you can hide from the resulting video by closing the popup that contains this button.
  • For the Apple Watch, just click "Stop Dancing".
  • You can then view, delete, or manually enter your data on our server, here.
  • The video from the Kinect should also be saved locally on your machine to whichever folder the Kinect application files are placed.

    • Enjoy!
    You can find more details in our Read Me file.

    Bi-weekly Reports

    Report 1

    Report 2

    Report 3

    Report 4

    Report 5

    Report 6

    Report 7


    Gannt Chart

    Gannt Chart


    References:


    Photos

    Home Page:
    Scroll Photo 1 Source: Dancing Show
    Scroll Photo 2 Source: Arthur Murray Sponsor
    Scroll Photo 3 Source: Article about trying Arthur Murray classes
    Algorithms: Swift logo Source: Wikimedia Commons
    C++ logo Source: Wikimedia Commons
    Visual Studio logo Source: Port135
    Apple Watch Source: Pure PNG (Free image)
    Kinect Source: Windows Central
    FHIR logo Source: FHIR website
    JSON logo Source: Spaghetti and Hammers
    Node.js logo Source: Wikimedia Commons
    MongoDB logo Source: Logo Download
    Azure logo Source: Free PNG site
    Evaluation:
    Azure Kinect Source: Microsoft Website
    ARKit 3 Source: Article about ARKit 3
    iPhone 11 Pro Max Source: Article about iPhone 11 Pro Max

    Research Papers, Articles, and Textbooks

    Research and Experiments

    [1] Dance Analysis using Multiple Kinect Sensors by A. Kitsikidis et. al.
    [2] Development of an automated exercise Detection and Evaluation system using the Kinect depth camera. Master Thesis, Twente University, Frodo Muijzer
    [3] Introduction to Labanotation, University of Frankfurt

    Requirements

    [1] Preece, J. , Sharp, H., & Rogers, Y 2015. Interaction Design: Beyond Human-Computer Interaction. 4th ed. West Sussex: Wiley. Chapter 7.4.2

    Testing

    [1] Nielsen Norman group: “Why You Only Need to Test with 5 Users” March 18 2000, Jakob Nielsen

    Evaluation
    [1] Nielsen Norman group: “Why You Only Need to Test with 5 Users” March 18 2000, Jakob Nielsen
    HCI
    [1] Preece, J. , Sharp, H., & Rogers, Y 2015. Interaction Design: Beyond Human-Computer Interaction. 4th ed. West Sussex: Wiley.
    [2] “Personas - Design Thinking Book” February 2 2016 MJV Technology and Innovation

    Other Sources include:
    Don Norman, The Design of Everyday Things
    Greenberg et. al. Y 2017, Sketching User Experience: The Workbook
    Nielsen Norman group: “Usability 101: Introduction to Usability” January 3 2012, Jakob Nielsen
    Nielsen Norman group: “Why You Only Need to Test with 5 Users” March 18 2000, Jakob Nielsen

    Maintenance

    The cost of maintaining this project boils down to 7.26€ per month, to host the Virtual Machine that our server runs on

    Notes:

    In the current version of this project, we only consider one type of user. This may however change in the future.
    You can find a blog-post/creative news article we wrote about our project and its development process, here.
    You can also find our poster, which summarizes our project in a research style layout, here.