Team 35: In-Air Multitouch with Multiviews

Multitouch with Multiview is using MotionInput3 to enable users to navigate touchlessly between multiple displays. Alternate displays to connect with will also include Holographic See-Through Glass Display projections – developing a range of examples for user experiences of holographic touchless interfaces.

Project description

The previous version of the MotionInput software presented a challenge for users due to its implementation of multiple gestures to switch displays and cameras. Such a feature proved unnatural and hindered the navigation flow of the program. In response, we aimed to make the program more user-friendly by implementing a new approach that would allow for seamless navigation between displays.

The proposed solution involved modifying the program to enable users to change displays by simply moving their hand to the desired monitor. This was accomplished by calculating the angle of the user's hand in relation to the camera, and when it exceeded a certain threshold, the software would begin sampling the cameras to determine which camera provided the clearest view of the user's hand. The software would then automatically switch to the best camera and the corresponding display.

We are pleased to report that we successfully implemented this new feature, allowing users to navigate up to four displays easily. Additionally, users can now drag objects and windows between screens, further enhancing the software's versatility. These new capabilities can be applied in various scenarios, from organising workspaces and sketching to real-time surgical guidance.