Algorithms
Our primary and most important task is to easily switch between multiple displays. For this, we have to be able to determine the following:
- When the user wishes to switch to a different display
- Which display to switch to
- How to seamlessly switch between displays without interrupting the user experience
To achieve this, we will implement a gesture recognition algorithm to detect when users intend to switch displays based on their hand movements. We have a few approaches that we plan to test: using the distance between fingers or finding the angle of the hand to the camera. The last option could be more scalable to work with more than two displays. But it will require us to find a way to represent a hand in a form that can be used to find the angle. You can find more information about this algorithm in the dedicated post in the Development section.
We will also develop an algorithm that associates specific hand movements with specific displays, enabling us to quickly and accurately switch between displays. We can set a threshold for the value found using one of the methods, so when the user exceeds the value, we know it’s time to switch to a different display.
Overall, our goal is to create a robust and scalable solution for switching between displays using hand gestures that provides a seamless and intuitive user experience.
Finally, we will optimise the performance of our algorithm to ensure that switching between displays occurs seamlessly and without any noticeable lag or interruption to the user experience.