Evaluation

MoSCoW

MI34 Speech Customization Setup

Functional Requirements

Priority Requirement Descriptiontick
Must Have Compliance with MotionInput Config Format The output must adhere strictly to the JSON format required by the MotionInput configuration files.
Must Have Automatic Game Detection Automatically detect the game being played, if possible, to suggest controls.
Must Have Synonym Mapping The system must recognize and map synonyms to the correct existing command within the game's vocabulary.
Must Have In-Game Key Mapping The system must map in-game actions to the correct existing key press within the game's controls setting.
Must Have Content Filtering It must filter out words irrelevant to the game's control scheme.
Must Have Offline Processing Enable users to use this regardless of internet connection.

Non-Functional Requirements

Priority Requirement Descriptiontick
Must Have Modular Design for Easy Updates The system should be designed modularly to easily incorporate updates or changes to games or controls.
Must Have Support for New Game Genres Ensure compatibility across a broad range of game genres, not limiting to specific types.
Must Have High Accuracy Recognition It must accurately differentiate between body parts and actions specified by the user.

Web App Portal Generator

Functional Requirements

Priority Requirement Description tick
Must Have Small File Size (Not including Images/Video) Ensure that generated websites have small file sizes to integrate on main hosted web pages, UCL domain (Not including images)
Must Have Generate a Website The details provided by the user will be displayed on the new website file, ready for execution when accessed by the user. The user-generated content will be automatically integrated into various components, ranging from basic elements like text boxes to more complex structures like React carousels, without the need for manual coding or imports.
Must Have Mobile Responsiveness Ensure that generated websites are optimised for mobile devices to provide a seamless user experience across various screen sizes.
Must Have Feedback Form Include a feedback form feature for users to provide comments and suggestions, facilitating continuous improvement and user engagement.
Must Have Browser Compatibility Generated web pages should be compatible with various browsers such as Firefox , Google Chrome and Safari.

Non-Functional Requirements

Priority Requirement Descriptiontick
Must Have Consistency in Design Elements All MotionInput Games should be consistent in design elements across all pages and components of the generated web apps.
Must Have Simple UI for generator The UI is simple and clear so that users should be able to use the website generator without the need for extensive documentation.
Must Have Manual Page Provide a manual or user guide page on generated web pages to assist users in navigating and using the platform effectively.
Must Have Feedback Form Include a feedback form feature for users to provide feedback on the platform's usability and functionality.

MoSCoW Completion

MoSCoW Web Portal Generator MI34 Speech Customization
Must Have 100% 100%
Should Have 100% 100%
Could Have 100% 100%

Individual Contributions

Work Packages Scooter Jia Yi Jan
Project Partners Liaison 90% 5 % 5 %
Requirement analysis 50% 25% 25%
Research 70% 20% 10%
HCI 30% 50% 20%
Website Template Design (Part 1) 75% 20% 5%
Website Template Coding (Part 1) 30% 25% 45%
Web Portal Generator Coding (Part 1) 25% 5% 70%
NER Model Development (Part 2) 100% 0% 0%
Speech Prediction (Part 2) 100% 0% 0%
Testing 70% 15% 15%
System Design 40% 20% 40%
Algorithm 100% 0% 0%
Documentation 50% 0% 50%
Video Editing 0% 100% 0%
Legal 0% 100% 0%
Blogging 60% 20% 20%
Website 65% 15% 20%
Overall contribution 48% 26% 26%
Main Roles (maximum three for each member) Partners Liaison, UI Designer, Back End Developer UI Evaluator, Front End Developer, Video Editor UI Evaluator, Full Stack Developer

Bug List

List

ID Priority Description Effect
1 Low Speech Mode in github files only work with .wav audio Nothing in bigger picture as this part is not integrated with client MotionInput anyway with VOSK/Whisper will do the jobs.
2 Medium MotionInput python config action is not added yet only the JSON one (Still in process of standardizing) There is less action/pose/gesture to map to.
3 Medium To retrain the NER model it requires different script Minor incovenient to run other script to train brand new model.

Critical Evaluation

Critical Evaluation:
Processing Software & Web Portal Generator

Evaluation

UI/UX

Language Processing Software: Not Applicable

Web Portal Generator : The user interface and user experience of the web portal generator have also been well-designed to provide an engaging experience for users. Attention to detail in layout, navigation, and aesthetics enhances usability and satisfaction, although it may lack the specialized features of a language processing software.

Functionality

Language Processing Software : The core functionalities of language processing, including speech recognition, text analysis, and natural language understanding, have been implemented successfully. These features demonstrate the software's potential to enhance communication and streamline workflows. The unit and system test proves that this system work without error and will be able to be use in MotionInput without a bug.

Web Portal Generator : The core functionality of web portal generator is complete with expected output of website template from the user filling in the form, user also able to fill in different type of input which expands the website choices, there is many more interesting features that we want to add however time limits us to have fixed template.

Stability and Efficiency

Language Processing Software : Stability and efficiency are crucial for real-time language processing applications. The software demonstrates robust performance under typical usage scenarios, with ongoing optimization efforts to address latency issues and improve overall efficiency. However there could be improvement on the training data set in which could help it recognize more speech pattern and identify the identity more accurately with the spaCy Matcher.

Web Portal Generator : The build is very stable with output of website template not missing any file and other editor can edit without problem, with our structure being JSON it increase the efficiency of user who is developer as they can just focus on the JSON file that is readable and organize when compare to changing the code mechanics itself.

Compatibility

Language Processing Software: This is compatible with MotionInput and can build with Nuitka as the requirement set, since I use control version environment of conda there is little issue in integrating, I also updated all my package which ensure that it will compatible in long term.

Web Portal Generator: It can be export to Window only currently, however since it going Microsoft store this will not be issue, and since only MotionInput developer will be using this project, which they all going to get one Window laptop each it perfectly fine by it only in Window. As for responsiveness of webnsite template it work perfectly with all dimension and devices.

Maintainability

Language Processing Software: Maintainability is ensured through a modular design and adherence to coding standards. Continuous integration and testing practices are in place to maintain code quality and system reliability, facilitating easy updates and scalability.

Web Portal Generator : Since all our code is component and can be reused easily maintainability don't have to be done on all component but just one, we also have a dynamic input where if the developer want to add more input field or want to remove current field they can just use keyword rather than coding up new input field, also the website template is divide into section and all control by single point of JSON file, it is easy to identify the section and change it if there were to be some bugs.

Project Management

Team Agile project management methodologies have been employed to foster flexibility and adaptability. With everyone in the team always working on something different it avoid any conflict, however it a double edge sword, where sometimes if one person make a mistake there no one checking on them until testing, which had happen and cause us to waste sometime on the last week to fix this bug together.

Future Works

The following sections outline the key areas of focus for future development to enhance the functionality, accuracy, and user experience of our system.


Expanding the Training Dataset

Expanding the diversity and volume of the TRAIN_DATA is crucial. A richer dataset will enable the system to better understand a wide array of speech patterns, dialects, and gaming terminologies, thereby improving command recognition accuracy and system robustness.


Fine-tuning the Similarity Checks

Enhancing the similarity checks to more effectively match user commands with actions, poses, and gestures is a priority. A more nuanced algorithm that accounts for context, synonyms, and phrasing variations will significantly improve the system's interpretative accuracy.


Enriching Entity Matches

Adding a wider variety of games, poses, and gestures to the entity matches will make the system more inclusive and versatile. This expansion will cater to a broader user base and enrich the interaction and customization options available.


Implementing Advanced NLP Techniques

Adopting advanced NLP techniques, such as transformer models and context-aware algorithms, could vastly enhance the system's understanding of user commands, leading to a more intuitive and responsive gaming experience.


Continuous Learning and Adaptation

Incorporating continuous learning mechanisms to adapt the system based on user interactions will ensure it evolves to meet user needs more effectively over time. This could lead to personalized control schemes and improved system suggestions.


Enhancing Web Portal Generator

Developing a preview page within the web portal generator will allow users to interact with and visualize their website as they build it, ensuring a more intuitive design experience.


Improving Website Design

Focus on elevating the aesthetic and functional aspects of website design will enhance user engagement and make the platform more appealing and accessible.


Adding Website Manual with YouTube Tutorials

Integrating a comprehensive manual and instructional YouTube tutorials will aid users in navigating the platform, leveraging its features to the fullest, and troubleshooting common issues.


Enabling Social Media Functionality

Incorporating features for users to upload and share their gameplay on the platform will foster a community-driven environment, turning the website into a social media hub for gamers.