Detailed analysis and documentation of the Portalt project requirements
IBM is a global technology company with a rich history of innovation spanning over a century. Their Innovation Centre at York Road, Waterloo serves as a hub for showcasing cutting-edge technologies and solutions to clients and partners. The centre demonstrates IBM's latest advancements in areas such as quantum computing, artificial intelligence, cloud solutions, and more.
The Innovation Centre plays a crucial role in IBM's business strategy, allowing potential clients to experience firsthand how IBM's technologies can transform their operations. However, the physical limitations of the centre mean that international clients and partners often face challenges in accessing these demonstrations without traveling to the UK.
Currently, IBM faces a significant challenge with their Innovation Centre: international clients cannot experience the centre's offerings without physically traveling to the UK. This limitation restricts IBM's ability to showcase their innovations to a global audience efficiently.
For example, a potential client in the UAE interested in IBM's quantum computing solutions would need to arrange international travel to visit the Innovation Centre in Waterloo. This creates barriers in terms of time, cost, and logistics, potentially impacting business opportunities.
Our project addresses this challenge by creating an augmented reality (AR) application that enables remote visitors to virtually experience the Innovation Centre. This solution will leverage the UBIQ online environment to create an immersive, interactive experience that captures the essence of being physically present at the centre.
The application will allow multiple participants from different locations to simultaneously visit the virtual Innovation Centre, interact with 3D models of IBM's products (such as their quantum computer), and engage with both IBM representatives and an AI-powered chatbot for information.
Additionally, the solution is designed to be adaptable for other contexts, such as NHS environments where medical students could remotely learn about specific organs or procedures with guidance from professors.
Our primary aim is to develop an innovative augmented reality solution that breaks down geographical barriers for IBM's Innovation Centre, enabling global access to their cutting-edge technologies while creating a template that can be adapted for various industries. The project will focus on creating an immersive, interactive experience that closely mimics physical presence while leveraging AI to enhance user interactions.
Create an immersive multiplayer AR environment that allows IBM representatives and international clients to interact in real-time as VR avatars, providing remote access to the Innovation Centre's offerings.
Develop an intuitive admin interface for IBM staff to easily upload, position, and manage 3D models of their products in the virtual environment, ensuring content remains consistent for all users.
Implement AI-powered interactions through a RAG-enabled chatbot with voice responses and Granite as an offline AI processor, enhancing the information delivery experience.
Research and integrate 3D model generative AI to identify optimal methods for adding new content to the virtual environment efficiently.
Design a scalable, open-source solution that serves as a template for other use cases beyond IBM, such as NHS training environments, with comprehensive documentation to support wider adoption.
As part of our requirements gathering process, we conducted a series of semi-structured interviews and created detailed user personas to better understand user needs and expectations for the AR experience.
VR/AR Experience Visitor
Experience virtual tours with engaging, interactive content. Easily navigate and access information.
May have varying levels of technical expertise and comfort with VR/AR technology.
Prioritizes intuitive navigation, clear information presentation, and immersive experiences.
"Not really. I've seen videos of people using VR for gaming, but I've never tried it myself. I'm curious, though! It looks cool, and I'd like to see how it can help me understand complex topics."
"A bit of both, I think. I like to start with some guidance, so I know what I'm looking at. But after that, it would be fun to explore on my own. I think I'd learn more if I could go at my own pace and check things out without too much pressure."
"A bit of both, I think. I like to start with some guidance, so I know what I'm looking at. But after that, it would be fun to explore on my own. I think I'd learn more if I could go at my own pace and check things out without too much pressure."
"For me, it's about being able to understand something really complex in a simple way. If I can come away feeling like I 'get' Quantum Computing, even just a little, I'd be happy. Also, if there's a way to share what I've learned, like a summary I can take away, that would be great."
Based on our interviews and persona development, we identified these critical insights about what users value most:
Content creation and environment setup process
Admin logs into the system and accesses the main dashboard
Admin initiates the creation of a new virtual tour activity
Design the virtual environment where the activity will take place
Generate two executables for different user roles:
ID | Use Case | Description |
---|---|---|
AC1 | Access Dashboard | Admin logs into the system and accesses the main dashboard where they can view and manage all activities. |
AC2 | Create New Activity | Admin creates a new VR activity by configuring title, image URL, VR mode, and target device IP address settings. |
AC3 | Create Scene | Admin designs the virtual environment where the activity will take place, setting up the base structure. |
AC4 | Manage 3D Assets | Admin uploads custom 3D models or selects from preset library to populate the virtual environment. |
AC5 | Configure AI Assistant | Admin adds reference documents for the RAG-enabled chatbot and configures the "Hey Genie" activation phrase. |
AC6 | Configure Connection Settings | Admin adjusts network settings including target device IP address for connecting with the viewer application. |
AC7 | Generate Executables | Admin launches the project to create both admin and viewer executables for different user roles. |
AC8 | Place and Scale Objects | Admin uses the admin executable to precisely position and scale 3D objects in the preferred locations within the VR environment. |
Priority | ID | Category | Requirement |
---|---|---|---|
Must Have | F1 | Admin Interface | Web-based admin dashboard for creating and managing virtual activities |
Must Have | F2 | User Management | Organization management system with multiple user accounts |
Must Have | F3 | VR Experience | VR viewer application for end users to experience created content |
Must Have | F4 | Content Creation | Support for 3D object placement and manipulation in virtual environments |
Must Have | F5 | AI Integration | RAG-enabled AI guide that responds to user voice queries |
Must Have | F6 | Content Management | Document upload system for creating AI knowledge base |
Must Have | F7 | Collaboration | Real-time voice interaction between users in the same virtual space |
Should Have | F8 | Content Creation | PC-based scene editor for precise object placement and manipulation |
Should Have | F9 | Security | Activity join codes for secure access to virtual environments |
Should Have | F10 | Content Creation | Support for multiple file formats for 3D models |
Should Have | F11 | Integration | Pairing system between admin dashboard and VR applications |
Could Have | F12 | Content Creation | Customizable virtual environment templates |
Could Have | F13 | Analytics | User analytics and activity metrics for administrators |
Could Have | F14 | Accessibility | Non-VR access for desktop users |
Could Have | F15 | Interaction | Hand gesture recognition for non-verbal communication |
Won't Have | F16 | AR Features | AR passthrough capabilities (deferred to future version) |
Won't Have | F17 | AI Generation | AI-generated 3D models from text or image inputs |
Priority | ID | Category | Requirement |
---|---|---|---|
Must Have | NF1 | Security | Secure authentication and authorization system |
Must Have | NF2 | Usability | Responsive design for admin dashboard on mobile and desktop devices |
Must Have | NF3 | Compatibility | Support for major VR headsets (Oculus Quest, HTC Vive, Valve Index) |
Must Have | NF4 | Performance | Low-latency voice communication (< 200ms delay) |
Should Have | NF5 | Performance | Efficient 3D asset loading and optimization |
Should Have | NF6 | Compatibility | Cross-browser compatibility for admin dashboard |
Should Have | NF7 | Accessibility | User interface accessibility features |
Should Have | NF8 | Reliability | Data backup and recovery mechanisms |
Could Have | NF9 | Reliability | Offline mode for previously loaded environments |
Could Have | NF10 | Performance | Performance optimization for low-end devices |
Won't Have | NF11 | Accessibility | Full native mobile application for admin dashboard |