UCL Open-Illumiroom V2

Abstract

Our project builds on Microsoft Research’s IllumiRoom proof-of-concept from 2013. The team has been working to “remaster” this project, creating our own deployable software to provide real-time Expanded Experiences for TV-based gaming and entertainment. Against the backdrop of the rising interest in virtual and augmented reality, we investigated the use of a projector for creating immersion accessibly.

UCL Open-Illumiroom V2 displays complementing effects around the user’s TV to expand their display. With 9 different projection modes currently in operation, and the possibility for many more to be developed, the system offers unparalleled possibilities for creating immersive experiences.

We have designed UCL Open-Illumiroom V2 to project effects onto the irregular surroundings around a TV, instead of the usual flat, plain wall. Extensive research was conducted into how to calibrate the projection system to map projections onto uneven objects. A novel algorithm was developed to achieve this, correcting projections for a fixed user perspective and replacing the Kinect for Windows depth sensor in Microsoft’s IllumiRoom. This also allows the projector to be placed to the side instead of directly opposite the TV, preventing glare on the screen. Moreover, due to our focus on accessibility, the system is hardware compatible. It can run on any computer using the Windows operating system, using any projector, and supports game consoles, such as the Xbox One, Series S and more!