Situated Cognitive Editor 2021

Problem statement

Situated Cognitive Editor is a open source project aims to provide handful tools for clinicians to build human factor training session out of 360 videos, which interactive 360 videos are exellect e-materials for learners under Covid-19 pandemic. We build an editor that consists of a 360-video featuring layers, dynamic timeline hotspots that are interactable, and project import/publish function.

Solution

We solved this problem by building a player and an editor separately using Unity.

For the editor, users can add hotspots by right-click on their mouse and open an input panel with a left-click. The input panel allows user to add a name, some description text, an explanatory image and a link to another video to the hotspot. All the information on hotspots will be stored into a json file.

For the player, it can read the json file and add the hotspots to its location with all its attached information. The user will be able to watch the video and click on the hotspots for extra information.

Achievement and impact

We managed to release 2 executable files (for the editor and the player) which allows the user to edit and present the annotated 360 videos.

Doctors are able to deliver training sessions more easily with hotspots and 360 videos, and their students can learn more clearly and efficiently.