This section of the website details the work that was completed by each member of the team, each of which contributed a large amount to the project and without whom the project would not have been able to be finished.
Kirthi
1. Using depth to identify tool: differences in the depth values with the neighboring pixels to identify the edges of the tool.
2. Color Map/ Heat Map: This assigns every pixel with a specific color based on the depth values of the pixels. This is done using the most and the least significant bits of the depth values. The most significant bits are used to determine the color range and the least significant bits determine the specific color.
3. Voice Control: Got the voice commands to work for the system to switch between the different modes available. This required the different language and the speech runtimes to be installed. A grammar is defined and the speech is checked against this grammar and the appropriate actions are performed.
4. Website Design and Implementation: Constructed the group website using Bootstrap.
5. Documentation: Documented in detail the progress I had made during the course of the project, including adding to the development section of the website, writing parts of the system manual and writing the Team Roles section of the website.
6. Final presentation: delivered a section of the final presentation about the requirements of the system and how it was tested.
Tom
1. ToolProximity augmentation: had the main responsibility of developing the ToolProximity augmentation, time was mostly focused on this because it was such a vital part of the project. Worked out how to colour the edges of the tool according to how far away they were from the background. As a part of this work, created the find edges algorithm that finds all of the edges in the camera frame based on depth.
2.Kinect CoordinateMapping: researched and implemented the first successful use of the Kinect CoordinateMapper class which maps the depth image received from the Kinect to the colour space. This was extremely important for the success of the rest of the project.
3. User Manual: wrote the user manual that guides the surgeon or user through how to use the system, talking about all of the different features avaliable. This is short because the system is so simplistic, as per our goals for the project.
4. System Manual: compiled the final system manual from the documents written by each member of the team related to their section of development of the final system. This manual will allow future developers to quickly understand the code of the system.
5. Documentation: wrote a part of the Development section of the website that details how I went about designing all of the algorithms that I implemented and how I came up with the ideas for them.
6. Final Presentation: delivered a section of the final presentation detailing what our solution to the problem of applying depth sensing to surgery was.
Ed
1.Team Management: managed work assignment and kept the project on track as well as handling client communications.
2. Green Tool Identification: developed the idea of identifying tools by their green colour as opposed to identifying them as they were, allowing the team to focus on the depth sensing side of the system rather than tool identification.
3. First Augmentation: created the first visual augmentation of the project that changed the colour of the tool based on how far away it was from the camera using basic thresholding techniques.
4. Final System Architecture: researched and designed the system architecture according to the strategy design pattern.
5. Final System: built the framework for the final system which included the design and subsequent redesign of the user interface, which the other team members could easily add the visual augmentations that they had created to. Made the final system multithreaded so that it would always display the normal feed in real time even if the augmentation ran slowly and ensured that the main UI thread was never blocked.
6. Tool Proximity: created a second version of the tool proximity augmentation when the original one became granular and hard to understand which works by analysing the depths of the twenty pixels surrounding each green pixel.
7. Test Scenarios: designed and created all of the team’s main test scenarios including slinging a blood vessel.
8. Prop Sourcing: decided on what props would be used to test the system and then purchased these props to use with the system.
9. Final Video: recorded and edited all of the footage for the final video of the system.
10. Documentation: created all of the following sections of the website: Architecture, Surgical Vision Group, Naming Conventions, Limitations of the Kinect, Testing, Final System in Action, Collaboration Opportunities, Evaluation, Work Assignment, Further Development and Goals. Also contributed to the Development section of the website and the System Manual. Finally proofread and edited all sections of the website.
11. Elevator Pitch: wrote and delivered the team’s elevator pitch in January.
12. Final Presentation: delivered the introduction to the final presentation and the evaluation.