Medecine 3D is a device allowing the visualization of human body parts in 3D and to manipulate them, giving the impression to interact physically with floating organs.
We propose a device allowing the visualization of human body parts in 3D and to manipulate them, giving the impression to interact physically with floating organs. This device will make use of a mirror and a screen coupled with a motion-sensor to recognize movements.
The interaction with a 3D image would even be interesting in some universities, especially in medical universities. It will help the students having difficulties with 3D representation of the human anatomy and providing a sense of touch on these digital resources will provide to students precise details about organs or bones and how to detect some diseases. Our project has a large domain of application. Even if we decided to focus on an educational objective, the application can be extended to other domains of interest for our technology.
The user can manipulate a 3D image thanks to a camera which sense the user’s movements (the Leap Motion). A program coded in Java analyzes the frames sent by the Leap Motion and that simulates some keyboard event as output if a motion control is detected. Four motions are detected : a Grab strength (zoom in/out), a pinch (to rotate the image), an horizontal swipe gesture (to quit the 3D visualization mode) and a key tape gesture (to simulate the click of the mouse).
The importation of the different 3D images is managed thanks to a website developed on Wordpress (a content management system designed to run websites). Each user can upload the image that he wants to manipulate on this website. The application is able to link with the database (MySQL) of the website and updates the different images needed by the user.
Our device is also composed of a beamsplitter and a screen. The mirror is a semi-reflecting mirror, meaning it reflects part of the light/image and lets through another. It is a 50/50 type i.e. 50% reflection and 50% transmission.
A part of the projected image on the screen is reflected toward the user’s eyes for one part while also being transmitted through it. At the same time, the user can see his hands through the mirror. This gives the impression to be able to interact with the image. The size of the mirror is 127 mm x 178 mm, which is practical in order to move it or to see the image.
The computer screen LCD displays the original image. The image displayed on the screen is projected onto the mirror.
The main satisfaction is that we managed to make a functional prototype.
The project that we have developed has main additional values compared to other technologies which already exist in the domain of 3D representation and visualization (the cost, the robust and reliable technology, a large domain of application, a new technology (the Leap Motion)).