Phantom Omni Simulation by qngn93 - 2

SDK

Simulates medical surgery by integrating Phantom Omni with Unity

Unknown VersionMIT LicenseUpdated 3 years agoCreated on March 10th, 2017
Go to source

Phantom-Omni-Project

Haptic / Force-Feedback Interface with OMNI Phantom for Robot Guidance

Introduction

This project presents a software application for medical intention. It consists of a three dimensional virtual environment created in Unity, which are graphical scenarios in which the user interacts in real time using sensory devices for vision and sense of movement. The virtual environment allows haptic devices such as the Phantom Omni, a device with peripheral input and output that allow user to interact with our virtual environment, to simulate the sensation corresponding to the touch for which forces return.

Methodology

Equipment and software necessary: Phantom Omni Haptic Device, Unity, C#, OpenGL Phantom Omni interface acts as a bidirectional communication device between the user and the object in the virtual environment. This interface allows the user to navigate through a virtual tube (blood vessel), and perceive reaction forces depending whether or not there is contact between the haptic cursor (the pill) and the tube. The user must move an object through a three-dimensional tube. When the object comes into contact with one of the walls of the tube, the user perceives the corresponding collision force through the haptic device. The magnitude of the reaction force is proportional to the level of the surface intact of the pill within the wall of the tube. The Phantom Omni device contains a rotating base attached with some joints and has 6 degree of freedom that allow user to indicate the position and orientation of the haptic cursor within our virtual environment. With the addition of OpenGL haptic plugin that connects the Phantom to the computer, we’re able to interface the device to unity. Scripts written in C# allows the user to manipulate objects, set restraints, boundaries, and force feedback.

Results

The proposed method was tested for haptic feedback when the pill comes in contact with the outer walls of the artery. -Complete workspace of artery:

screenshot1

When starting the executable file, the expected result includes controlling the pill in the free space with the haptic device. Sample image of the pill moving in free space until it enters the bounded tube:

screenshot2

Once inside the tube, the pill is enabled to traverse through it while being restricted within the bounds providing haptic feedback to the Omni.

screenshot3

Sample image of the pill traversing through the tube If there is visual contact between the pill and the artery boundaries, the haptic device will provide force feedback in order to guide the pill back onto it’s traversal path.

screenshot4

Sample image of contact with boundaries producing force feedback.

Limitation

The plugin did not allow access to raw data from the haptic device. The data provided limited the ability to integrate the separate workspaces of the haptic and Unity dynamically.

YouTube link to demo: https://youtu.be/DoSwg3S898E

Conclusion

In this project, the Phantom Omni haptic device demonstrated force feedback by interfacing along a Unity Scenario with descriptive components developed by C# scripts. The proposed result aligned with the project’s expectations by providing the correct feedback when the pill collided with the artery tube. Thus, handling feedback by guiding the tube safely back to its traversal path. By allowing the haptic device to calculate the precise and accurate measurements of the procedure, it increases the chances of a successful operation. This demonstration supports the technological medical movement by providing hands-off and minimal error procedures. With the advancement of robotic technology, more tasks using haptic feedback are being performed by robots to reduce execution time and minimize human mistakes, such as errors caused by negligence and/or exhaustion.

Show all projects by qngn93