News

Video game technology gives surgeons 3-D vision for operating on beating hearts

24 June 2008

Stereo glasses and video game hardware can give surgeons the fast, highly sophisticated real-time 3-D imaging needed to do complex operations on the beating heart using keyhole surgery.

In a study published in the June Journal of Thoracic and Cardiovascular Surgery, cardiac surgeons from Children’s Hospital Boston, US, report good results with the technology.

The researchers, led by Pedro del Nido, MD, and Nikolay Vasilyev, MD, of the Children’s Hospital Department of Cardiac Surgery, had already been testing a three-dimensional ultrasound imaging system. But although the images are 3D and displayed in real time, they give little indication of depth. In animal tests, surgeons trying to navigate surgical tools inside the heart became disoriented when guided by these images.

Del Nido, chief of Cardiac Surgery at the Children’s Hospital, realised that what they needed was stereoscopic vision. Watching the flat picture on the computer screen was like watching a baseball game on TV, he says. “It’s good enough to follow what's happening in the game, but you could never grab a ball in mid-flight,” del Nido explains.

So collaborator Dr Robert Howe, of Harvard University, borrowed a solution from video games — splitting computer images in two and cocking them at slightly different angles. When wearing gamers’ flickering glasses, users can see ultrasound images of the beating heart as a hologram. “You definitely have depth perception,” says Vasilyev. “You feel like you’re inside the heart chamber.”

Vasilyev tested the glasses while operating on pigs with an atrial septal defect, a common form of congenital heart disease in which there is a hole in the wall dividing the heart’s upper chambers. Vasilyev closed each defect using a catheter carrying a tiny patch, threaded into the heart through a vein. Using another device, he fastened the patch around the hole with tiny anchors. In all, he placed 64 anchors: 32 under standard 3D ultrasound guidance, and 32 using the stereoscopic vision display.

Using the stereoscopic display, Vasilyev was able to place the anchors 44% faster than with the standard display (9.7 versus 17.2 seconds). The tip of the anchoring device also navigated more accurately.

The accuracy of anchor placement didn’t differ significantly between the two sets of tests. However, the speed of the anchor placement improved significantly. The researchers believe that the ability to precisely navigate tools inside the beating heart will minimize risk to neighbouring heart structures.

Stereo vision (above)

Volumetric data on an atrial septal defect (arrowheads) are streamed in real time from an ultrasound system to a graphics station computer, which renders left-eye and right-eye views by alternating the position and orientation of the image, skewed by angle %u03B1.

The rendered volumes, immediately displayed on a conventional monitor, are synchronized with flickering shutter glasses worn by the surgeon, yielding stereo-rendered 3D ultrasound images. This imaging technology provides surgeons with significantly better spatial information and depth perception for making repairs inside the beating heart. (LA, left atrium; RA, right atrium.)

Beatring heart repair of atrial septal defects

When surgeons patched holes guided by ordinary 3-D ultrasound, they anchored their patches askew (left). Aided by stereoscopic vision (middle), they secured the patches with more evenly-spaced anchors (middle), results nearly as good as those with open-heart surgery.

Clinical trials of beating-heart surgery with the patching system could begin in children with ASDs this year, Vasilyev says.

Del Nido believes that stereoscopic imaging, coupled with recent advances in catheter-based surgical tools, will eventually allow surgeons to do much more complex operations on beating hearts, such as closing more complicated holes, shaving away excess tissue or repairing fast-moving structures like mitral or aortic valve leaflets. “We look at some very unusual cardiac anatomy,” he says. “Half the battle is figuring out what the structure is without opening up the heart.”

For children, being able to do beating-heart surgery is a real advantage, del Nido adds. The large incisions can scar the heart and disrupt its rhythm, occasionally requiring a pacemaker. Opening the heart invites infection, and air bubbles can slip into the bloodstream and damage the brain. Running blood through a bypass machine can sometimes launch an inflammatory response, damaging organs throughout the body. And even in uncomplicated open-heart surgeries, recovery times are weeks to months.

The real-time stereoscopic visualization system was designed to handle and render 30MB of data every second. The renderer was implemented on a GeForce FX 7800 computer video card from nVidia Corp.

 

Increase your knowledge with a wide range of Informatics and IT books from the bjhc&im bookstore

 

To top^