Trial of "touchless" gaming technology in surgery
Published: 31st May 2012 07:39:50
Doctors in London are trialling "touchless" technology, often used in TV games, to help them carry out delicate keyhole surgery.
The system allows them to manipulate images with their voice and hand-gestures rather than using a keyboard and mouse.
Surgeons say it gives them more control and avoids disruption.
Independent experts say this approach could become the norm over the next ten or 15 years.
Surgeons are increasingly reliant on 3D images to carry out complex and delicate procedures.
Accessing the information they want is not straightforward. Using a conventional keyboard and mouse during the operation would risk contamination.
Relying on colleagues to get the right image can be time-consuming and disruptive.
Surgeons at St Thomas' hospital in London are trialling gesture-based gaming technology to access and manipulate images.
The system will be familiar to anyone who has used Kinect interactive games at home.
This has been adapted to respond to surgeons voice commands and arm-movements during operations.
The initial trial at St Thomas' hospital is in vascular surgery - in this case inserting a graft to repair a damaged aorta, the main blood vessel running through the body.
Standing straight, arms raised like an conductor, the surgeon, Tom Carrell, issues commands to a Kinect sensor perched beneath a monitor displaying a 3D image of the patient's damaged aorta.
With hand gestures he can pan across, zoom in and out, and rotate images. He can then lock the image and make markers to help ensure the graft is in exactly the right place.
Until recently I was shouting out across the operating theatre to tell someone to go up, down, left right. But with the Kinect I'm able to get the position that I want quickly ”
He says this direct control helps him to focus on the technical aspects of the operation.
"Until recently I was shouting out across the operating theatre to tell someone to go up, down, left right.
"But with the Kinect I'm able to get the position that I want quickly - and also without me having to handle non-sterile things like a keyboard or mouse during the procedure."
Mr Carrell says the technology is easy to use.
"The sensitivity is the main thing, but it's very simple gestures, like on a smart-phone. Once you know the gestures it's very intuitive."
This is one of the first trials of its kind in the world. Some of the features - such as the voice control and gestures tailored to vascular surgery - are unique.
The refinements from gaming technology to complex surgery have been developed by Microsoft Research, with support from Lancaster University. Helena Mentis from Microsoft Research says the operating theatre presents particular challenges.
"In something like a surgical theatre we're interested in a very constrained area. You have surgeons and scrub nurses that are all very close to one another.
"You have a patient in front of you. You don't have the ability to reach up and reach out as far because you're sterile. You can't touch anything that's not already sterile."
I would find it difficult to think of operating rooms in ten or fifteen years time where these were just not the norm.”
This trial will soon be extended to other centres and other types of surgery. John Brennan, who is president of the British Society for Endovascular Therapy, says it is early days, but the potential is great.
"I think these sort of advances in image manipulation which is an integral part of the a lot of the minimally invasive stuff that is done nowadays - they are inevitably going to become more refined and more available.
"I would find it difficult to think of operating rooms in ten or 15 years time where these were just not the norm."
Dr Mark Rouncefield from the School of Computing and Communications at Lancaster University welcomed the trial.
"This is a lovely example of a successful interdisciplinary research project, combining the technical skills of computer scientists with a social scientific and medical expertise that ensures the new technology resonates with the way in which surgeons actually do their work."
Harvard CitationBBC News, 2012. Trial of "touchless" gaming technology in surgery. [Online] (Updated 31 May 2012)
Available at: http://www.manchesterwired.co.uk/news.php/1431976-Trial-of-touchless-gaming-technology-in-surgery [Accessed 20th May 2013]
More England News
Bristol's mayor wants to raise the cost of business parking permits by up to 400%, the Liberal Democrats say....
A dementia sufferer left overnight on a Luton patient transport bus without food or water was "badly let down", her family have sa...
Scheduled flights to four new European destinations will begin from Cambridge Airport, it has been announced....
A police officer completed nine marathons in six days in memory of murdered Greater Manchester PCs Fiona Bone and Nicola Hughes....
Liverpool footballer Raheem Sterling has had a common assault charge against him dropped after a witness failed to turn up to court....
The father of former England footballers Gary and Phil Neville is to be charged with sexual assault....
A man has been charged over an attack in Wolverhampton city centre which left a man critically ill....
Police searching for the parents of a baby girl who was found dead on a country lane are hoping they will attend her funeral....
A further three people have been charged with the murder of a father who was shot at his Leeds home....
A fatal shooting in Hove in which a gunman apparently also tried to shoot dead two other people was not random, Sussex Police have said....
At 11:45:18 in HeadlinesThere's a furore around a graffiti-festooned, skater hangout under threat on London's Southbank. These graffiti and skating "...
At 11:25:43 in OtherA police officer completed nine marathons in six days in memory of murdered Greater Manchester PCs Fiona Bone and Nicola Hughes....
At 10:22:03 in OtherPolice searching for the parents of a baby girl who was found dead on a country lane are hoping they will attend her funeral....
At 08:39:51 in OtherA 23-year-old man has been charged with attempted murder after a man was stabbed "numerous times" in Stockport....
At 07:40:09 in OtherThree teenagers arrested on suspicion of supplying drugs after a 16-year-old girl died in Warrington have been released on bail....
At 15:28:22 in OtherCoronation Street has won eight prizes at the British Soap Awards, compared with just one for its rival EastEnders....
At 11:48:38 in OtherA 23-year-old man has been arrested on suspicion of attempted murder after a man was stabbed in the early hours of Saturday in Stockport....
At 11:43:34 in OtherThree teenagers have been arrested on suspicion of supplying drugs after a 16-year-old girl died in Warrington....
At 15:37:51 in OtherTwo giant Archimedes screws installed to generate renewable energy from the River Goyt in Stockport have been officially opened....
At 15:14:22 in OtherA prisoner who was missing for two months has been charged with 13 offences including indecent exposure and causing grievous bodily harm....
News In Other Categories
Police say they were overwhelmed by the large crowd when a stampede killed four people at a church in Ghana's capital, Accra, on Sunday...
Two 16-year-old boys have been arrested in connection with smoke canister offences at a Fife football match....
Plans to legalise same-sex marriage in England and Wales return to the Commons later, amid continuing opposition from some Conservative acti...
JP Morgan chairman and chief executive Jamie Dimon is facing a shareholder revolt as investors prepare to vote on whether he should be allow...
There's a furore around a graffiti-festooned, skater hangout under threat on London's Southbank. These graffiti and skating "...
State-sponsored hackers have renewed attacks on the US after a three-month hiatus, the New York Times reports....