AR and AI converge offering more accurate and timely diagnosis
There are two key properties around disruption – the first is the adoption curve – the second is convergence. Already in health we’re seeing this convergence – in this case augmented reality with Google Glass (for those of you that thought Google Glass was a failure – it wasn’t, it was an experiment) combined with artificial intelligence is helping doctors produce more accurate and timely diagnosis…
From the Washington Post;
“PALO ALTO, Calif. — Jim Andrews is in a medical office wearing just a hospital gown, staring at his doctor of 11 years, who is staring back at him through the sleek, metallic lens of Google Glass.
As the doctor examines Andrews, a new kind of medical scribe is watching the examination, transcribing everything he sees. The scribe, named Rahul, is thousands of miles away in India, and he is viewing the office visit live through the pint-size, WiFi-connected camera attached to the doctor’s glasses.
“When was his last physical?” the doctor, Albert Chan, asks as he listens to Andrews’s breathing and checks his reflexes. Rahul’s nearly immediate answer pops up in a text bubble display in the right corner of the doctor’s field of vision. “June 3, 2014!”
What it was like to get examined by a doctor wearing Google Glass?
The entrepreneurs behind the technology — which could one day morph into something as tiny as a contact lens — say it is more than a transcription tool: It’s the first step to supercharging doctors with instantaneous information that transforms how medical decisions are made. Instead of human scribes taking down notes, they envision a world in which artificial intelligence software could transcribe the office visit in real time, while immediately comparing the patient’s medical issues with those of millions of others, then making predictions about what treatments would work best. Moreover, they say the technology is bringing health-care professionals back into the moment with their patients — returning a sense of humanity that has been lost as computers have become a fixture in the doctor’s office.
Darren Phelan discusses healthcare options with patient Lindsy Martin in Menlo Park, Calif. (Christie Hemm Klok/For The Washington Post)
Yet, like much new digital technology in health care, Google Glass has the potential to create more problems than it solves. Medical scribing is a tough job that requires a high level of accuracy — note-takers in far-off lands need to know terms such as “eosinophilic esophagitis” — and getting a word wrong could have grave consequences.
Health systems are also far more vulnerable to cyberattacks than other industries, such as banking, a gap that hackers have aggressively exploited in recent years, said Avi Rubin, director of the Health and Medical Security Lab at Johns Hopkins University. In recent years, hundreds of hospitals have been victims of “ransomware” attacks, in which outsiders block the hospital from accessing its own data until the hospital pays them money.
Rubin said that hospitals are prime targets because of a “perfect storm” of weak security systems, the increasing digitization of data, and the fact that medical records can be so time-sensitive and critical to making life-or-death decisions. A live-streaming video of a patient exam with a doctor could be most sensitive of all.
“You’re taking something that was in the doctor’s office and now you’re streaming it across the world,” Rubin said. “The whole health-care industry has lax security, and if you combine that with how private the information is and how it needs to be immediately available, that’s where I have concerns.”
Google Glass is in part a response to the most recent major technology introduced into the doctor’s office. The switch to electronic health records has received billions in federal funding and been hailed as a major step forward for the medical field. Doctors now say they are turning to Google Glass so they can escape the burden of spending an entire patient visit — and several hours later in the day — typing information into forms.
“I can look my patients in the eye again,” said Teresa Nauenberg, a primary care physician who works with Chan at the hospital Palo Alto Medical Foundation and has been using the technology for two years.
Today, roughly 500 doctors in 27 states put on Google Glass. They wear them through the day, live-streaming their office visits to the virtual scribes, who look on and take detailed notes.
Ian Shakil, the 32-year-old chief executive of Augmedix, the San Francisco start-up that has partnered with search-engine giant Google to distribute the technology, hopes that in the near future, seeing a doctor wear Google Glass will feel as normal as seeing one with a stethoscope. Augmedix has raised more than $36 million from venture capitalists and health systems, including Dignity and Sutter Health, which owns Palo Alto Medical Foundation. The start-up charges doctors between $1,500 and $4,000 a month for the service, which Sutter says saves doctors up to two hours a day.
Scribes receive about three months of training from Augmedix before they can do the work, which is performed in sealed-off rooms. The company’s 200 scribes, divided between San Francisco and Bangalore, India, must leave pens, paper, smartphones and all other belongings at the door.
For Shakil, accuracy is critical. Beyond extensive training of scribes, he says that doctors must ultimately review the notes to make sure all details were recorded accurately.
If Augmedix is successful, it would also be a huge coup for Google, which has had a troubled history with Glass and health data.
Glass emerged in 2012 as a pet project of Google co-founder Sergey Brin. Brin wanted to sell the $1,500-a-pair glasses as a high-end fashion item, and he went so far as to partner with designer Diane Von Furstenberg. But the product fell flat.
Even in a society that is always recording, the glasses felt too much like a privacy violation — or a gimmicky party trick. Google discontinued its limited consumer sales last year and retooled the devices. (Snap, the company behind Snapchat, last week launched sunglasses with an embedded camera that can create 10-second videos.)
Augmedix is now one of nine Google partners, which include start-ups using Glass to enhance museum tours, record surgeries and train workers doing equipment repair.
In 2013, Google shuttered its personal health record platform, Google Health, because so few people were using it. Today, the search giant is competing with Amazon.com (whose chief executive, Jeffrey P. Bezos, owns The Washington Post), Microsoft and others for hospital customers to store data on its cloud servers. Many hospitals are wary of tech giants storing their data. Augmedix does not share any data with Google. Google declined to comment.
Like many entrepreneurs, Augmedix’s founders say they believe in the Silicon Valley vision of better technology liberating people from older technology’s burdens. Yet in health, the record has not been so clear.
Electronic medical records were supposed to make the medical system more efficient — reducing errors and enabling doctors to track a patient’s history. But their implementation has been rife with unintended consequences, said Robert Wachter, the interim chairman of the Department of Medicine at the University of California at San Francisco and the author of a 2015 book on the subject.
A 2014 study by the American Medical Association and RAND Corporation found that digital records were a major contributor to physician dissatisfaction. Another article, in the journal Health Affairs, found that two-thirds of a primary care physician’s day was spent on clerical work. There’s also some evidence that electronic health records have increased the practice of overbilling Medicare by stuffing digital data fields with unnecessary procedural codes”…more..