Could ChatGPT soon be used as a diagnostic tool?
A research team in London is looking into whether or not ChatGPT can be used as a diagnostic tool for medical learners and clinicians.
Dr. Amrit Kirpalani, a paediatric nephrologist at Children’s Hospital at London Health Sciences Centre, and his team of Schulich Medicine students, wanted to explore how ChatGPT could help learners and professionals.
To do so, they inputted 150 medical case challenges into ChatGPT, and the answers were analyzed based on accuracy, relevance and cognitive load.
According to Kirpalani, the results concluded that ChatGPT 3.5 accurately diagnosed 49 per cent of the 150 case challenges, but that the overall reliability was limited.
The team found that ChatGPT struggled with interpreting numerical values, neglected data points key to diagnoses and often overlooked important details which led to inaccurate assumptions.
However, the team was interested in ChatGPT’s ability to take complex cases and explain answers in a way that is understandable to those who may not possess complex medical knowledge.
“The cognitive load was relatively low, meaning that it was easy to understand,” said Branavan Nagarajan, a third-year Schulich Medicine medical student involved in the project. “This means ChatGPT can be a powerful tool for the learning process, helping both pre- and early-year medical students understand complex concepts because they are presented in a more manageable format. But when you combine this with the issues of accuracy, it highlights the importance of having someone with a higher level of medical knowledge to validate the outputs.”
Going forward, the research team believes there are exciting opportunities in terms of next steps.
“We are curious to analyze the performance of future iterations of ChatGPT, to see how much better it does in terms of relevancy, accuracy and cognitive load,” said Nagarajan. “There could be the opportunity to expand the parameters the program receives, allowing us to incorporate more numerical data, images and even clinical content such as patient history. We would be curious to see how this could impact the program’s diagnostic accuracy.”
Kirpalani said he would like to explore the potential of incorporating ChatGPT and AI literacy into formal medical training, adding, “Our results illustrate the importance of understanding how to use these AI tools properly to avoid receiving or spreading misinformation. A tool is only powerful if we know how to use it accurately.”
CTVNews.ca Top Stories
Canadian government announces new border security plan amid Donald Trump tariff threats
The federal government has laid out a five-pillared approach to boosting border security, though it doesn't include specifics about where and how the $1.3-billion funding package earmarked in the fall economic statement will be allocated.
Fall sitting bookended by Liberal byelection losses ends with Trudeau government in tumult
The House of Commons adjourned on Tuesday, bringing an end to an unstable fall sitting that has been bookended by Liberal byelection losses. The conclusion of the fall sitting comes as Prime Minister Justin Trudeau's minority government is in turmoil.
Police chief says motive for Wisconsin school shooting was a 'combination of factors'
Investigators on Tuesday are focused on trying to determine a motive in a Wisconsin school shooting that left a teacher and a student dead and two other children in critical condition.
14 dead and hundreds injured in magnitude 7.3 quake in Vanuatu. Some people are trapped in rubble
A magnitude 7.3 earthquake that struck off Vanuatu killed at least 14 people, injured hundreds more and caused widespread damage across the South Pacific island nation, rescuers and officials said early Wednesday. Rescuers worked through the night trying to reach some people yelling under the rubble.
Prosecutors charge suspect with killing UnitedHealthcare CEO as an act of terrorism
The man accused of killing UnitedHealthcare's CEO has been charged with murder as an act of terrorism, prosecutors said Tuesday as they worked to bring him to a New York court from from a Pennsylvania jail.
'She will not be missed': Trump on Freeland's departure from cabinet
As Canadians watched a day of considerable political turmoil for Prime Minister Justin Trudeau and his government given the sudden departure of Chrystia Freeland on Monday, it appears that U.S. president-elect Donald Trump was also watching it unfold.
The world's busiest flight routes for 2024 revealed
If you think planes have got fuller and the skies busier over the past year, you’d be right — especially if you live in either Hong Kong or Taipei.
NASA's 2 stuck astronauts face more time in space with return delayed until at least late March
NASA's two stuck astronauts just got their space mission extended again. That means they won’t be back on Earth until spring, 10 months after rocketing into orbit on Boeing’s Starliner capsule.
Sex-ed group deemed 'inappropriate' by Tory government returns to N.B. schools
A sexual-education group whose presentations were deemed "clearly inappropriate" by the previous New Brunswick Progressive Conservative government has been cleared to return to the province's schools.