Could ChatGPT soon be used as a diagnostic tool?
A research team in London is looking into whether or not ChatGPT can be used as a diagnostic tool for medical learners and clinicians.
Dr. Amrit Kirpalani, a paediatric nephrologist at Children’s Hospital at London Health Sciences Centre, and his team of Schulich Medicine students, wanted to explore how ChatGPT could help learners and professionals.
To do so, they inputted 150 medical case challenges into ChatGPT, and the answers were analyzed based on accuracy, relevance and cognitive load.
According to Kirpalani, the results concluded that ChatGPT 3.5 accurately diagnosed 49 per cent of the 150 case challenges, but that the overall reliability was limited.
The team found that ChatGPT struggled with interpreting numerical values, neglected data points key to diagnoses and often overlooked important details which led to inaccurate assumptions.
However, the team was interested in ChatGPT’s ability to take complex cases and explain answers in a way that is understandable to those who may not possess complex medical knowledge.
“The cognitive load was relatively low, meaning that it was easy to understand,” said Branavan Nagarajan, a third-year Schulich Medicine medical student involved in the project. “This means ChatGPT can be a powerful tool for the learning process, helping both pre- and early-year medical students understand complex concepts because they are presented in a more manageable format. But when you combine this with the issues of accuracy, it highlights the importance of having someone with a higher level of medical knowledge to validate the outputs.”
Going forward, the research team believes there are exciting opportunities in terms of next steps.
“We are curious to analyze the performance of future iterations of ChatGPT, to see how much better it does in terms of relevancy, accuracy and cognitive load,” said Nagarajan. “There could be the opportunity to expand the parameters the program receives, allowing us to incorporate more numerical data, images and even clinical content such as patient history. We would be curious to see how this could impact the program’s diagnostic accuracy.”
Kirpalani said he would like to explore the potential of incorporating ChatGPT and AI literacy into formal medical training, adding, “Our results illustrate the importance of understanding how to use these AI tools properly to avoid receiving or spreading misinformation. A tool is only powerful if we know how to use it accurately.”
CTVNews.ca Top Stories
America votes: How the election could impact the Canada-U.S. border
While America's southern border remains a hot button issue on the campaign trail, the result of the U.S. election in November could also impact the northern frontier with Canada, which remains the longest undefended border in the world.
Fluoride in drinking water poses enough risk to merit new EPA action, judge says
A federal judge has ordered the U.S. Environmental Protection Agency to further regulate fluoride in drinking water because high levels could pose a risk to the intellectual development of children.
Frequent drinking of fizzy beverages and fruit juice are linked to an increase risk of stroke: research
New data raises questions about the drinks people consume and the potential risks associated with them, according to researchers at Galway University in Ireland, in partnership with Hamilton’s McMaster University.
'Oct. 7 changed us': Palestinian Canadians with family in Gaza mark a year of war
Fedaa Nassar says any time she has heard the phone ring in the last year, she becomes overwhelmed with anxiety.
NDP house leader laments 'agents of chaos' in precarious Parliament
NDP House leader Peter Julian says there's more his party wants to do in Parliament before the next election, but if the current dysfunction continues it will become a factor in how they vote on a confidence measure.
Police arrest Toronto woman in connection with three recent homicides
Police have arrested a Toronto woman in connection with three recent homicides and investigators say that they believe two of the victims may have been 'randomly targeted.'
Trump is returning to the site of Pennsylvania assassination attempt for a rally with Vance and Musk
Former U.S. president Donald Trump plans to return Saturday to the site where a gunman tried to assassinate him in July, setting aside what are now near-constant worries for his physical safety in order to fulfill a promise — 'really an obligation,' he said recently — to the people of Butler, Pa.
Scientists looked at images from space to see how fast Antarctica is turning green. Here's what they found
Parts of icy Antarctica are turning green with plant life at an alarming rate as the region is gripped by extreme heat events, according to new research, sparking concerns about the changing landscape on this vast continent.
Missing B.C. climber died from fall on Mount Baker, medical examiner says
The body of a British Columbia mountain climber has been located and recovered after the 39-year-old man was reported missing during a solo climb on Washington state's Mount Baker earlier this week.