A leading expert on Artificial Intelligence has warned that safety measures need to be put in place to deal with the increasing use of AI for therapy and the Government needs to consider a ban on some AI therapy.
Professor Barry O'Sullivan from the School of Computer Science in UCC was speaking on RTÉ's Behind the Story news podcast following an interview with Laura Reiley, an American woman who lost her daughter to suicide in February this year.
Ms Reiley discovered her daughter Sophie, had been using ChatGPT AI Therapist called ‘Harry’ in the months before her death. The AI chatbot had helped Sophie write the suicide note she left her parents.
Prof O’Sullivan said there are increasing concerns around the use of AI as therapy.
"Almost on a weekly basis, people are reaching out to me about, ‘What should I do, who should I see?" he told podcast hosts Katie Hannon and Paul Cunningham.
"What they’re looking for is a referral to a professional who can deal with this kind of thing – a human therapist who actually knows how to intervene.
"This problem isn’t going to go away".
Read more: The real-life dangers of AI therapy
Prof O’Sullivan said the impact of building online relationships need to be considered, "particularly if there’s a therapeutic nature or a cry for help".
"I think something really needs to be done there, and if guardrails don’t cut it I think we do need to look seriously at what they’re doing in Illinois – which I think is quite inspired," he said.
The US state recently brought in legislation prohibiting AI therapy, which it says, "protect patients from unregulated and unqualified AI products, while also protecting the jobs of Illinois’ thousands of qualified behavioural health providers."
Prof O’Sullivan, who is a member of the Government’s AI Advisory Council, was speaking in a personal capacity but he explained that when they issued recommendations about AI in February this year, a warning about AI therapy was not included.
"I think frankly the impact of these technologies on societies is so fast-paced that my recollection is that we weren’t even talking about AI Therapy or AI psychosis back then, that this wasn’t a thing," he said.
"I don’t think the Council was concerning itself at that point with issues around psychosis and of course I think it does need to do that, I think it is something that needs to be looked at because it’s becoming critically important".
The AI Advisory Council consists of 15 voluntary members including Prof O’Sullivan, but he said a dedicated office is now needed.
"Ireland needs a dedicated AI Advisory Office, a professional office, that is a watchdog and providing independent advice on the other".
You can listen to Behind the Story which is available on the RTÉ Radio Player.
You can also find episodes on Apple here, or on Spotify here.
