AI chatbots get divorce law wrong
Reading time: 1 minute
Shane McCann
AI chatbots answer questions about divorce law in Northern Ireland and the UK with an “unacceptable level of accuracy”, Belfast-based SG Murphy Solicitors has warned.
The firm found put ChatGPT and Google Bard to the test, asking a series of questions about divorce law and asking the chatbots to draft documents such as a matrimonial separation agreement and a divorce petition.
ChatGPT provided insufficient detail in 50 per cent of its responses and Bard provided insufficient detail in 70 per cent, the firm said, while both chatbots generated factually incorrect answers one in five times.
Shane McCann, managing director at SG Murphy, said: “This is an unacceptable level of accuracy. With both AI chatbots being freely available to the public, this inconsistency poses a real threat to misinformed individuals who may take these answers at face value, to save both time and money.”
He added: “Ultimately, we do not feel that chatbots like ChatGPT-3 and Bard will take over from experienced lawyers any day soon. The responses are usually not detailed enough, and the level of incorrect answers is far too high.”
Share this article:
Subscribe to our newsletter to not miss articles like this one:
SUBSCRIBE
