AI Models Exhibit High Error Rates in Financial Advice
- AI models provided incorrect answers to financial questions an average of 57% of the time.
- The error rate increased to 88% for complex queries requiring multiple calculations.
- In one instance, a pension-tax error could have led to an HMRC charge of £17,500, approximately $23,430.
- Some models had error rates as high as 99% for complicated financial questions.
- Paid AI models generally showed better accuracy compared to free versions.
The study highlights significant risks associated with using AI for financial guidance, especially given that many users trust these models for critical decisions regarding taxes and investments without adequate regulation or protection.
With errors reaching up to 99% on complex queries, reliance on AI for financial advice poses substantial risks to users’ finances. (Source)
