A recent study by The College Investor revealed that Google’s AI-generated summaries are inaccurate or misleading in 43% of finance-related queries, posing risks for users making important financial decisions.
While Google’s AI can handle simple questions well, it often misrepresents complex topics—such as tax rules, student loan plans, and investment products—due to outdated or incorrect information. These inaccuracies highlight the potential dangers of relying on Google’s AI for “Your Money or Your Life” (YMYL) queries, which can directly impact users’ financial health and well-being.
‘YMYL’ queries refer to searches that affect critical areas of a person’s life—namely health, finances, safety, and overall well-being.
It's an appropriate label because users could make weighty life decisions based on the kind of information they find when searching for these topics, they also make up a considerable number of the search queries processed each month
While some of Google's early attempts at the AI summary bordered on comical, there have been updates in the last few months that have improved their accuracy and relevance. That said, inaccuracies in response to YMYL queries have the potential to be much more serious than the funny answers to niche questions being served in the early days of AI search results. The nature of these searches revolves around subjects that have long-term effects on the lives of users, so a wrong step has bigger consequences.
The risks here are especially high for inexperienced users who may not double-check what they read on the internet or rely on Google’s AI-generated answers without looking further.
Out of 100 queries examined, 57 were verified to be correct, while 43 were deemed misleading, missing key information or incorrect.
Google fared well at more straightforward questions (eg. ‘what is’ or ‘how to’) and seemed to have more accurate answers about banking and insurance, where information is more concrete.
The AI summary struggled with more complicated questions on personal finance, like tax, investing and student loans. The topics tend to be more specific to each person's circumstances, so it makes sense that AI would struggle to respond to these kinds of questions in an actionable way for that user.
Business Insider reached out to Google for comment on similar issues and was told that the “vast majority of AI Overviews provide high-quality information.” Whilst this is partly true, the consequences of YML queries being served with misinformation almost half the time need to be considered.
To address this, AI systems should implement stricter measures when generating responses to complex YMYL queries. This could include limiting AI responses for nuanced financial and legal matters or encouraging users to seek information from trusted financial institutions and licensed professionals for critical guidance.
At a minimum, search engines should consider attaching disclaimers to AI-generated answers on YMYL topics, reminding users to verify with qualified experts before taking action.
Ultimately, while AI has great potential to democratise information access, it must be held to a higher standard of responsibility for YMYL content.
Proud to partner with
