5 Risks of Using ChatGPT for Financial Advice

Millions of people now turn to AI chatbots like ChatGPT, Anthropic’s Claude, and Google’s Gemini for financial guidance. I’ve done it myself. After feeding ChatGPT my monthly salary, utilities, and recurring bills, it generated several solid budgeting options that I refined into a tight, workable plan. But while these tools can feel like practical financial assistants, they come with serious limitations that deserve a closer look.

“ChatGPT can be a helpful tool for exploring options, preparing questions, and making financial topics easier to understand, but it is not a substitute for licensed financial professionals,” says Niko Felix, an OpenAI spokesperson. OpenAI’s Terms of Use explicitly state that the AI is not meant to replace professional financial advice. Beyond simple miscalculations, here are five risks to consider before relying on chatbots for money matters.

AI Still Confidently Outputs Incorrect Answers

When I ask ChatGPT for smarter money management advice, it responds with authority, laying out seemingly solid reasoning behind each bullet point. But chatbots can weave convincing errors into their outputs. OpenAI has reduced hallucination rates in recent models, but the problem persists. “There seems to be this sense emerging, at least among casual users, that the hallucination problem has been fixed,” says Srikanth Jagabathula, a professor of technology operations and statistics at NYU. “But that’s definitely not the case, because they’re fundamentally statistical machines. They don’t have a notion of a ground truth, or what is true.” One simple stress test is to ask the chatbot to double-check everything it just said. While this won’t confirm correctness, it often reveals flaws and leaves me increasingly skeptical about relying on bots for advice on any topic.

Yes-Bot May Affirm Preexisting Beliefs

Human financial advisors are cordial and professional, but they also push back on your preconceptions about saving, investing, and spending. Chatbots, by contrast, are known for being overly agreeable. “AI sycophancy is not merely a stylistic issue or a niche risk, but a prevalent behavior with broad downstream consequences,” reads a study published this year in the journal Science. “Although affirmation may feel supportive, sycophancy can undermine users’ capacity for self-correction and responsible decision-making.” While the study focused on interpersonal conflicts, the same concern applies to financial advice. When making money moves, I want guidance from someone who knows more than me, not a yes-bot offering easy affirmations.

Requires Sensitive Info for Better Results

To get the best tailored outputs, chatbots nudge users to share sensitive information. When I asked ChatGPT how to improve my budget further, it suggested uploading my complete financial history from the last few months. “You don’t have to upload everything,but yes, the more real data you share, the more accurate (and useful) the audit will be,” it said. “Upload CSVs or screenshots of bank account, credit cards. Then I can: categorize everything, calculate exact spending patterns, identify hidden leaks you wouldn’t notice, and build a precise monthly budget.” Unless you adjust your settings, all conversations with ChatGPT may be used by OpenAI to improve tools and train future models. Visit the “data controls” tab to opt out. Even then, uploading sensitive financial data to a platform that isn’t a banking app carries inherent risk.

Bots Lack Accountability

Jagabathula views ChatGPT as a worthwhile part of your toolkit, especially during early-stage exploration of topics like tax strategies or investment ideas. But high-stakes decisions require human expertise. “A human expert in the loop is super critical,” he says. “Especially for the last mile, you’re actually going from idea generation to taking action. Somebody needs to review the plan, adjust it, and correct it if necessary.” Chatbots can help you brainstorm, but they cannot be held responsible for bad advice. That accountability rests entirely with you.