Top
Best
New

Posted by 1vuio0pswjnm7 1 day ago

AI chatbots give wrong answers to financial queries 'most of the time'(www.ft.com)
154 points | 88 commentspage 3
johnnienaked 1 day ago|
I can attest to this. It's so odd that a technology can solve a millennium math problem but completely messes up pretty basic financial calculations.
demibabs 1 day ago||
I like how FT makes me accept cookies from their 46 “technology” (advertising) partners before showing me that the article is behind a paywall anyway.
Good4boothee 1 day ago||
To be fair those are rookie numbers. Nothing says "we value your privacy" as GDPR cookie banner with 1k+ "partners" list.
jb1991 1 day ago||
You actually like that? I find it kind of annoying.
Wololooo 1 day ago||
No they do not like it, it is a figure of speech to underline how much they do not like it.
onetokeoverthe 1 day ago||
that figure of speech is called sarcasm.

very popular on Earth.

yieldcrv 1 day ago||
Tool calling solves this
SyneRyder 1 day ago||
Another summary report here, for those who can't get past the paywall:

https://www.financialreporter.co.uk/ai-models-give-wrong-fin...

Much of the testing is on Haiku and Luna, and criticizing the quality of free AI (!). But they do claim Opus 5 with reasoning still failed 39% of their financial questions.

emsign 1 day ago||
Not a surprise, so do financial advisors: garbage in = garbage out.
sreekanth850 1 day ago||
[dead]
dvflas 1 day ago||
[dead]
zikalify 1 day ago||
[dead]
throwawayffffas 1 day ago|
In my experience AI chatbots give wrong answers to all queries most of the time.

Getting results requires a harness like in coding and objective metrics, like tests.

hdhdjdif 1 day ago|
I have been trying to use chatbots for a relatively simple data organization task a child could do since gpt came out. Every single model gets it wrong in different ways.

Yet every time I open this website someone is trying to sell me that chatgpt solved abstract mathematics.

postflopclarity 1 day ago||
if it is truly a "relatively simple data organization task a child could do" then I simply don't believe that claude/codex are not capable of it. you are probably using the tools ineffectively.
hdhdjdif 1 day ago||
yeah, I bet