Why Off-the-Shelf AI Doesn't Understand Money - Udi Menkes, Intuit

AI Engineer19m 50s
Udi Menkes in a blue shirt beside the headline “FINANCIAL AI NEEDS OUTCOMES” on a black background.
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Off-the-shelf LLMs can sound confident about financial decisions while changing a recommendation after small input changesModel reliability is the degree to which an AI model produces dependable behavior across repeated, varied and operationally realistic use.. In anonymized business examples, Udi Menkes argues that generic growth advice can miss cash-flow pressure, customer concentration or a vendor's role in generating revenue.

    The proposed method derives business states, actions and later outcomes from comparable records. It uses causal comparisonsCausal inference investigates how changing one factor affects an outcome, rather than treating an observed correlation as proof of cause. to distinguish correlation from the effect of a decision, lets a general model propose possible actions, and applies an outcome-trained model to assess them. The central distinction is between adding more context and learning from observed results.

    The broader lesson is to evaluate AI recommendations against outcomesEvaluation is the systematic assessment of a system's behaviour or results against explicit criteria. that can be checked in a given domain and to present them with enough context for people to understand the reasoning and make their own decisions.

    Original YouTube thumbnailWatch on YouTube

    Video topic coverage

    • Agents & workflows25
    • Coding & tools0
    • Models & learning75
    • Infrastructure & compute10
    • Research & evaluation100
    • Safety & security25
    • Business & productivity100
    • Creative & media0
    • Robotics & perception0
    • Society & policy0

    Share this video

    Udi Menkes in a blue shirt beside the headline “FINANCIAL AI NEEDS OUTCOMES” on a black background. With WWW.ARTIFICIAL-INTELLIGENCE.VIDEO, 29 July 2026 and duration 19m 50s.

    Generic LLMs can give confident but unstable financial suggestions; this talk proposes using comparable business histories and observed outcomes to assess possible actions.