We're sunsetting PodQuest on 2025-07-28. Thank you for your support!
Export Podcast Subscriptions
cover of episode Building Trust in AI: Chatbots, LLMs, Decentralized Finance, and JPMorgan Chase

Building Trust in AI: Chatbots, LLMs, Decentralized Finance, and JPMorgan Chase

2025/3/26
logo of podcast The Brave Technologist

The Brave Technologist

AI Deep Dive AI Chapters Transcript
People
J
James Massa
Topics
我坚信,在金融科技领域,对AI的信任至关重要。负责任的AI应该像值得信赖的员工一样,能够胜任工作并遵守规则。我们可以通过类似面试、背景调查和参考检查等方式来评估LLM的可靠性。 我专注于构建可信赖的AI,特别是应用于区块链和去中心化金融领域,以应对其中存在的信任问题。我们通过分析代码漏洞、可疑交易、异常价格变化和社交媒体情绪等多个维度来评估去中心化金融项目的信任度,并为其分配信任分数。 为了确保聊天机器人只提供经过批准的答案,我们使用检索增强生成(RAG)技术,并设置防火墙或护栏来审查输入和输出,从而最大限度地减少风险。RAG技术通过将预先批准的文档转换为向量数据库,并根据向量相似度来匹配问题和答案,确保答案的准确性和安全性。 在金融领域应用AI时,我们更关注的是避免出现假阴性结果(即遗漏),也就是保证召回率,而不是追求精确率(即每次都正确)。我们需要持续监控模型的性能,以确保其在数据变化或模型更新后仍然保持有效性。 在AI应用中,合规性至关重要,需要多方审查和严格的治理流程,尤其是在全球范围内,各国法规差异较大。我们需要尽量减少AI系统的规模和复杂性,以降低风险和合规成本。 未来,人类专家将更多地扮演AI管理者的角色,监督和协调AI系统的工作。在软件工程领域,我们可以利用多个AI代理来完成软件开发生命周期中的不同阶段的任务,从而提高效率。在聊天机器人领域,AI代理可以实现端到端的流程自动化,例如直接完成订票等任务。 加密货币和AI的未来融合,很大程度上取决于两者的监管政策的明朗化和全球一致性。组织在采用AI技术时,需要权衡创新速度和风险控制之间的关系,并根据自身情况选择合适的策略。

Deep Dive

Shownotes Transcript

James Massa, Senior Executive Director of Engineering and Architecture at JPMorgan Chase—and holder of six AI-related patents—emphasizes the evolving role of human experts in managing AI technologies and offers insights into the future convergence of AI and crypto. He also shares how major financial institutions are implementing guardrails around their AI systems, using techniques like retrieval augmented generation (RAG) with enterprise chatbots. Key Takeaways: 

How he’s succeeded in applying trust scores to blockchain and DeFi projects by analyzing code vulnerabilities, suspicious transactions, and social media sentiment

Using retrieval augmented generation (RAG) to ensure chatbots provide only pre-approved responses

Balancing precision (always giving correct results) with recall (not missing any compliance issues)

The importance of trust in AI, particularly in the context of blockchain and decentralized finance

A practical roadmap for organizations navigating the AI revolution, bridging the gap between innovation and responsible governance

Guest Bio: James Massa) is the Senior Executive Director of Engineering and Architecture at JPMorganChase. He holds six patents covering subjects such as AI Data Quality, cloud cost management, multi-teacher LLM distillation, and model self-healing. In 2024, James led a team that won the FSTech award for Best Financial Services IT Team, migrated 53 apps to AWS, published two IEEE papers on LLM blockchain security, and presented 14 keynotes, including one at UCSD. He holds a master’s degree from the computer science department of Harvard University, and a master’s degree in finance from the City University of New York.  

About this Show: The Brave Technologist is here to shed light on the opportunities and challenges of emerging tech. To make it digestible, less scary, and more approachable for all! Join us as we embark on a mission to demystify artificial intelligence, challenge the status quo, and empower everyday people to embrace the digital revolution. Whether you're a tech enthusiast, a curious mind, or an industry professional, this podcast invites you to join the conversation and explore the future of AI together. The Brave Technologist Podcast) is hosted by Luke Mulks, VP Business Operations at Brave Software—makers of the privacy-respecting Brave browser and Search engine, and now powering AI everywhere with the Brave Search API. Music by: Ari Dvorin)

Produced by: Sam Laliberte)