We're sunsetting PodQuest on 2025-07-28. Thank you for your support!
Export Podcast Subscriptions
cover of episode Real World AI Agent Stories // Zach Wallace // #283

Real World AI Agent Stories // Zach Wallace // #283

2025/1/15
logo of podcast MLOps.community

MLOps.community

AI Deep Dive AI Chapters Transcript
People
Z
Zach Wallace
Topics
Zach Wallace: 我主导了Nearpod的数据平台转型,旨在解决数据分散和难以处理的问题。我们通过整合各种数据源,并利用DBT和Redshift等工具,实现了数据的有效处理和转换。我带领团队构建了一个数据产品交换平台,作为数据网格的基础,使得我们能够以一致、可靠和自信的方式处理大规模数据。虽然我们正在朝着完全的数据网格迈进,但目前仍处于过渡阶段,因为我们需要定义清晰的领域,并实现流式数据产品的传输。我认为数据产品是数据和数据定义的交集,它能够清晰地表达数据的含义和用途。

Deep Dive

Chapters
This chapter details Nearpod's journey of transforming its data platform using dbt and Redshift. It describes challenges with disparate data sources, the implementation of a data product exchange, and the transition towards a data mesh architecture.
  • Nearpod used dbt and Redshift to consolidate data from disparate sources.
  • They implemented a data product exchange, laying the groundwork for a data mesh.
  • The process involved ELT (Extract, Load, Transform) for real-time data updates.
  • Data products were defined as the intersection of data and its definition, enabling consistent data sharing across the system.

Shownotes Transcript

Machine Learning, AI Agents, and Autonomy // MLOps Podcast #283 with Zach Wallace, Staff Software Engineer at Nearpod Inc.

// Abstract Demetrios chats with Zach Wallace, engineering manager at Nearpod, about integrating AI agents in e-commerce and edtech. They discuss using agents for personalized user targeting, adapting AI models with real-time data, and ensuring efficiency through clear task definitions. Zach shares how Nearpod streamlined data integration with tools like Redshift and DBT, enabling real-time updates. The conversation covers challenges like maintaining AI in production, handling high-quality data, and meeting regulatory standards. Zach also highlights the cost-efficiency framework for deploying and decommissioning agents and the transformative potential of LLMs in education.

// Bio Software Engineer with 10 years of experience. Started my career as an Application Engineer, but I have transformed into a Platform Engineer. As a Platform Engineer, I have handled the problems described below

  • Localization across 6-7 different languages
  • Building a custom local environment tool for our engineers
  • Building a Data Platform
  • Building standards and interfaces for Agentic AI within ed-tech.

// MLOps Swag/Merch https://shop.mlops.community/

// Related Links https://medium.com/renaissance-learning-r-d/data-platform-transform-a-data-monolith-9d5290a552ef

--------------- ✌️Connect With Us ✌️ ------------- Join our slack community: https://go.mlops.community/slack Follow us on Twitter: @mlopscommunity Sign up for the next meetup: https://go.mlops.community/register Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/ Connect with Zach on LinkedIn: https://www.linkedin.com/in/zachary-wallace/