We're sunsetting PodQuest on 2025-07-28. Thank you for your support!
Export Podcast Subscriptions
cover of episode DoK Talks #101- Redpanda: how to build a storage engine for kubernetes // Alexander Gallego

DoK Talks #101- Redpanda: how to build a storage engine for kubernetes // Alexander Gallego

2021/11/12
logo of podcast Data on Kubernetes Community

Data on Kubernetes Community

Shownotes Transcript

https://go.dok.community/slack) https://dok.community/)

ABSTRACT OF THE TALK

How to build a stateful, transactional streaming storage engine on top of kubernetes.

KEY TAKE-AWAYS FROM THE TALK

  1. Building storage engines in kubernetes is hard
  2. You need tiered storage (S3 or google cloud bucket, Azure Blob) for total disaster recovery
  3. You also need sound replication inside the cluster
  4. You need a simple architecture so you can scale the pods easily

BIO

Alex Gallego is the founder and CEO of Vectorized, where he & the team hack on Redpanda, a modern streaming platform for mission critical workloads. Prior to Vectorized, he was a principal engineer at Akamai, as well as co-founder and CTO of Concord.io, a high performance stream processing engine built in C++ and acquired by Akamai in 2016.