We're sunsetting PodQuest on 2025-07-28. Thank you for your support!
Export Podcast Subscriptions
cover of episode 169: HyperLogLog

169: HyperLogLog

2023/11/27
logo of podcast Programming Throwdown

Programming Throwdown

Shownotes Transcript

Intro topic: Testing your car battery

News/Links:

Book of the Show

 

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h)

Tool of the Show

Topic: HyperLogLog

  • Motivation

  • Cardinality Counting

  • LinearCounting

  • Hash + expectation of collision based on how full

  • Bloom Filter

  • LogLog

  • Use first N bits as bucket

  • Use max sequential 0s in each bucket

  • Average

  • HyperLogLog

  • Handle empty buckets

  • Use correction factor like linear counting for low counts (number of empty buckets) and high counts

  • Distributing

  • Transfer bucket counts

** ★ Support this podcast on Patreon ★) **