Caching (and cache invalidation) is often mentioned as one of the hardest problems in computer science. Caching can bring substantial performance improvements, but also contributes to complexity. As Datadog grew, it became untenable for teams to design and operate their own cache solutions. So a new team was created to design, build, and maintain a managed distributed in-memory caching service. In this session, we’ll show you inside our service that provides an easy way for over 2,000 engineers at Datadog to add fast caching to their apps in a scalable, reliable, and consistent manner.