August 22nd - 24th in Toronto, Canada
Register Now for LinuxCon+ContainerCon North America 2016!
Monday, August 22 • 10:45am - 11:35am
CAT at Scale: Deploying Cache Isolation in a Mixed Workload Environment - Rohit Jnagal & David Lo, Google

Sign up or log in to save this to your schedule and see who's attending!

Intel introduced cache allocation technology (CAT) that allows partitioning of last-level cache to provide better micro-architectural isolation. Google deployed CAT using intel_rdt cgroup for mixed workloads in Borg. We experimented with various partitioning techniques for different workloads to get better performance and higher utilization.

Preventing batch tasks from affecting latency-sensitive tasks performance through static cache partitioning providing significant performance boost. Additionally, highly latency-sensitive tasks could reduce their footprint and share better when provided exclusive cache access.

In this talk, Rohit and David will cover the motivation for each use-case, describe pre-CAT strategies for interference in Borg, share CAT experiment results and performance/efficiency gains seen in production, interesting problems, and future work for isolation in Borg.

avatar for Rohit Jnagal

Rohit Jnagal

Google, Google
Software engineer at Google working on Technical Infrastructure. Worked on internal scheduling systems like Borg, Omega, and open-source Kubernetes. Developed internal and open-source version of container runtime LMCTFY. Worked on and maintained few other container projects: cAdvisor... Read More →
avatar for David Lo

David Lo

Software engineer at Google working on Technical Infrastructure. Worked on developing more energy efficient (PEGASUS, ISCA'14) and resource efficient (Heracles, ISCA'15) cluster management techniques.

Monday August 22, 2016 10:45am - 11:35am

Attendees (24)