from Hacker News

Predictive CPU isolation of containers at Netflix (2019)

by Cwizard on 4/8/24, 10:35 PM with 21 comments

  • by high_na_euv on 4/9/24, 9:55 AM

    It seems like we are more and more getting away from OSes managing our resources

    Runtimes/vms implement memory management, varius threading techniques and things like we see here

    Maybe in the future we will entirely skip OS's overhead and run apps directly on HW and they will manager themselves more efficiently (their runtimes/vms like jvm clr)

  • by shadowpho on 4/9/24, 3:13 AM

    This is amazing, they use ML to predict utilization on the fly

  • by dang on 4/10/24, 9:55 PM

    Related:

    Predictive CPU isolation of containers at Netflix using a MIP solver - https://news.ycombinator.com/item?id=21116565 - Sept 2019 (21 comments)

    Predictive CPU Isolation of Containers at Netflix - https://news.ycombinator.com/item?id=20096699 - June 2019 (1 comment)

  • by yencabulator on 4/10/24, 9:11 PM

  • by Sparkyte on 4/9/24, 10:56 AM

    Kind of an old article. It is pretty straight forward thing to do. If you spend enough time accurately load testing your environments you can dial in the container resources and shave thousands of dollars. Lots of places are too scared of under allocating. Limit and request exist for a reason. Limit is for surge and request is what is always guaranteed. It is okay to exceed your request as long as you balance add a scaling policy to balance out the surge. And be cautious with request and limit on memory not all applications benefit from this.