Journey to a 750-Node Cluster: Why Mastering Allocation and Routing in OpenSearch is the Key to Successfully Achieving Massive Scale

In this talk we will present OCI OpenSearch case study and learnings as we built our biggest cluster to date of 750 nodes and 165,000+ shards. This cluster we assume is one of the largest ever built and hosted by a service, this also means that we had the chance of stretching OpenSearch to it’s limit and we would like to share some of our lessons primarily around shards allocations, bottlenecks we encountered and how we overcome them.