Blog

OpenSearch Sessions at re:Invent

Nov 24 • news

Wondering what sessions to attend at re:Invent to learn more about OpenSearch? We've got you covered! Here are the top 6 sessions to attend this year at re:Invent to deepen...

Building custom threat detection rules with OpenSearch Security Analytics

Nov 21 • feature, technical-posts

The threat detection rules scan log data to produce security findings representing potential threats. Security Analytics provides more than 2,200 prepackaged, open-source Sigma rules to help you identify potential security...

Secrets to improving ingestion with OpenSearch

Nov 20 • ingestion, clients

While most of the optimization secrets I’m sharing with you aren’t intentionally hidden, they sure felt hidden to me when I started with OpenSearch.

Optimize OpenSearch Refresh Interval

Nov 13 • technical-posts

Learn how to optimize the refresh interval of an OpenSearch index and strike a balance between the speed at which indexed information is available for search with CPU and I/O...

What in the ML is going on around here?

Nov 02 • technical

Going from a vanilla install of OpenSearch to having vectorized text stored in a k-NN–enabled index seemed like a quick learning exercise. On paper, it almost looked easy. Upload a...

Introducing a traffic capture and replay solution for OpenSearch migrations and upgrades

Oct 26 • technical-post

We are thrilled to introduce the beta release of a live traffic capture and replay solution designed to assist users in migrating to OpenSearch. This tool equips users to capture...

Efficient filtering in OpenSearch vector engine

Oct 18 • technical-posts

With the release of OpenSearch 2.9, we introduced efficient filtering, or “filter-while-search,” functionality for queries using the Facebook AI Similarity Search (Faiss) engine. This update overcomes the previous limitations of...

Introducing concurrent segment search in OpenSearch

Oct 18 • search, technical-post

OpenSearch is a scalable, flexible, and extensible open-source search and analytics engine. It is built on top of Apache Lucene and uses its powerful capabilities to ingest user data and...

Get started with OpenSearch 2.11

Oct 16 • releases

OpenSearch 2.11 is now available, with exciting new capabilities for observability applications, an expanded selection of search tools, enhancements to data durability, and more, along with new experimental functionality to...

Announcing Data Prepper 2.5.0

Oct 11 • releases

Data Prepper 2.5.0 is now available for download. This release includes a new OpenSearch source, new dissect and translate processors, and additions to the existing key-value processor.

Byte-quantized vectors in OpenSearch

Oct 09 • technical-posts

In OpenSearch k-NN plugin when we index and query vectors of type float, each vector element occupies 4 bytes. This is getting expensive in terms of memory and storage, especially...

Growth and community take the spotlight at OpenSearchCon 2023

Oct 06 • community

More than 300 attendees—an increase of 60% year-over-year—arrived at the Sheraton Grand Seattle for 3 days of connecting, sharing, and learning with the OpenSearch community. We renewed old friendships and...

New IP2Geo processor with automatic update in OpenSearch

Oct 04 • technical-posts

When you host a service across geographic regions, it often helps to understand load patterns from various geographies. In many cases it helps to analyze anomalies and attacks. Starting with...

Improve search relevance with hybrid search, generally available in OpenSearch 2.10

Oct 04 • technical-posts

In an earlier blog post, a group of Amazon scientists and engineers described methods of combining keyword-based search with dense vector search in order to improve search relevance. With OpenSearch...

Improved durability in OpenSearch with remote-backed storage

Sep 27 • community

We are excited to announce remote-backed storage, a new feature that enables request-level durability with remote storage options like Amazon Simple Storage Service (Amazon S3), Oracle Cloud Infrastructure Object Storage,...