reindex_remote_whitelist Whitelisted addresses for reindexing. Changing this value will cause all OpenSearch instances to restart. |
http.max_content_length Maximum content length for HTTP requests to the OpenSearch HTTP API, in bytes. |
http.max_header_size The max size of allowed headers, in bytes |
http.max_initial_line_length The max length of an HTTP URL, in bytes |
indices.query.bool.max_clause_count Maximum number of clauses Lucene BooleanQuery can have. The default value (1024) is relatively high, and increasing it may cause performance issues. Investigate other approaches first before increasing this value. |
search.max_buckets Maximum number of aggregation buckets allowed in a single response. OpenSearch default value is used when this is not defined. |
indices.fielddata.cache.size Relative amount. Maximum amount of heap memory used for field data cache. This is an expert setting; decreasing the value too much will increase overhead of loading field data; too much memory used for field data cache will decrease amount of heap available for other operations. |
indices.memory.index_buffer_size Percentage value. Default is 10%. Total amount of heap used for indexing buffer, before writing segments to disk. This is an expert setting. Too low value will slow down indexing; too high value will increase indexing performance but causes performance issues for query performance. |
indices.memory.min_index_buffer_size Absolute value. Default is 48mb. Doesn't work without indices.memory.index_buffer_size. Minimum amount of heap used for query cache, an absolute indices.memory.index_buffer_size minimal hard limit. |
indices.memory.max_index_buffer_size Absolute value. Default is unbound. Doesn't work without indices.memory.index_buffer_size. Maximum amount of heap used for query cache, an absolute indices.memory.index_buffer_size maximum hard limit. |
indices.queries.cache.size Percentage value. Default is 10%. Maximum amount of heap used for query cache. This is an expert setting. Too low value will decrease query performance and increase performance for other operations; too high value will cause issues with other OpenSearch functionality. |
indices.recovery.max_bytes_per_sec Limits total inbound and outbound recovery traffic for each node. Applies to both peer recoveries as well as snapshot recoveries (i.e., restores from a snapshot). Defaults to 40mb |
indices.recovery.max_concurrent_file_chunks Number of file chunks sent in parallel for each recovery. Defaults to 2. |
action.auto_create_index Explicitly allow or block automatic creation of indices. Defaults to true |
plugins.alerting.filter_by_backend_roles Enable or disable filtering of alerting by backend roles. Requires Security plugin. Defaults to false |
knn.memory.circuit_breaker.limit Maximum amount of memory in percentage that can be used for the KNN index. Defaults to 50% of the JVM heap size. 0 is used to set it to null which can be used to invalidate caches. |
knn.memory.circuit_breaker.enabled Enable or disable KNN memory circuit breaker. Defaults to true. |
Opensearch Security Plugin Settings |
| internal_authentication_backend_limiting.type The type of rate limiting | internal_authentication_backend_limiting.authentication_backend The internal backend. Enter internal | internal_authentication_backend_limiting.allowed_tries The number of login attempts allowed before login is blocked | internal_authentication_backend_limiting.time_window_seconds The window of time in which the value for allowed_tries is enforced | internal_authentication_backend_limiting.block_expiry_seconds The duration of time that login remains blocked after a failed login | internal_authentication_backend_limiting.max_blocked_clients The maximum number of blocked IP addresses | internal_authentication_backend_limiting.max_tracked_clients The maximum number of tracked IP addresses that have failed login |
|
|
Enable/Disable security audit |
Enable/Disable snapshot API for custom repositories, this requires security management to be enabled |
search thread pool size Size for the thread pool. See documentation for exact details. Do note this may have maximum value depending on CPU count - value is automatically lowered if set to higher than maximum value. |
search_throttled thread pool size Size for the thread pool. See documentation for exact details. Do note this may have maximum value depending on CPU count - value is automatically lowered if set to higher than maximum value. |
Size for the thread pool. See documentation for exact details. Do note this may have maximum value depending on CPU count - value is automatically lowered if set to higher than maximum value. |
analyze thread pool size Size for the thread pool. See documentation for exact details. Do note this may have maximum value depending on CPU count - value is automatically lowered if set to higher than maximum value. |
write thread pool size Size for the thread pool. See documentation for exact details. Do note this may have maximum value depending on CPU count - value is automatically lowered if set to higher than maximum value. |
force_merge thread pool size Size for the thread pool. See documentation for exact details. Do note this may have maximum value depending on CPU count - value is automatically lowered if set to higher than maximum value. |
search thread pool queue size Size for the thread pool queue. See documentation for exact details. |
search_throttled thread pool queue size Size for the thread pool queue. See documentation for exact details. |
Size for the thread pool queue. See documentation for exact details. |
analyze thread pool queue size Size for the thread pool queue. See documentation for exact details. |
write thread pool queue size Size for the thread pool queue. See documentation for exact details. |
Require explicit index names when deleting |
cluster.max_shards_per_node Controls the number of shards allowed in the cluster per data node |
compatibility.override_main_response_version Compatibility mode sets OpenSearch to report its version as 7.10 so clients continue to work. Default is false |
Script max compilation rate - circuit breaker to prevent/minimize OOMs Script compilation circuit breaker limits the number of inline script compilations within a period of time. Default is use-context |
How many concurrent incoming/outgoing shard recoveries (normally replicas) are allowed to happen on a node. Defaults to node cpu count * 2. |
This should be identical to the Sender name defined in Opensearch dashboards |
Sender username for Opensearch alerts |
Sender password for Opensearch alerts to authenticate with SMTP server |
Specifies whether ISM is enabled or not |
Specifies whether audit history is enabled or not. The logs from ISM are automatically indexed to a logs document. |
The maximum age before rolling over the audit history index in hours |
- min:
1 - max:
9223372036854776000
The maximum number of documents before rolling over the audit history index. |
The time between rollover checks for the audit history index in hours. |
How long audit history indices are kept in days. |
Search Backpressure Settings |
The search backpressure mode. Valid values are monitor_only, enforced, or disabled. Default is monitor_only | Node duress settings | The CPU usage threshold (as a percentage) required for a node to be considered to be under duress. Default is 0.9 | The heap usage threshold (as a percentage) required for a node to be considered to be under duress. Default is 0.7 | The number of successive limit breaches after which the node is considered to be under duress. Default is 3 |
| Search task settings | The maximum number of search tasks to cancel in a single iteration of the observer thread. Default is 5.0 | The maximum number of search tasks to cancel per millisecond of elapsed time. Default is 0.003 | The maximum number of search tasks to cancel, as a percentage of successful search task completions. Default is 0.1 | The CPU usage threshold (in milliseconds) required for an individual parent task before it is considered for cancellation. Default is 30000 | The elapsed time threshold (in milliseconds) required for an individual parent task before it is considered for cancellation. Default is 45000 | The window size used to calculate the rolling average of the heap usage for the completed parent tasks. Default is 10 | The heap usage threshold (as a percentage) required for an individual parent task before it is considered for cancellation. Default is 0.2 | The heap usage variance required for an individual parent task before it is considered for cancellation. A task is considered for cancellation when taskHeapUsage is greater than or equal to heapUsageMovingAverage * variance. Default is 2.0 | The heap usage threshold (as a percentage) required for the sum of heap usages of all search tasks before cancellation is applied. Default is 0.5 |
| Search shard settings | The maximum number of search tasks to cancel in a single iteration of the observer thread. Default is 10.0 | The maximum number of tasks to cancel per millisecond of elapsed time. Default is 0.003 | The maximum number of tasks to cancel, as a percentage of successful task completions. Default is 0.1 | The CPU usage threshold (in milliseconds) required for a single search shard task before it is considered for cancellation. Default is 15000 | The elapsed time threshold (in milliseconds) required for a single search shard task before it is considered for cancellation. Default is 30000 | The number of previously completed search shard tasks to consider when calculating the rolling average of heap usage. Default is 100 | The heap usage threshold (as a percentage) required for a single search shard task before it is considered for cancellation. Default is 0.5 | The minimum variance required for a single search shard task’s heap usage compared to the rolling average of previously completed tasks before it is considered for cancellation. Default is 2.0 | The heap usage threshold (as a percentage) required for the sum of heap usages of all search shard tasks before cancellation is applied. Default is 0.5 |
|
|
Shard indexing back pressure settings |
Enable or disable shard indexing backpressure. Default is false | Run shard indexing backpressure in shadow mode or enforced mode.
In shadow mode (value set as false), shard indexing backpressure tracks all granular-level metrics,
but it doesn’t actually reject any indexing requests.
In enforced mode (value set as true),
shard indexing backpressure rejects any requests to the cluster that might cause a dip in its performance.
Default is false | Primary parameter | | Node soft limit Define the percentage of the node-level memory
threshold that acts as a soft indicator for strain on a node.
Default is 0.7 |
| | Shard min limit Specify the minimum assigned quota for a new shard in any role (coordinator, primary, or replica).
Shard indexing backpressure increases or decreases this allocated quota based on the inflow of traffic for the shard.
Default is 0.001 |
|
| Operating factor | Specify the lower occupancy limit of the allocated quota of memory for the shard.
If the total memory usage of a shard is below this limit,
shard indexing backpressure decreases the current allocated memory for that shard.
Default is 0.75 | Specify the optimal occupancy of the allocated quota of memory for the shard.
If the total memory usage of a shard is at this level,
shard indexing backpressure doesn’t change the current allocated memory for that shard.
Default is 0.85 | Specify the upper occupancy limit of the allocated quota of memory for the shard.
If the total memory usage of a shard is above this limit,
shard indexing backpressure increases the current allocated memory for that shard.
Default is 0.95 |
|
|
|
Top N queries monitoring by CPU | Enable or disable top N query monitoring by the metric | Specify the value of N for the top N queries by the metric | Configure the window size of the top N queries |
| Top N queries monitoring by latency | Enable or disable top N query monitoring by the metric | Specify the value of N for the top N queries by the metric | Configure the window size of the top N queries |
| Top N queries monitoring by memory | Enable or disable top N query monitoring by the metric | Specify the value of N for the top N queries by the metric | Configure the window size of the top N queries |
|
|
cluster.routing.allocation.balance.prefer_primary When set to true, OpenSearch attempts to evenly distribute the primary shards between the cluster nodes. Enabling this setting does not always guarantee an equal number of primary shards on each node, especially in the event of a failover. Changing this setting to false after it was set to true does not invoke redistribution of primary shards. Default is false. |
Watermark settings |
Low watermark (percentage) The low watermark for disk usage. | The high watermark for disk usage. | The flood stage watermark for disk usage. |
|
Segment Replication Backpressure Settings |
segrep.pressure.enabled Enables the segment replication backpressure mechanism. Default is false. | The maximum amount of time that a replica shard can take to copy from the primary shard. Once segrep.pressure.time.limit is breached along with segrep.pressure.checkpoint.limit, the segment replication backpressure mechanism is initiated. Default is 5 minutes. | The maximum number of indexing checkpoints that a replica shard can fall behind when copying from primary. Once segrep.pressure.checkpoint.limit is breached along with segrep.pressure.time.limit, the segment replication backpressure mechanism is initiated. Default is 4 checkpoints. | The maximum number of stale replica shards that can exist in a replication group. Once segrep.pressure.replica.stale.limit is breached, the segment replication backpressure mechanism is initiated. Default is .5, which is 50% of a replication group. |
|
|
The default value of the translog buffer interval used when performing periodic translog updates. This setting is only effective when the index setting index.remote_store.translog.buffer_interval is not present. Defaults to 650ms. | Sets the maximum number of open translog files for remote-backed indexes. This limits the total number of translog files per shard. After reaching this limit, the remote store flushes the translog files. Default is 1000. The minimum required is 100. | The amount of time to wait for the cluster state upload to complete. Defaults to 20s. | The amount of time to wait for the manifest file upload to complete. The manifest file contains the details of each of the files uploaded for a single cluster state, both index metadata files and global metadata files. Defaults to 20s. |
|
|
Enables remote segment backpressure. Default is true | The minimum consecutive failure count for activating remote segment backpressure. Defaults to 5. | The variance factor that is used together with the moving average to calculate the dynamic bytes lag threshold for activating remote segment backpressure. Defaults to 10. | The variance factor that is used together with the moving average to calculate the dynamic time lag threshold for activating remote segment backpressure. Defaults to 10. |
|
Defines a limit of how much total remote data can be referenced as a ratio of the size of the disk reserved for the file cache. This is designed to be a safeguard to prevent oversubscribing a cluster. Defaults to 0. |
Defines a limit of how much total remote data can be referenced as a ratio of the size of the disk reserved for the file cache. This is designed to be a safeguard to prevent oversubscribing a cluster. Defaults to 5gb. Requires restarting all OpenSearch nodes. |
|
Log level | | Debug threshold for total request took time. The value should be in the form count and unit, where unit one of (s,m,h,d,nanos,ms,micros) or -1. Default is -1 | Info threshold for total request took time. The value should be in the form count and unit, where unit one of (s,m,h,d,nanos,ms,micros) or -1. Default is -1 | Trace threshold for total request took time. The value should be in the form count and unit, where unit one of (s,m,h,d,nanos,ms,micros) or -1. Default is -1 | Warning threshold for total request took time. The value should be in the form count and unit, where unit one of (s,m,h,d,nanos,ms,micros) or -1. Default is -1 |
|
|
Enable remote-backed storage |
Enable searchable snapshots |