Skip to content

Commit 6a9aba8

Browse files
CopilotWenyXu
andcommitted
Move Noop WAL to separate page and reduce use of info/warning boxes
Co-authored-by: WenyXu <[email protected]>
1 parent 517bd52 commit 6a9aba8

File tree

7 files changed

+113
-122
lines changed

7 files changed

+113
-122
lines changed

docs/user-guide/deployments-administration/wal/local-wal.md

Lines changed: 1 addition & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -22,46 +22,14 @@ If you are using Helm Chart to deploy GreptimeDB, you can refer to [Common Helm
2222

2323
| Configuration Option | Description | Default Value |
2424
| -------------------- | -------------------------------------------------------------------------------------------------------------------- | ----------------- |
25-
| `provider` | The provider of the WAL. Options: `raft_engine` (local file system storage), `kafka` (remote WAL storage in Kafka), or `noop` (no-op WAL provider) | `"raft_engine"` |
25+
| `provider` | The provider of the WAL. Options: `raft_engine` (local file system storage), `kafka` (remote WAL storage in Kafka), or `noop` (no-op WAL provider, see [Noop WAL](/user-guide/deployments-administration/wal/noop-wal.md)) | `"raft_engine"` |
2626
| `dir` | The directory where to write logs | `{data_home}/wal` |
2727
| `file_size` | The size of single WAL log file | `128MB` |
2828
| `purge_threshold` | The threshold of the WAL size to trigger purging | `1GB` |
2929
| `purge_interval` | The interval to trigger purging | `1m` |
3030
| `read_batch_size` | The read batch size | `128` |
3131
| `sync_write` | Whether to call fsync when writing every log | `false` |
3232

33-
## Noop WAL Configuration
34-
35-
The Noop WAL provider is a special WAL option designed for emergency situations where the normal WAL provider becomes unavailable.
36-
37-
:::info
38-
Noop WAL is **only available in distributed (cluster) mode**, not in standalone mode.
39-
:::
40-
41-
### Configuration
42-
43-
To configure Noop WAL for a Datanode in a cluster:
44-
45-
```toml
46-
[wal]
47-
provider = "noop"
48-
```
49-
50-
:::danger DATA LOSS WARNING
51-
When using Noop WAL:
52-
- **All unflushed data will be lost** when the Datanode is shutdown or restarted.
53-
- This provider should **only be used temporarily** when the normal WAL provider is unavailable.
54-
- **Not recommended for production use** except in emergency situations.
55-
:::
56-
57-
### Important Notes
58-
59-
- **Noop WAL is only available in distributed (cluster) mode.** It cannot be used in standalone mode.
60-
- **Noop WAL cannot be configured on Metasrv.** It is only available for Datanode configuration. The Metasrv WAL provider should be set to either `raft_engine` or `kafka`.
61-
- When switching to Noop WAL, ensure that you have a data recovery plan in place.
62-
- To minimize data loss, flush regions regularly using `admin flush_table()` or `admin flush_region()`.
63-
- Once the normal WAL provider is available again, switch back to using it as soon as possible.
64-
6533
## Best practices
6634

6735
### Using a separate High-Performance Volume for WAL
Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
---
2+
keywords: [Configuration, Noop WAL, GreptimeDB Datanode, GreptimeDB, cluster mode]
3+
description: This section describes how to configure the Noop WAL for GreptimeDB Datanode component in cluster mode.
4+
---
5+
# Noop WAL
6+
7+
Noop WAL is a special WAL provider designed for emergency situations where the configured WAL provider becomes temporarily unavailable. It is a no-operation WAL provider that does not actually store any WAL data.
8+
9+
## Availability
10+
11+
Noop WAL is **only available in distributed (cluster) mode**, not in standalone mode.
12+
13+
## Use Cases
14+
15+
- **Temporary WAL Unavailability**: When your configured WAL provider (e.g., Kafka) becomes temporarily unavailable, you can switch the Datanode to use Noop WAL to keep the cluster operational.
16+
- **Testing and Development**: Useful for testing scenarios where WAL persistence is not required.
17+
18+
## Data Loss Warning
19+
20+
**When using Noop WAL, all unflushed data will be lost when the Datanode is shutdown or restarted.** This provider should only be used temporarily when the normal WAL provider is unavailable and is not recommended for production use except in emergency situations.
21+
22+
## Configuration
23+
24+
To configure Noop WAL for a Datanode in a cluster:
25+
26+
```toml
27+
[wal]
28+
provider = "noop"
29+
```
30+
31+
In a GreptimeDB cluster, WAL provider configuration is needed in two places:
32+
33+
1. **Metasrv** - Responsible for generating WAL provider metadata for new regions. The Metasrv WAL provider should be set to either `raft_engine` or `kafka`. Noop WAL cannot be configured on Metasrv.
34+
2. **Datanode** - Responsible for reading and writing WAL data. This is where you configure Noop WAL.
35+
36+
When the WAL provider is temporarily unavailable, you only need to configure the Datanode's WAL provider as `noop` to keep the cluster functional. The Metasrv continues using its configured WAL provider (`raft_engine` or `kafka`).
37+
38+
## Important Notes
39+
40+
- Noop WAL is only available in distributed (cluster) mode. It cannot be used in standalone mode.
41+
- Noop WAL cannot be configured on Metasrv. It is only available for Datanode configuration.
42+
- The Metasrv WAL provider should be set to either `raft_engine` or `kafka`.
43+
- When switching to Noop WAL, ensure that you have a data recovery plan in place.
44+
- To minimize data loss, flush regions regularly using `admin flush_table()` or `admin flush_region()`.
45+
- Once the normal WAL provider is available again, switch back to using it as soon as possible.

docs/user-guide/deployments-administration/wal/overview.md

Lines changed: 10 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -44,39 +44,21 @@ The [Write-Ahead Logging](/contributor-guide/datanode/wal.md#introduction)(WAL)
4444

4545
## Noop WAL
4646

47-
Noop WAL is a special WAL provider designed for situations where the configured WAL provider becomes temporarily unavailable. It is a no-operation WAL provider that does not actually store any WAL data.
47+
Noop WAL is a special WAL provider designed for situations where the configured WAL provider becomes temporarily unavailable. It is a no-operation WAL provider that does not actually store any WAL data. Noop WAL is only available in distributed (cluster) mode, not in standalone mode.
4848

49-
:::info
50-
Noop WAL is **only available in distributed (cluster) mode**, not in standalone mode.
51-
:::
49+
### Key Characteristics
5250

53-
### Use Cases
51+
- **No Data Persistence**: Does not store any WAL data.
52+
- **Data Loss Risk**: All unflushed data will be lost when the Datanode is shutdown or restarted.
53+
- **Temporary Use Only**: Should only be used temporarily when the normal WAL provider is unavailable.
54+
- **Cluster Mode Only**: Only available in distributed (cluster) mode, not in standalone mode.
5455

55-
- **Temporary WAL Unavailability**: When your configured WAL provider (e.g., Kafka) becomes temporarily unavailable, you can switch the Datanode to use Noop WAL to keep the cluster operational.
56-
- **Testing and Development**: Useful for testing scenarios where WAL persistence is not required.
57-
58-
### Important Warnings
59-
60-
:::danger DATA LOSS WARNING
61-
When using Noop WAL:
62-
- **All unflushed data will be lost** when the Datanode is shutdown or restarted.
63-
- This provider should **only be used temporarily** when the normal WAL provider is unavailable.
64-
- **Not recommended for production use** except in emergency situations.
65-
:::
66-
67-
### Configuration
68-
69-
In a GreptimeDB cluster, WAL provider configuration is needed in two places:
70-
71-
1. **Metasrv** - Responsible for generating WAL provider metadata for new regions. The Metasrv WAL provider should be set to either `raft_engine` or `kafka`. **Noop WAL cannot be configured on Metasrv.**
72-
2. **Datanode** - Responsible for reading and writing WAL data. This is where you configure Noop WAL.
73-
74-
When the WAL provider is temporarily unavailable, you only need to configure the Datanode's WAL provider as `noop` to keep the cluster functional. The Metasrv continues using its configured WAL provider (`raft_engine` or `kafka`).
75-
76-
For configuration details, see the [Local WAL configuration page](/user-guide/deployments-administration/wal/local-wal.md#noop-wal-configuration).
56+
For detailed configuration and usage information, see the [Noop WAL](/user-guide/deployments-administration/wal/noop-wal.md) page.
7757

7858
## Next steps
7959

8060
- To configure the Local WAL storage, please refer to [Local WAL](/user-guide/deployments-administration/wal/local-wal.md).
8161

82-
- To learn more about the Remote WAL, please refer to [Remote WAL](/user-guide/deployments-administration/wal/remote-wal/configuration.md).
62+
- To learn more about the Remote WAL, please refer to [Remote WAL](/user-guide/deployments-administration/wal/remote-wal/configuration.md).
63+
64+
- To learn more about the Noop WAL, please refer to [Noop WAL](/user-guide/deployments-administration/wal/noop-wal.md).

i18n/zh/docusaurus-plugin-content-docs/current/user-guide/deployments-administration/wal/local-wal.md

Lines changed: 1 addition & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -23,46 +23,14 @@ sync_write = false
2323

2424
| 配置项 | 描述 | 默认值 |
2525
| ----------------- | ----------------------------------------------------------------------------------------------- | ----------------- |
26-
| `provider` | WAL 的提供者。可选项:`raft_engine`(本地文件系统存储)、`kafka`(使用 Kafka 的远程 WAL 存储)或 `noop`(无操作 WAL 提供者) | `"raft_engine"` |
26+
| `provider` | WAL 的提供者。可选项:`raft_engine`(本地文件系统存储)、`kafka`(使用 Kafka 的远程 WAL 存储)或 `noop`(无操作 WAL 提供者,参见 [Noop WAL](/user-guide/deployments-administration/wal/noop-wal.md)| `"raft_engine"` |
2727
| `dir` | 日志写入目录 | `{data_home}/wal` |
2828
| `file_size` | 单个 WAL 日志文件的大小 | `128MB` |
2929
| `purge_threshold` | 触发清理的 WAL 总大小阈值 | `1GB` |
3030
| `purge_interval` | 触发清理的时间间隔 | `1m` |
3131
| `read_batch_size` | 读取批次大小 | `128` |
3232
| `sync_write` | 是否在每次写入日志时调用 fsync | `false` |
3333

34-
## Noop WAL 配置
35-
36-
Noop WAL 提供者是专为正常 WAL 提供者不可用的紧急情况而设计的特殊 WAL 选项。
37-
38-
:::info
39-
Noop WAL **仅在分布式(集群)模式下可用**,不适用于单机模式。
40-
:::
41-
42-
### 配置
43-
44-
要为集群中的 Datanode 配置 Noop WAL:
45-
46-
```toml
47-
[wal]
48-
provider = "noop"
49-
```
50-
51-
:::danger 数据丢失警告
52-
使用 Noop WAL 时:
53-
- **所有未刷新的数据**将在 Datanode 关闭或重启时**丢失**
54-
- 此提供者应**仅在正常 WAL 提供者不可用时临时使用**
55-
- **不建议在生产环境中使用**,除非是紧急情况。
56-
:::
57-
58-
### 重要提示
59-
60-
- **Noop WAL 仅在分布式(集群)模式下可用。** 它不能在单机模式下使用。
61-
- **Noop WAL 不能在 Metasrv 上配置。** 它仅适用于 Datanode 配置。Metasrv 的 WAL 提供者应设置为 `raft_engine``kafka`
62-
- 切换到 Noop WAL 时,请确保有数据恢复计划。
63-
- 为了最小化数据丢失,请使用 `admin flush_table()``admin flush_region()` 定期刷新 Region。
64-
- 一旦正常 WAL 提供者恢复可用,请尽快切换回使用它。
65-
6634
## 最佳实践
6735

6836
### 使用单独的高性能卷作为 WAL 目录
Lines changed: 45 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,45 @@
1+
---
2+
keywords: [配置, Noop WAL, GreptimeDB Datanode, GreptimeDB, 集群模式]
3+
description: 介绍如何在集群模式下为 GreptimeDB Datanode 组件配置 Noop WAL。
4+
---
5+
# Noop WAL
6+
7+
Noop WAL 是专为配置的 WAL 提供者暂时不可用的情况而设计的特殊 WAL 提供者。它是一个无操作 WAL 提供者,实际上不存储任何 WAL 数据。
8+
9+
## 可用性
10+
11+
Noop WAL **仅在分布式(集群)模式下可用**,不适用于单机模式。
12+
13+
## 使用场景
14+
15+
- **WAL 暂时不可用**: 当您配置的 WAL 提供者(例如 Kafka)暂时不可用时,可以将 Datanode 切换为使用 Noop WAL,以保持集群的运行。
16+
- **测试和开发**: 适用于不需要 WAL 持久化的测试场景。
17+
18+
## 数据丢失警告
19+
20+
**使用 Noop WAL 时,所有未刷新的数据将在 Datanode 关闭或重启时丢失。** 此提供者应仅在正常 WAL 提供者不可用时临时使用,不建议在生产环境中使用,除非是紧急情况。
21+
22+
## 配置
23+
24+
要为集群中的 Datanode 配置 Noop WAL:
25+
26+
```toml
27+
[wal]
28+
provider = "noop"
29+
```
30+
31+
在 GreptimeDB 集群中,WAL 提供者配置需要在两个地方进行:
32+
33+
1. **Metasrv** - 负责为新 Region 生成 WAL 提供者元数据。Metasrv 的 WAL 提供者应设置为 `raft_engine``kafka`。Noop WAL 不能在 Metasrv 上配置。
34+
2. **Datanode** - 负责读写 WAL 数据。这是配置 Noop WAL 的地方。
35+
36+
当 WAL 提供者暂时不可用时,您只需将 Datanode 的 WAL 提供者配置为 `noop` 即可保持集群正常运行。Metasrv 继续使用其配置的 WAL 提供者(`raft_engine``kafka`)。
37+
38+
## 重要提示
39+
40+
- Noop WAL 仅在分布式(集群)模式下可用。它不能在单机模式下使用。
41+
- Noop WAL 不能在 Metasrv 上配置。它仅适用于 Datanode 配置。
42+
- Metasrv 的 WAL 提供者应设置为 `raft_engine``kafka`
43+
- 切换到 Noop WAL 时,请确保有数据恢复计划。
44+
- 为了最小化数据丢失,请使用 `admin flush_table()``admin flush_region()` 定期刷新 Region。
45+
- 一旦正常 WAL 提供者恢复可用,请尽快切换回使用它。

i18n/zh/docusaurus-plugin-content-docs/current/user-guide/deployments-administration/wal/overview.md

Lines changed: 10 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -47,39 +47,21 @@ description: 介绍 GreptimeDB 中的 WAL(预写日志),包括本地 WAL
4747

4848
## Noop WAL
4949

50-
Noop WAL 是专为配置的 WAL 提供者暂时不可用的情况而设计的特殊 WAL 提供者。它是一个无操作 WAL 提供者,实际上不存储任何 WAL 数据。
50+
Noop WAL 是专为配置的 WAL 提供者暂时不可用的情况而设计的特殊 WAL 提供者。它是一个无操作 WAL 提供者,实际上不存储任何 WAL 数据。Noop WAL 仅在分布式(集群)模式下可用,不适用于单机模式。
5151

52-
:::info
53-
Noop WAL **仅在分布式(集群)模式下可用**,不适用于单机模式。
54-
:::
52+
### 主要特性
5553

56-
### 使用场景
54+
- **无数据持久化**: 不存储任何 WAL 数据。
55+
- **数据丢失风险**: 所有未刷新的数据将在 Datanode 关闭或重启时丢失。
56+
- **仅临时使用**: 应仅在正常 WAL 提供者不可用时临时使用。
57+
- **仅限集群模式**: 仅在分布式(集群)模式下可用,不适用于单机模式。
5758

58-
- **WAL 暂时不可用**: 当您配置的 WAL 提供者(例如 Kafka)暂时不可用时,可以将 Datanode 切换为使用 Noop WAL,以保持集群的运行。
59-
- **测试和开发**: 适用于不需要 WAL 持久化的测试场景。
60-
61-
### 重要警告
62-
63-
:::danger 数据丢失警告
64-
使用 Noop WAL 时:
65-
- **所有未刷新的数据**将在 Datanode 关闭或重启时**丢失**
66-
- 此提供者应**仅在正常 WAL 提供者不可用时临时使用**
67-
- **不建议在生产环境中使用**,除非是紧急情况。
68-
:::
69-
70-
### 配置
71-
72-
在 GreptimeDB 集群中,WAL 提供者配置需要在两个地方进行:
73-
74-
1. **Metasrv** - 负责为新 Region 生成 WAL 提供者元数据。Metasrv 的 WAL 提供者应设置为 `raft_engine``kafka`**Noop WAL 不能在 Metasrv 上配置。**
75-
2. **Datanode** - 负责读写 WAL 数据。这是配置 Noop WAL 的地方。
76-
77-
当 WAL 提供者暂时不可用时,您只需将 Datanode 的 WAL 提供者配置为 `noop` 即可保持集群正常运行。Metasrv 继续使用其配置的 WAL 提供者(`raft_engine``kafka`)。
78-
79-
有关配置详情,请参阅[本地 WAL 配置页面](/user-guide/deployments-administration/wal/local-wal.md#noop-wal-配置)
59+
有关详细配置和使用信息,请参阅 [Noop WAL](/user-guide/deployments-administration/wal/noop-wal.md) 页面。
8060

8161
## 后续步骤
8262

8363
- 如需配置本地 WAL 存储,请参阅[本地 WAL](/user-guide/deployments-administration/wal/local-wal.md)
8464

85-
- 想了解更多 Remote WAL 相关信息,请参阅 [Remote WAL](/user-guide/deployments-administration/wal/remote-wal/configuration.md)
65+
- 想了解更多 Remote WAL 相关信息,请参阅 [Remote WAL](/user-guide/deployments-administration/wal/remote-wal/configuration.md)
66+
67+
- 想了解更多 Noop WAL 相关信息,请参阅 [Noop WAL](/user-guide/deployments-administration/wal/noop-wal.md)

sidebars.ts

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -313,6 +313,7 @@ const sidebars: SidebarsConfig = {
313313
'user-guide/deployments-administration/wal/remote-wal/manage-kafka',
314314
]
315315
},
316+
'user-guide/deployments-administration/wal/noop-wal',
316317
],
317318
},
318319
'user-guide/deployments-administration/configuration',

0 commit comments

Comments
 (0)