Skip to content

docs: clarify cache statistics and Paimon OSS-HDFS config #3568

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
suxiaogang223 wants to merge 2 commits into
base: master
Choose a base branch
from
Open

docs: clarify cache statistics and Paimon OSS-HDFS config #3568

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
3283c7c
docs: update cache and paimon catalog notes
suxiaogang223 Apr 24, 2026
ff68c4c
add next
morningman May 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions docs-next/admin-manual/system-tables/information_schema/file_cache_statistics.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,8 @@

Used to view the metric information related to data cache on each BE node. The metric information is sourced from the monitoring metrics related to BE's data cache.

In compute-storage decoupled mode, this table only returns the BE nodes in the compute group used by the current query. If the cluster contains multiple compute groups, the query result may include only part of all BE nodes in the cluster.

:::tip Tip
This system table is supported from versions 2.1.6 and 3.0.2.
:::
Expand Down
2 changes: 2 additions & 0 deletions docs/admin-manual/system-tables/information_schema/file_cache_statistics.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,8 @@

Used to view the metric information related to data cache on each BE node. The metric information is sourced from the monitoring metrics related to BE's data cache.

In compute-storage decoupled mode, this table only returns the BE nodes in the compute group used by the current query. If the cluster contains multiple compute groups, the query result may include only part of all BE nodes in the cluster.

:::tip Tip
This system table is supported from versions 2.1.6 and 3.0.2.
:::
Expand Down
2 changes: 2 additions & 0 deletions .../current/admin-manual/system-tables/information_schema/file_cache_statistics.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@

指标信息来源于 BE 的数据缓存相关监控指标。

在存算分离模式下，该系统表仅返回当前查询所使用的计算组（Compute Group）中的 BE 节点信息。如果集群中存在多个计算组，查询结果可能只包含集群全部 BE 节点中的一部分。

:::tip 提示
该系统表自 2.1.6 和 3.0.2 版本支持。
:::
Expand Down
2 changes: 2 additions & 0 deletions .../current/admin-manual/system-tables/information_schema/file_cache_statistics.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@

指标信息来源于 BE 的数据缓存相关监控指标。

在存算分离模式下，该系统表仅返回当前查询所使用的计算组（Compute Group）中的 BE 节点信息。如果集群中存在多个计算组，查询结果可能只包含集群全部 BE 节点中的一部分。

:::tip 提示
该系统表自 2.1.6 和 3.0.2 版本支持。
:::
Expand Down
2 changes: 2 additions & 0 deletions ...sion-2.1/admin-manual/system-tables/information_schema/file_cache_statistics.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@

指标信息来源于 BE 的数据缓存相关监控指标。

在存算分离模式下，该系统表仅返回当前查询所使用的计算组（Compute Group）中的 BE 节点信息。如果集群中存在多个计算组，查询结果可能只包含集群全部 BE 节点中的一部分。

:::tip 提示
该系统表自 2.1.6 和 3.0.2 版本支持。
:::
Expand Down
20 changes: 20 additions & 0 deletions ...ocusaurus-plugin-content-docs/version-2.1/lakehouse/catalogs/paimon-catalog.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -340,6 +340,26 @@ CREATE CATALOG [IF NOT EXISTS] catalog_name PROPERTIES (
'oss.secret_key' = '<sk>'
);
```

对于 Doris 2.1 和 3.0 版本，如果 Paimon 表存储在阿里云 OSS-HDFS 中，且路径使用 `oss-dls.aliyuncs.com` 这类 OSS-HDFS Endpoint，需要显式添加 OSS-HDFS 和 Jindo FileSystem 相关属性：

```sql
CREATE CATALOG paimon_hms_on_oss_hdfs_catalog PROPERTIES (
'type' = 'paimon',
'paimon.catalog.type' = 'hms',
'warehouse' = 'oss://bucket.cn-beijing.oss-dls.aliyuncs.com/path/to/paimon_warehouse',
'hive.metastore.uris' = 'thrift://127.0.0.1:9383',
'fs.oss.accessKeyId' = '<ak>',
'fs.oss.accessKeySecret' = '<sk>',
'fs.oss.endpoint' = 'cn-beijing.oss-dls.aliyuncs.com',
'oss.access_key' = '<ak>',
'oss.secret_key' = '<sk>',
'oss.endpoint' = 'cn-beijing.oss-dls.aliyuncs.com',
'oss.hdfs.enabled' = 'true',
'fs.oss.impl' = 'com.aliyun.jindodata.oss.JindoOssFileSystem',
'fs.AbstractFileSystem.oss.impl' = 'com.aliyun.jindodata.oss.OSS'
);
```
</TabItem>
<TabItem value='COS' label='COS'>
```sql
Expand Down
2 changes: 2 additions & 0 deletions ...sion-3.x/admin-manual/system-tables/information_schema/file_cache_statistics.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@

指标信息来源于 BE 的数据缓存相关监控指标。

在存算分离模式下，该系统表仅返回当前查询所使用的计算组（Compute Group）中的 BE 节点信息。如果集群中存在多个计算组，查询结果可能只包含集群全部 BE 节点中的一部分。

:::tip 提示
该系统表自 2.1.6 和 3.0.2 版本支持。
:::
Expand Down
20 changes: 20 additions & 0 deletions ...ocusaurus-plugin-content-docs/version-3.x/lakehouse/catalogs/paimon-catalog.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -433,6 +433,26 @@ ORDER BY entry_name;
'oss.secret_key' = '<sk>'
);
```

对于 Doris 2.1 和 3.0 版本，如果 Paimon 表存储在阿里云 OSS-HDFS 中，且路径使用 `oss-dls.aliyuncs.com` 这类 OSS-HDFS Endpoint，需要显式添加 OSS-HDFS 和 Jindo FileSystem 相关属性：

```sql
CREATE CATALOG paimon_hms_on_oss_hdfs_catalog PROPERTIES (
'type' = 'paimon',
'paimon.catalog.type' = 'hms',
'warehouse' = 'oss://bucket.cn-beijing.oss-dls.aliyuncs.com/path/to/paimon_warehouse',
'hive.metastore.uris' = 'thrift://127.0.0.1:9383',
'fs.oss.accessKeyId' = '<ak>',
'fs.oss.accessKeySecret' = '<sk>',
'fs.oss.endpoint' = 'cn-beijing.oss-dls.aliyuncs.com',
'oss.access_key' = '<ak>',
'oss.secret_key' = '<sk>',
'oss.endpoint' = 'cn-beijing.oss-dls.aliyuncs.com',
'oss.hdfs.enabled' = 'true',
'fs.oss.impl' = 'com.aliyun.jindodata.oss.JindoOssFileSystem',
'fs.AbstractFileSystem.oss.impl' = 'com.aliyun.jindodata.oss.OSS'
);
```
</TabItem>
<TabItem value='COS' label='COS'>
```sql
Expand Down
2 changes: 2 additions & 0 deletions ...sion-4.x/admin-manual/system-tables/information_schema/file_cache_statistics.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@

指标信息来源于 BE 的数据缓存相关监控指标。

在存算分离模式下，该系统表仅返回当前查询所使用的计算组（Compute Group）中的 BE 节点信息。如果集群中存在多个计算组，查询结果可能只包含集群全部 BE 节点中的一部分。

:::tip 提示
该系统表自 2.1.6 和 3.0.2 版本支持。
:::
Expand Down
2 changes: 2 additions & 0 deletions ...sion-2.1/admin-manual/system-tables/information_schema/file_cache_statistics.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,8 @@

Used to view the metric information related to data cache on each BE node. The metric information is sourced from the monitoring metrics related to BE's data cache.

In compute-storage decoupled mode, this table only returns the BE nodes in the compute group used by the current query. If the cluster contains multiple compute groups, the query result may include only part of all BE nodes in the cluster.

:::tip Tip
This system table is supported from versions 2.1.6 and 3.0.2.
:::
Expand Down
20 changes: 20 additions & 0 deletions versioned_docs/version-2.1/lakehouse/catalogs/paimon-catalog.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -341,6 +341,26 @@ The currently dependent Paimon version is 1.0.0.
'oss.secret_key' = '<sk>'
);
```

For Doris 2.1 and 3.0, when the Paimon table is stored in Alibaba Cloud OSS-HDFS and the path uses an OSS-HDFS endpoint such as `oss-dls.aliyuncs.com`, add the OSS-HDFS and Jindo FileSystem properties explicitly:

```sql
CREATE CATALOG paimon_hms_on_oss_hdfs_catalog PROPERTIES (
'type' = 'paimon',
'paimon.catalog.type' = 'hms',
'warehouse' = 'oss://bucket.cn-beijing.oss-dls.aliyuncs.com/path/to/paimon_warehouse',
'hive.metastore.uris' = 'thrift://127.0.0.1:9383',
'fs.oss.accessKeyId' = '<ak>',
'fs.oss.accessKeySecret' = '<sk>',
'fs.oss.endpoint' = 'cn-beijing.oss-dls.aliyuncs.com',
'oss.access_key' = '<ak>',
'oss.secret_key' = '<sk>',
'oss.endpoint' = 'cn-beijing.oss-dls.aliyuncs.com',
'oss.hdfs.enabled' = 'true',
'fs.oss.impl' = 'com.aliyun.jindodata.oss.JindoOssFileSystem',
'fs.AbstractFileSystem.oss.impl' = 'com.aliyun.jindodata.oss.OSS'
);
```
</TabItem>
<TabItem value='COS' label='COS'>
```sql
Expand Down
2 changes: 2 additions & 0 deletions ...sion-3.x/admin-manual/system-tables/information_schema/file_cache_statistics.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,8 @@

Used to view the metric information related to data cache on each BE node. The metric information is sourced from the monitoring metrics related to BE's data cache.

In compute-storage decoupled mode, this table only returns the BE nodes in the compute group used by the current query. If the cluster contains multiple compute groups, the query result may include only part of all BE nodes in the cluster.

:::tip Tip
This system table is supported from versions 2.1.6 and 3.0.2.
:::
Expand Down
20 changes: 20 additions & 0 deletions versioned_docs/version-3.x/lakehouse/catalogs/paimon-catalog.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -428,6 +428,26 @@ Supported since version 4.0.3, `timestamp_with_local_time_zone` can be mapped to
'oss.secret_key' = '<sk>'
);
```

For Doris 2.1 and 3.0, when the Paimon table is stored in Alibaba Cloud OSS-HDFS and the path uses an OSS-HDFS endpoint such as `oss-dls.aliyuncs.com`, add the OSS-HDFS and Jindo FileSystem properties explicitly:

```sql
CREATE CATALOG paimon_hms_on_oss_hdfs_catalog PROPERTIES (
'type' = 'paimon',
'paimon.catalog.type' = 'hms',
'warehouse' = 'oss://bucket.cn-beijing.oss-dls.aliyuncs.com/path/to/paimon_warehouse',
'hive.metastore.uris' = 'thrift://127.0.0.1:9383',
'fs.oss.accessKeyId' = '<ak>',
'fs.oss.accessKeySecret' = '<sk>',
'fs.oss.endpoint' = 'cn-beijing.oss-dls.aliyuncs.com',
'oss.access_key' = '<ak>',
'oss.secret_key' = '<sk>',
'oss.endpoint' = 'cn-beijing.oss-dls.aliyuncs.com',
'oss.hdfs.enabled' = 'true',
'fs.oss.impl' = 'com.aliyun.jindodata.oss.JindoOssFileSystem',
'fs.AbstractFileSystem.oss.impl' = 'com.aliyun.jindodata.oss.OSS'
);
```
</TabItem>
<TabItem value='COS' label='COS'>
```sql
Expand Down
2 changes: 2 additions & 0 deletions ...sion-4.x/admin-manual/system-tables/information_schema/file_cache_statistics.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,8 @@

Used to view the metric information related to data cache on each BE node. The metric information is sourced from the monitoring metrics related to BE's data cache.

In compute-storage decoupled mode, this table only returns the BE nodes in the compute group used by the current query. If the cluster contains multiple compute groups, the query result may include only part of all BE nodes in the cluster.

:::tip Tip
This system table is supported from versions 2.1.6 and 3.0.2.
:::
Expand Down
Loading