Skip to content

Add Pivot - #2276

Merged
alexey-milovidov merged 3 commits into
ClickHouse:mainfrom
pivotlake:pivot-parquet
Oct 1, 2026
Merged

alexey-milovidov merged 3 commits into
ClickHouse:mainfrom
pivotlake:pivot-parquet

Conversation

@giladkl

@giladkl giladkl commented Sep 28, 2026 •

Copy link
Copy Markdown
Contributor

Hi! Thanks for maintaining ClickBench!

Adds Pivot, a Rust, PostgreSQL-compatible query engine, in two variants: pivot-parquet (single file) and pivot-parquet-partitioned (100 files). Both install via the official installer and query the Parquet in place through psql, with default settings.

When running the benchmark, would it be possible to run it on all machines (machine:all)? If not all, c8g.metal-48xl and c8g.4xlarge are the ones we're mostly looking on.

Thanks a lot!

@CLAassistant

CLAassistant commented Sep 28, 2026 •

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@giladkl giladkl changed the title Adding Pivot Add Pivot Sep 29, 2026
@alexey-milovidov alexey-milovidov added the machine:c6a.4xlarge PR benchmark machine: c6a.4xlarge (16 vCPU, 32 GB, AMD) — the default label Sep 29, 2026
@alexey-milovidov
alexey-milovidov deployed to benchmark-approval September 29, 2026 23:39 — with GitHub Actions Active
@github-actions

Copy link
Copy Markdown
Contributor

Results for pivot-parquet are ready for: c6a.4xlarge.
Results for pivot-parquet-partitioned are ready for: c6a.4xlarge.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet-partitioned/results/20260929/c6a.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet/results/20260929/c6a.4xlarge.json.
Tick "Allow edits by maintainers" on the pull request to let the automation commit the results itself.

Logs:

@giladkl

giladkl commented Sep 30, 2026

Copy link
Copy Markdown
Contributor Author

Hi @alexey-milovidov - added the results from the bot in a new commit.

Could you also run it with machine:all? We’ve put substantial work into NUMA-aware execution and high parallelism, which isn’t fully reflected on the smaller instance.

@alexey-milovidov alexey-milovidov added machine:all PR benchmark on every machine type and removed machine:c6a.4xlarge PR benchmark machine: c6a.4xlarge (16 vCPU, 32 GB, AMD) — the default labels Oct 1, 2026
@alexey-milovidov alexey-milovidov self-assigned this Oct 1, 2026
@alexey-milovidov
alexey-milovidov deployed to benchmark-approval October 1, 2026 00:48 — with GitHub Actions Active
@github-actions

github-actions Bot commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Results for pivot-parquet are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
Results for pivot-parquet-partitioned are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet-partitioned/results/20261001/c8g.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet-partitioned/results/20261001/c6a.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet/results/20261001/c8g.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet-partitioned/results/20261001/c8g.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet-partitioned/results/20261001/c6a.2xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet-partitioned/results/20261001/c7a.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet/results/20261001/c6a.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet-partitioned/results/20261001/c6a.xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet/results/20261001/c6a.2xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet/results/20261001/c6a.xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet/results/20261001/c8g.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet-partitioned/results/20261001/c6a.metal.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet/results/20261001/c7a.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as pivot-parquet/results/20261001/c6a.metal.json.
Tick "Allow edits by maintainers" on the pull request to let the automation commit the results itself.
The run of pivot-parquet on c6a.large did not produce results.
The run of pivot-parquet on t3a.small did not produce results.
The run of pivot-parquet-partitioned on c6a.large did not produce results.
The run of pivot-parquet-partitioned on t3a.small did not produce results.

Logs:

@giladkl

giladkl commented Oct 1, 2026

Copy link
Copy Markdown
Contributor Author

@alexey-milovidov Added a new commit with the full results - thanks! :)

Looks good to merge, at least from our side.

@alexey-milovidov
alexey-milovidov merged commit 381f8d4 into ClickHouse:main Oct 1, 2026
1 of 2 checks passed

This branch is waiting to be deployed

1 waiting deployment
benchmark-approval — 9482c182 Waiting Oct 1, 2026 by giladkl via launch #599
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

machine:all PR benchmark on every machine type

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants