Skip to content

ci: use Rook 1.19.3 and Ceph Tentacle#5672

Merged
mergify[bot] merged 7 commits intoceph:develfrom
nixpanic:testing/ceph-tentacle
Apr 8, 2026
Merged

ci: use Rook 1.19.3 and Ceph Tentacle#5672
mergify[bot] merged 7 commits intoceph:develfrom
nixpanic:testing/ceph-tentacle

Conversation

@nixpanic
Copy link
Copy Markdown
Member

@nixpanic nixpanic commented Oct 15, 2025

Recent versions of Rook use Ceph-CSI Operator by default. There is no need to have Ceph-CSI deployed by Rook, as our CI deploys it from the PR that is being tested.

Rook v1.18.4 works well with Ceph Squid (v19). But for NVMe-oF testing we need a Ceph Tentacle (v20) cluster.

Closes: #5772


Show available bot commands

These commands are normally not required, but in case of issues, leave any of
the following bot commands in an otherwise empty comment in this PR:

  • /retest ci/centos/<job-name>: retest the <job-name> after unrelated
    failure (please report the failure too!)

@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

@mergify mergify Bot added the component/testing Additional test cases or CI work label Oct 15, 2025
nixpanic added a commit to nixpanic/ceph-csi that referenced this pull request Oct 15, 2025
The devel branch will use a newer version of Rook and Ceph in the near
future. That requires the images to be mirrored in the CI registry.

See-also: ceph#5672
Signed-off-by: Niels de Vos <ndevos@ibm.com>
@nixpanic nixpanic added the ci/skip/multi-arch-build skip building on multiple architectures label Oct 15, 2025
@nixpanic
Copy link
Copy Markdown
Member Author

nixpanic commented Oct 15, 2025

@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

1 similar comment
@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

@nixpanic nixpanic changed the title ci: use Rook 1.18.4 ci: use Rook 1.18.4 and Ceph Tentacle Oct 15, 2025
mergify Bot pushed a commit that referenced this pull request Oct 16, 2025
The devel branch will use a newer version of Rook and Ceph in the near
future. That requires the images to be mirrored in the CI registry.

See-also: #5672
Signed-off-by: Niels de Vos <ndevos@ibm.com>
@nixpanic nixpanic force-pushed the testing/ceph-tentacle branch from c2dabc9 to 03040f1 Compare October 16, 2025 09:07
@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.33

@nixpanic nixpanic force-pushed the testing/ceph-tentacle branch from 03040f1 to 870215d Compare October 16, 2025 09:54
@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

@nixpanic nixpanic force-pushed the testing/ceph-tentacle branch from 870215d to 025e47a Compare October 16, 2025 10:13
@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

@nixpanic nixpanic force-pushed the testing/ceph-tentacle branch from 025e47a to a40f06c Compare October 16, 2025 11:19
@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

@nixpanic nixpanic force-pushed the testing/ceph-tentacle branch from a40f06c to 9b9119c Compare October 16, 2025 11:59
@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

1 similar comment
@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

@nixpanic nixpanic force-pushed the testing/ceph-tentacle branch from 960e97e to 4b7516f Compare October 16, 2025 14:44
@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

@nixpanic nixpanic force-pushed the testing/ceph-tentacle branch from 4b7516f to 48a4306 Compare October 16, 2025 14:59
@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

1 similar comment
@nixpanic
Copy link
Copy Markdown
Member Author

/test ci/centos/mini-e2e/k8s-1.34

@nixpanic nixpanic force-pushed the testing/ceph-tentacle branch from b919ccd to 96abede Compare October 16, 2025 15:49
@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/mini-e2e/k8s-1.33

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/upgrade-tests-cephfs

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/mini-e2e/k8s-1.35

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/mini-e2e/k8s-1.34

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/upgrade-tests-rbd

@ceph-csi-bot ceph-csi-bot removed the ok-to-test Label to trigger E2E tests label Apr 8, 2026
@mergify
Copy link
Copy Markdown
Contributor

mergify Bot commented Apr 8, 2026

Deprecation notice: This pull request comes from a fork and was queued with update_method=rebase and update_bot_account impersonation. This capability will be removed on July 1, 2026. After this date, the merge queue will no longer be able to rebase fork pull requests with this configuration. To avoid disruption, switch to update_method=merge in your queue rule.

@mergify
Copy link
Copy Markdown
Contributor

mergify Bot commented Apr 8, 2026

Merge Queue Status

  • Entered queue2026-04-08 08:42 UTC · Rule: default
  • Checks passed · in-place
  • Merged2026-04-08 11:50 UTC · at 049b480e71a2101c38c5753e65e35c0a0cf64166

This pull request spent 3 hours 7 minutes 22 seconds in the queue, including 3 hours 7 minutes 5 seconds running CI.

Required conditions to merge

nixpanic and others added 7 commits April 8, 2026 08:42
Recent versions of Rook use Ceph-CSI Operator by default. There is no
need to have Ceph-CSI deployed by Rook, as our CI deploys it from the PR
that is being tested.

Signed-off-by: Niels de Vos <ndevos@ibm.com>
Signed-off-by: Niels de Vos <ndevos@ibm.com>
Signed-off-by: Niels de Vos <ndevos@ibm.com>
With Ceph Tentacle creating a (the first?) NFS-export fails with:

```
Error EINVAL: Traceback (most recent call last):
    File "/usr/share/ceph/mgr/mgr_module.py", line 2010, in _handle_command
      return CLICommand.COMMANDS[cmd['prefix']].call(self, cmd, inbuf)
    File "/usr/share/ceph/mgr/mgr_module.py", line 534, in call
      return self.func(mgr, **kwargs)
    File "/usr/share/ceph/mgr/object_format.py", line 592, in _format_response
      robj = f(*args, **kwargs)
    File "/usr/share/ceph/mgr/nfs/module.py", line 45, in
_cmd_nfs_export_create_cephfs
      earmark_resolver = CephFSEarmarkResolver(self)
    File "/usr/share/ceph/mgr/mgr_util.py", line 356, in __init__
      self._cephfs_client = client or CephfsClient(mgr)
    File "/usr/share/ceph/mgr/mgr_util.py", line 318, in __init__
      self.connection_pool = CephfsConnectionPool(self.mgr)
    File "/usr/share/ceph/mgr/mgr_util.py", line 223, in __init__
      self.timer_task.start()
    File "/usr/lib64/python3.9/threading.py", line 899, in start
      _start_new_thread(self._bootstrap, ())
  RuntimeError: can't start new thread
```

It seems this can only happen when the CLI is used, that means go-ceph
failed to create the export in the first place. It would be useful to
log the go-ceph failure, so that improving is possible.

Signed-off-by: Niels de Vos <ndevos@ibm.com>
Signed-off-by: Niels de Vos <ndevos@ibm.com>
Signed-off-by: Niels de Vos <ndevos@ibm.com>
Use `dd` to sync the data, do not wait for unmounting to flush
outstanding I/O (and ignore failed writes).

See-also: https://tracker.ceph.com/issues/73997?#note-27
Co-authored-by: Patrick Donnelly <pdonnell@ibm.com>
Signed-off-by: Niels de Vos <ndevos@ibm.com>
@ceph-csi-bot ceph-csi-bot force-pushed the testing/ceph-tentacle branch from 32a0149 to 049b480 Compare April 8, 2026 08:42
@mergify mergify Bot added ci/in-progress/e2e This label acts like a guard and prevents Mergify from adding the `ok-to-test` label again. ok-to-test Label to trigger E2E tests queued labels Apr 8, 2026
@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/k8s-e2e-external-storage/1.33

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/k8s-e2e-external-storage/1.34

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/mini-e2e-helm/k8s-1.33

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/upgrade-tests-cephfs

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/mini-e2e-helm/k8s-1.34

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/mini-e2e/k8s-1.33

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/upgrade-tests-rbd

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/k8s-e2e-external-storage/1.35

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/mini-e2e/k8s-1.34

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/mini-e2e-helm/k8s-1.35

@ceph-csi-bot
Copy link
Copy Markdown
Collaborator

/test ci/centos/mini-e2e/k8s-1.35

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci/in-progress/e2e This label acts like a guard and prevents Mergify from adding the `ok-to-test` label again. ci/skip/multi-arch-build skip building on multiple architectures component/testing Additional test cases or CI work

Projects

None yet

Development

Successfully merging this pull request may close these issues.

CephFS: Data loss when readAffinity is enabled on Ceph Tentacle v20.2.0

6 participants