Skip to content

test: refactor operatorpolicy tests to run faster #419

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
jan-law wants to merge 19 commits into
base: main
Choose a base branch
from
Draft

test: refactor operatorpolicy tests to run faster #419

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
c1a888c
test: refactor operator policy setup for parallel procs
jan-law Nov 24, 2025
7d51e85
test: run test with Serial when breaking catalog
jan-law Dec 3, 2025
1eef9b5
style: run make fmt
jan-law Nov 25, 2025
d6fd325
test: move example policy tests with no operatorgroup
jan-law Dec 1, 2025
02df561
test: wrap similar example policies with Ordered container
jan-law Dec 2, 2025
9076484
test: use unique operator for default operator group tests
jan-law Dec 19, 2025
0fda27d
test: move tests with crd assertions
jan-law Dec 3, 2025
fe38147
test: wrap crd tests with Ordered container
jan-law Dec 3, 2025
94d7280
test: run crd tests with a different operator
jan-law Dec 1, 2025
4c34c7a
test: standardize catalogsource cleanup
jan-law Dec 3, 2025
aa6a6cb
test: fix typo in step desc
jan-law Dec 5, 2025
62fc55a
test: retry patch commands until success
jan-law Dec 5, 2025
f64b010
test: fix flaky subscription condition
jan-law Dec 12, 2025
854d032
DROP ME: debug info
jan-law Dec 12, 2025
d3f5bad
test: fix flaky reconcile counter
jan-law Dec 16, 2025
d84acba
test: fix flaky installation timeouts
jan-law Dec 16, 2025
b48caa9
DROP ME: more debug info
jan-law Dec 19, 2025
32da9d3
fixup: skipConsistently on template test
jan-law Dec 19, 2025
a1c4420
fixup: swap 2ndary crd test operator to quay
jan-law Dec 19, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3,922 changes: 2,225 additions & 1,697 deletions test/e2e/case38_install_operator_test.go
View file
Open in desktop

Large diffs are not rendered by default.

5 changes: 5 additions & 0 deletions test/resources/case38_operator_install/operator-policy-manual-upgrades.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,11 @@ spec:
remediationAction: enforce
severity: medium
complianceType: musthave
operatorGroup:
name: manual-upgrades-operator-group
namespace: operator-policy-testns
targetNamespaces:
- operator-policy-testns
subscription:
channel: strimzi-0.36.x
name: strimzi-kafka-operator
Expand Down
28 changes: 28 additions & 0 deletions test/resources/case38_operator_install/operator-policy-mustnothave-any-version-apicast.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
apiVersion: policy.open-cluster-management.io/v1beta1
kind: OperatorPolicy
metadata:
name: oppol-mustnothave-apicast
labels:
policy.open-cluster-management.io/cluster-name: "managed"
policy.open-cluster-management.io/cluster-namespace: "managed"
ownerReferences:
- apiVersion: policy.open-cluster-management.io/v1
kind: Policy
name: parent-policy
uid: 12345678-90ab-cdef-1234-567890abcdef # must be replaced before creation
spec:
remediationAction: inform
severity: medium
complianceType: mustnothave
subscription:
channel: stable
name: apicast-community-operator
namespace: operator-policy-testns
source: operatorhubio-catalog
sourceNamespace: olm
upgradeApproval: Automatic
removalBehavior:
operatorGroups: DeleteIfUnused
subscriptions: Delete
clusterServiceVersions: Delete
customResourceDefinitions: Delete
0 ...rator-policy-mustnothave-any-version.yaml → ...-policy-mustnothave-any-version-quay.yaml
View file
Open in desktop
File renamed without changes.
8 changes: 4 additions & 4 deletions test/resources/case38_operator_install/operator-policy-mustnothave.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,14 +15,14 @@ spec:
severity: medium
complianceType: mustnothave
subscription:
channel: stable-3.10
name: project-quay
channel: stable
name: apicast-community-operator
namespace: operator-policy-testns
source: operatorhubio-catalog
sourceNamespace: olm
startingCSV: quay-operator.v3.10.0
startingCSV: apicast-community-operator.v0.7.1
versions:
- quay-operator.v3.10.0
- apicast-community-operator.v0.7.1
upgradeApproval: Automatic
removalBehavior:
operatorGroups: DeleteIfUnused
Expand Down
2 changes: 1 addition & 1 deletion test/resources/case38_operator_install/operator-policy-no-exist-enforce.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,6 @@ spec:
channel: stable
name: project--does-not-exist
namespace: operator-policy-testns
source: grc-mock-source
source: operatorhubio-catalog
sourceNamespace: olm
upgradeApproval: None
8 changes: 4 additions & 4 deletions ...-policy-no-group-enforce-one-version.yaml → ...ator-policy-no-group-enforce-one-ver.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,11 +16,11 @@ spec:
complianceType: musthave
subscription:
channel: stable
name: example-operator
name: authorino-operator
namespace: operator-policy-testns
source: grc-mock-source
source: operatorhubio-catalog
sourceNamespace: olm
startingCSV: example-operator.v0.0.3
startingCSV: authorino-operator.v0.15.0
versions:
- example-operator.v0.0.3
- authorino-operator.v0.15.0
upgradeApproval: Automatic
4 changes: 2 additions & 2 deletions test/resources/case38_operator_install/operator-policy-no-group-enforce.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,8 @@ spec:
complianceType: musthave
subscription:
channel: stable
name: example-operator
name: authorino-operator
namespace: operator-policy-testns
source: grc-mock-source
source: operatorhubio-catalog
sourceNamespace: olm
upgradeApproval: Automatic
8 changes: 4 additions & 4 deletions test/resources/case38_operator_install/operator-policy-no-group-one-version.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,14 +15,14 @@ spec:
severity: medium
complianceType: musthave
subscription:
channel: stable-3.10
name: project-quay
channel: stable
name: apicast-community-operator
namespace: operator-policy-testns
source: operatorhubio-catalog
sourceNamespace: olm
startingCSV: quay-operator.v3.10.0
startingCSV: apicast-community-operator.v0.7.1
versions:
- '{{ if false }}some value to test empty string is discarded{{ end }}'
- '{{ if true }}quay-operator.v3.10.0{{ end }}'
- '{{ if true }}apicast-community-operator.v0.7.1{{ end }}'
- '{{ if false }}some other value to test empty string is discarded{{ end }}'
upgradeApproval: None
Loading