Skip to content

chore(tracking): OLM Manifests for SDP Release 26.3.0 #834

@razvan

Description

@razvan

This is for tracking distributed work. For instructions on how to proceed with each operator, see the description below.

Please follow this list in order at least until the zookeeper-operator before parallelizing.

Operator Maintainer Branch Kuttl Tests Cert PR Catalog PR
commons @razvan stackable-commons-26.3.0 7994 8014
secret @razvan stackable-secret-26.3.0 7995 8015
listener @razvan stackable-listener-26.3.0 7998 8016
zookeeper @razvan stackable-zookeeper-26.3.0 8000 8017
hdfs @razvan stackable-hdfs-26.3.0 8001 8018
hive @razvan stackable-hive-26.3.0 8002 8019
hbase @razvan stackable-hbase-26.3.0 8003 8020
opa @razvan stackable-opa-26.3.0 8004 8021
opensearch @razvan stackable-opensearch-26.3.0 8005 8022
druid @razvan stackable-druid-26.3.0 8006 8023
kafka @razvan stackable-kafka-26.3.0 8007 8024
nifi @razvan stackable-nifi-26.3.0 8008 8025
spark @razvan stackable-spark-26.3.0 8009 8026
superset @razvan stackable-superset-26.3.0 8010 8027
airflow @razvan stackable-airflow-26.3.0 8011 8028
trino @razvan stackable-trino-26.3.0 8012 8029

Description

This is a list of steps you can follow to generate, install and test Operator Lifecycle Management (OLM) manifests for the Stackable Data Platform.

The manigest generation is fully automated for all operators except two: the secret and the listener operator. These two required manual intervention.

OLM manifests can be generated at any time and for any version of the operators (including 0.0.0-dev) but it's specially needed after a platform release, to certify the new operator versions.

To generate manifests for a released version of the SDP, ensure that you checkout the appropriate branch of the operator repository and the openshift operator repository.

Pre-requisites

In addition to the usual development tools like git and Python you need to clone the following repositories, idealy in the same location (this guide assumes $HOME/repo/stackable):

This issue assumes you are generating OLM manifests for a released SDP version with the intention of certifying it. This means:

  • All operator repositories have the required release branch. These releases have been tested and are generally available.
  • All container images have been published to quay.io

Secret and listener operator

Generate manifests

  • Update the supported OpenShift version range in the function generate_metadata()

  • Create release branch (from main) in the openshift operator repository

    cd $HOME/repo/stackable/openshift-certified-operators
    git switch -c stackable-secret-YY.M.X
  • Generate manifests

Use the scripts/generate-olm.py script in each operator repository like this:

uv run --script scripts/generate-olm.py \
--output-dir $HOME/repo/openshift/openshift-certified-operators/operators/stackable-secret-operator \
--version 26.3.0 \
--openshift-versions v4.18-v4.21
  • Commit & push your changes

Install manifests

  • Ensure your K8S configuration points to a an OpenShift (or OKD) instance

  • Install the operator from the manifests generated in the previous step

    /olm/build-bundles.sh -r YY.M.X -o secret -c ~/repo/stackable/openshift-certified-operators -d

Options:

  • -r YY.M.X version of the operator to install
  • -o secret name of the operator to install
  • -c ~/repo/stackable/openshift-certified-operators location of the openshift operator repository
  • -d deploy to the cluster

All other operators

These operators shouldn't require any manual editing of the manifests but a visual check is recommended.

The steps are illustrated only once for the ZooKeeper operator but a list of all operators to work on is added below.

Generate manifests

  • Create release branch (from main) in the openshift operator repository

    cd $HOME/repo/stackable/openshift-certified-operators
    git switch -c stackable-zookeeper-YY.M.X
  • Ensure appropriate branch (release-YY.M) is checkout out in the ZooKeeper operator

  • Generate manifests

./olm/build-manifests.py  \
--openshift-versions v4.18-v4.20 \
--repo-certified-operators ~/repo/openshift/openshift-certified-operators \
--channel 26.3 \
--release 26.3.0 \
--replaces 25.11.0 \
--repo-operator ~/repo/stackable/commons-operator

See ./olm/build-manifests.py --help for possible options.

Install manifests

./olm/build-bundles.sh \
-r YY.M.X \
-o zookeeper \
-c ~/repo/stackable/openshift-certified-operators \
-d

Test the operator

Run the openshit integration test suite for the operator

cd ~/repo/stackable/zookeeper-operator
/scripts/run-tests --test-suite openshift --skip-operator zookeeper

We use --skip-operator because the operator has already been installed previously.

Out of bound changes

  • Fix stackable-utils/olm/build-manifests.py to remove crd handling as it is now done by the operators.
  • Fix supported Kubernetes versions to replace OpenShift 4.20 with 4.21.
  • Fix common operator integration tests, use unprivileged nginx image.
  • Use Claude to rewrite scripts that perform Helm -> OLM translation for the secret and listener operators.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

Status
Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions