Skip to content

Run/check getting-started scripts + integration tests for 24.7 #613

@maltesander

Description

@maltesander

For each operator with a getting_started.sh script, run the following:

git fetch
git checkout release-24.7

# Some of the scripts are in a code/ subdirectory
# pushd docs/modules/superset/examples/getting_started
# pushd docs/modules/superset/examples/getting_started/code
pushd $(fd -td getting_started | grep examples); cd code 2>/dev/null || true

# Make a fresh cluster (~12 seconds)
kind delete cluster && kind create cluster
./getting_started.sh stackablectl

# Make a fresh cluster (~12 seconds)
kind delete cluster && kind create cluster
./getting_started.sh helm

popd

Then run integration tests:

# Make a fresh cluster (~12 seconds)
kind delete cluster && kind create cluster
./scripts/run-tests --test-suite nightly

x86_64

### Tasks
- [x] airflow-operator @NickLarsenNZ
- [x] https://github.com/stackabletech/druid-operator/pull/602 https://github.com/stackabletech/druid-operator/pull/603 @NickLarsenNZ
- [x] https://github.com/stackabletech/hbase-operator/pull/536 https://github.com/stackabletech/hbase-operator/pull/537 @NickLarsenNZ
- [ ] https://github.com/stackabletech/hdfs-operator/pull/562
- [x] hello-world-operator (integration tests only) @Techassi
- [x] hive-operator @Techassi
- [ ] https://github.com/stackabletech/kafka-operator/pull/738
- [x] listener-operator (integration tests only) @Techassi
- [x] nifi-operator @Techassi
- [x] opa-operator @Techassi
- [x] secret-operator (integration tests only) @Techassi
- [x] spark-k8s-operator @Techassi
- [x] superset-operator @Techassi
- [x] trino-operator @Techassi
- [x] ZooKeeper-operator @Techassi

aarch64

### Tasks
- [x] airflow-operator @Maleware
- [x] druid-operator @Maleware
- [x] hbase-operator @Maleware
- [x] hello-world-operator  (integration tests only)
- [x] hdfs-operator @Maleware
- [x] hive-operator @Maleware
- [x] kafka-operator @Maleware
- [x] listener-operator (integration tests only) @Maleware
- [x] nifi-operator @Maleware
- [x] opa-operator @Maleware
- [x] secret-operator (integration tests only) @Maleware
- [x] spark-k8s-operator @Maleware
- [x] superset-operator @Maleware
- [x] trino-operator @Maleware
- [x] zookeeper-operator @Maleware

Important

kafka-operator requires kafkacat (kcat in nix)

Note

The list above was generated by:

# cd to directory where you store the stackabletech repos locally
find -name 'getting_started.sh' -or -name 'test-definition.yaml' -not -path './operator-templating/*' \
| cut -d/ -f2 \
| sort \
| uniq \
| grep -- -operator \
| sed 's/^/- [ ] /'

If you want to reuse a cluster, you can delete everything by doing:

# Delete Stackable Custom Resources
kubectl get crds | grep stackable | cut -d' ' -f1 | xargs -I {} kubectl -n default delete {} --all

# Delete well-known Kubernetes Resources in the default namespace
kubectl -n default delete all --all --grace-period 0

# Delete the operators
stackablectl release uninstall 24.7

# delete the Stackable Custom Resource Definitions
kubectl get crds | grep stackable | cut -d' ' -f1 | xargs -I {} kubectl delete crd {}

# You might need to check on any Helm releases
helm list
helm uninstall ....

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions