Deploy Stackable Services
Once the basic infrastructure has been set up, you are ready to deploy services to the cluster. To do this, you must provide Kubernetes with service descriptions for each service you wish to deploy.
Deploy an Apache ZooKeeper instance to your cluster:
kubectl apply -f - <<EOF
---
apiVersion: zookeeper.stackable.tech/v1alpha1
kind: ZookeeperCluster
metadata:
name: simple-zk
spec:
servers:
roleGroups:
primary:
replicas: 1
config:
myidOffset: 10
version: 3.5.8
EOF
This deploys an Apache Kafka broker that depends on the ZooKeeper service you just deployed. The zookeeperReference property below points to the namespace and name you gave to the ZooKeeper service deployed previously.
kubectl apply -f - <<EOF
---
apiVersion: kafka.stackable.tech/v1alpha1
kind: KafkaCluster
metadata:
name: simple-kafka
spec:
version: 2.8.1
zookeeperConfigMapName: simple-kafka-znode
brokers:
roleGroups:
brokers:
replicas: 1
selector:
matchLabels:
node: quickstart-1
---
apiVersion: zookeeper.stackable.tech/v1alpha1
kind: ZookeeperZnode
metadata:
name: simple-kafka-znode
spec:
clusterRef:
name: simple-zk
namespace: default
EOF
The next step is to deploy an Apache NiFi server:
kubectl apply -f - <<EOF
---
apiVersion: zookeeper.stackable.tech/v1alpha1
kind: ZookeeperZnode
metadata:
name: simple-nifi-znode
spec:
clusterRef:
name: simple-zk
---
apiVersion: v1
kind: Secret
metadata:
name: nifi-admin-credentials-simple
stringData:
username: admin
password: AdminPassword
---
apiVersion: nifi.stackable.tech/v1alpha1
kind: NifiCluster
metadata:
name: simple-nifi
spec:
version: "1.15.0"
zookeeperConfigMapName: simple-nifi-znode
authenticationConfig:
method:
SingleUser:
adminCredentialsSecret:
name: nifi-admin-credentials-simple
autoGenerate: true
sensitivePropertiesConfig:
keySecret: nifi-sensitive-property-key
autoGenerate: true
nodes:
roleGroups:
default:
selector:
matchLabels:
node: quickstart-1
config:
log:
rootLogLevel: INFO
replicas: 1
EOF
You can use
kubectl get pods to check the status of the services, but you must first install these tools (simple-kafka, simple-nifi, etc.). This will return the status of all pods that are currently running in the default namespace.NAME READY STATUS RESTARTS AGE
nifi-operator-deployment-64c98c779c-nw6h8 1/1 Running 0 24m
kafka-operator-deployment-54df9f86c7-psqgd 1/1 Running 0 24m
zookeeper-operator-deployment-767458d4f5-2czb9 1/1 Running 0 24m
secret-operator-daemonset-pddkv 2/2 Running 0 24m
simple-zk-server-primary-0 1/1 Running 0 23m
simple-kafka-broker-brokers-0 2/2 Running 0 21m
simple-nifi-node-default-0 1/1 Running 0 22m
Note: The software download from the Stackable repository and deployment of the services will take time because this is the first time that each service has been deployed to these nodes. Your cluster is prepared for use once the pods are in the running state.
Last modified 9mo ago