The Kafka Cluster Deletion feature allows users to remove a Kafka cluster from their environment. Follow the steps below to delete a Kafka cluster.
Warning:
Deleting a Kafka cluster is irreversible. Once a cluster is deleted, all the data and configurations contained within it will be permanently removed.
Ensure that you have backed up any necessary data before deleting the cluster.
Log in to the DCD with your username and password.
Go to Menu > Analytics > Event Streams for Apache Kafka.
Identify the Kafka cluster you wish to delete from the list. Ensure that you are selecting the correct cluster.
From the drop-down menu, click Delete.
A confirmation dialog will appear, asking you to confirm the deletion. Ensure that you understand this action is irreversible and will permanently delete the cluster and all its data. Confirm the deletion to proceed.
Result: The cluster will be permanently deleted.
Before setting up a Kafka Cluster, ensure that you are working within a provisioned Virtual Data Center (VDC) that contains at least one VM in a private LAN, which will access the cluster via the private LAN. The VM you create is counted against the quota allocated in your contract.
To create a Kafka cluster, follow these steps:
Log in to the DCD with your username and password.
Go to Menu > Analytics > Event Streams for Apache Kafka.
Click Create cluster.
Configure your cluster properties.
Cluster Name: Enter a unique name for your cluster. This name will help you identify the cluster in the dashboard.
Kafka Version: Select the Kafka version you wish to use. Currently, only version 3.7.0 is supported.
Cluster Size: Choose the appropriate size for your cluster:
XS (Extra Small): Suitable for small-scale testing and development environments.
S (Small): Ideal for slightly larger workloads with moderate throughput needs.
M (Medium): Designed for medium-sized workloads with significant data volume and consistent throughput requirements.
L (Large): Suitable for large-scale applications that require high throughput and robust fault tolerance.
XL (Extra Large): Tailored for enterprise-grade, high-performance environments with extremely high throughput and storage needs.
For more details on sizing, refer to the Cluster Sizes section.
Location: Select the region for your cluster. At present, only Germany / Berlin is available.
Choose a datacenter and a LAN.
Datacenter: Select the datacenter and region where you want to create your cluster. The region you choose determines the geographical placement of your Kafka cluster, affecting latency and compliance with local regulations.
Datacenter LAN: Your cluster will be connected to this network.
Configure the addresses for your Kafka brokers. These addresses will be used by clients to connect to the Kafka cluster. Ensure that the addresses are correctly configured to allow for seamless communication between the brokers and your clients.
The IP addresses you choose must belong to the same subnet as the LAN you selected in the previous step. This ensures proper network routing and communication within the cluster. To find out your subnet IP follow the instructions on the DCD screen.
Info: The Estimated costs will be displayed based on the input. It is an estimate and certain variables such as traffic are not considered.
Click Save to deploy your cluster.
Result: Your cluster is now being deployed. You can monitor its progress by returning to the Event Streams for Apache menu.
The Kafka Topic Creation screen allows users to create a new Kafka topic within a specified Kafka cluster. Below are the detailed steps and descriptions of the parameters users need to configure.
Prerequisite: A Kafka cluster must already be deployed and it must be in an Available state. Ensure that your Apache Kafka cluster is up and running and accessible from the Event Streams for Apache Kafka Clusters Overview window.
Log in to the DCD with your username and password.
Go to Menu > Analytics > Event Streams for Apache Kafka.
From the list of clusters, select the Kafka cluster where you want to create the new topic.
Click the Topics tab.
Click the Create topic button to open the topic creation dialog.
In the Create Topic dialog, configure your topic by providing the following values:
Name: Enter the name of the new Kafka topic.
Replication Factor: Specify the replication factor, which determines the number of copies of the data that will be maintained.
Number of Partitions: Define the number of partitions for the topic. Partitions determine how the data is distributed across the brokers.
Retention Time (ms): Set the retention time in milliseconds. This determines how long messages are retained in the topic. If set to -1, no time limit is applied.
Retention Segment Size (B): Specify the retention segment size in bytes. This is the size at which log segments are rolled over.
Note: The value must be greater than or equal to 14 bytes.
Click Create to finalize the topic creation process.
Result: The Kafka cluster is successfully created.
The Kafka Topic Deletion feature allows users to remove a Kafka topic from the specified Kafka cluster. To delete a Kafka topic, follow these steps:
Warning:
Deleting a Kafka topic is irreversible. Once a topic is deleted, all the data contained within it will be permanently removed.
Ensure that you have backed up any necessary data before deleting the topic.
Go to Menu > Analytics > Event Streams for Apache Kafka.
Select the cluster you want to delete a topic from.
Within the cluster, navigate to the Topics tab to view the list of available Kafka topics.
In the topic list, identify the topic you wish to delete.
Select a topic for deletion.
Result: The topic will be permanently deleted.
The Kafka Cluster List feature allows users to view the available Kafka clusters within their environment. Follow the steps below to view the Kafka clusters.
Log in to the DCD with your username and password.
Go to Menu > Analytics > Event Streams for Apache Kafka.
Result: You will be presented with a list of Kafka clusters. The list contains the following details:
— Name: The name of the Kafka cluster. — State: The current status of the Kafka cluster. For example, Available, Degraded, etc. — Location: The data center location where the Kafka cluster is deployed. — Size: The size of the Kafka cluster. — Version: The version of Kafka the cluster is running.
Info: Click on any cluster name in the list to view more detailed information about that specific Kafka cluster.
Info: Use the Options column that is represented by three vertical dots. Clicking this will open a dropdown menu with available management actions for the cluster, such as delete.
Click located in the Options column for the desired Kafka cluster.
