Create a Kafka Cluster

Prerequisites

  • Before setting up a Kafka Cluster, ensure that you are working within a provisioned Virtual Data Center (VDC) that contains at least one VM in a private LAN, which will access the cluster via the private LAN. The VM you create is counted against the quota allocated in your contract.

Create a cluster

To create a Kafka cluster, follow these steps:

  1. Log in to the DCD with your username and password.

  2. Go to Menu > Analytics > Event Streams for Apache Kafka.

Select Event Streams for Apache Kafka from the menu
  1. Click Create cluster.

Create cluster
  1. Configure your cluster properties.

Create cluster
  • Cluster Name: Enter a unique name for your cluster. This name will help you identify the cluster in the dashboard.

  • Kafka Version: Select the Kafka version you wish to use. Currently, only version 3.7.0 is supported.

  • Cluster Size: Choose the appropriate size for your cluster:

    • XS (Extra Small): Suitable for small-scale testing and development environments.

    • S (Small): Ideal for slightly larger workloads with moderate throughput needs.

    • M (Medium): Designed for medium-sized workloads with significant data volume and consistent throughput requirements.

    • L (Large): Suitable for large-scale applications that require high throughput and robust fault tolerance.

    • XL (Extra Large): Tailored for enterprise-grade, high-performance environments with extremely high throughput and storage needs.

  • For more details on sizing, refer to the Cluster Sizes section.

  • Location: Select the region for your cluster. At present, only Germany / Berlin is available.

  1. Choose a datacenter and a LAN.

Create cluster
  • Datacenter: Select the datacenter and region where you want to create your cluster. The region you choose determines the geographical placement of your Kafka cluster, affecting latency and compliance with local regulations.

  • Datacenter LAN: Your cluster will be connected to this network.

  1. Configure the addresses for your Kafka brokers. These addresses will be used by clients to connect to the Kafka cluster. Ensure that the addresses are correctly configured to allow for seamless communication between the brokers and your clients.

    The IP addresses you choose must belong to the same subnet as the LAN you selected in the previous step. This ensures proper network routing and communication within the cluster. To find out your subnet IP follow the instructions on the DCD screen.

Info: The Estimated costs will be displayed based on the input. It is an estimate and certain variables such as traffic are not considered.

Estimated Costs
  1. Click Save to deploy your cluster.

Save

Result: Your cluster is now being deployed. You can monitor its progress by returning to the Event Streams for Apache menu.

The cluster is deploying

Last updated