# Cloud GPU VMs

IONOS Cloud Graphics Processing Unit (GPU) VMs deliver high-end accelerated computing with dedicated NVIDIA H200 Tensor Core GPUs, optimized for demanding AI and High-Performance Computing (HPC) workloads. Leverage the 141 GB HBM3e memory and 4.8 TB/s memory bandwidth of the H200 to accelerate Large Language Model (LLM) training, high-speed machine learning inference, and complex 3D rendering.

IONOS Cloud allows you to provision single NVIDIA H200 GPUs with a predictable pricing model. This makes high-end accelerated computing available for research and development, individual developers, and smaller workloads.

{% hint style="info" %}
**Prerequisite:** Before setting up a VM, ensure you have the appropriate privileges:

* Only contract administrators, owners, or users with the **Create Data Center** privilege can set up a [Virtual Data Center (VDC)](#user-content-fn-1)[^1]. For more information, see [<mark style="color:blue;">Set User Privileges for Data Center</mark>](/cloud/set-up-ionos-cloud/get-started/set-user-privileges-data-center.md).
* Other user types have a read-only access and cannot provision changes.
  {% endhint %}

## Product Overview

<table data-view="cards"><thead><tr><th></th><th></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><mark style="color:blue;"><strong>Cloud GPU VMs</strong></mark></td><td>Learn about its configuration templates, storage options, resource usage, and data security.</td><td><a href="/pages/oSueyGhee9xqzrD7tK86">/pages/oSueyGhee9xqzrD7tK86</a></td></tr></tbody></table>

## Quick Links

<table data-view="cards"><thead><tr><th></th><th></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><mark style="color:blue;"><strong>How-Tos</strong></mark></td><td>Create, configure, and manage GPUs using the DCD.</td><td><a href="/pages/cm8zxvFIqBHUjWfrLAsb">/pages/cm8zxvFIqBHUjWfrLAsb</a></td></tr><tr><td><mark style="color:blue;"><strong>API How-Tos</strong></mark></td><td>Create, configure, and manage GPUs using the API.</td><td><a href="/pages/AhuBRqtUuukMCGleexMn">/pages/AhuBRqtUuukMCGleexMn</a></td></tr></tbody></table>

## Developer Tools

<table data-view="cards"><thead><tr><th></th><th></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><mark style="color:blue;"><strong>Cloud API</strong></mark></td><td>Access the Cloud API documentation for Cloud GPU VMs.</td><td><a href="https://api.ionos.com/docs/cloud/v6/#tag/Templates">https://api.ionos.com/docs/cloud/v6/#tag/Templates</a></td></tr><tr><td><mark style="color:blue;"><strong>SDKs</strong></mark></td><td>Interact with the Cloud GPU VMs using <strong>GO</strong> SDKs.</td><td><a href="https://docs.ionos.com/cloud/reference/software-development-kits/sdks/cloud-api-sdks">https://docs.ionos.com/cloud/reference/software-development-kits/sdks/cloud-api-sdks</a></td></tr><tr><td><mark style="color:blue;"><strong>Config Management Tools</strong></mark></td><td>Explore <strong>Terraform</strong> and <strong>ionosctl</strong> configuration management tools compatible with Cloud GPU VMs.</td><td><a href="https://docs.ionos.com/cloud/reference/config-management-tools/config-management-tools">https://docs.ionos.com/cloud/reference/config-management-tools/config-management-tools</a></td></tr></tbody></table>

## Frequently Asked Questions (FAQ)

<table data-view="cards"><thead><tr><th></th><th></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><mark style="color:blue;"><strong>FAQ</strong></mark></td><td>Get answers to the most commonly encountered questions about Cloud GPU VMs.</td><td><a href="/pages/fQseendxRHJZPScM8ODR">/pages/fQseendxRHJZPScM8ODR</a></td></tr></tbody></table>

[^1]: A collection of cloud resources used for creating an enterprise-grade IT infrastructure. VDC resources include the processors, memory, disk space, and networks from which virtual machines are built.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.ionos.com/cloud/compute-services/compute-engine/cloud-gpu-vm.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.