Text Generation

The IONOS CLOUD AI Model Hub offers an OpenAI-compatible API that enables powerful text generation capabilities through foundation models. These Large Language Models (LLMs) can perform a wide variety of tasks, such as generating conversational responses, summaries, and contextual answers, without requiring you to manage hardware, or extensive infrastructure.

Supported text generation models

All Large Language Models shown on the AI Model Hub Models page can be used for text generation. Review the individual model cards to find the best solution for your specific application.

Overview

In this guide, you will learn how to generate text using foundation models through the IONOS CLOUD API. This guide is intended for developers with basic knowledge of:

• REST APIs
• A programming language for handling REST API endpoints (Python and Bash examples are provided)

By the end, you will be able to:

1. Retrieve a list of text generation models available in the IONOS CLOUD AI Model Hub.
2. Apply prompts to these models to generate text responses, supporting applications like virtual assistants and content creation.

Getting started with text generation

To use text generation models, first set up your environment and authenticate using the OpenAI-compatible API endpoints.

Download the respective code files to use text generation-specific scripts and examples and generate the intended output:

Python Notebook

Download this Python Notebook file to use text generation-specific scripts and examples and generate the intended output.

12KB

ai-model-hub-text-generation.ipynb

Open

Python Code

Download this Python code file to use text generation-specific scripts and examples and generate the intended output.

2KB

ai-model-hub-text-generation.py

Open

Bash Code

Download this Bash code file to use text generation-specific scripts and examples and generate the intended output.

1KB

ai-model-hub-text-generation.sh

Open

Step 1: Retrieve Available Models

Fetch a list of models to see which are available for your use case:

Python

# Python example to retrieve available models
import requests

IONOS_API_TOKEN = "[YOUR API TOKEN HERE]"

endpoint = "https://openai.inference.de-txl.ionos.com/v1/models"

header = {
    "Authorization": f"Bearer {IONOS_API_TOKEN}", 
    "Content-Type": "application/json"
}
requests.get(endpoint, headers=header).json()

Bash

#!/bin/bash

IONOS_API_TOKEN=[YOUR API TOKEN HERE]

curl -H "Authorization: Bearer ${IONOS_API_TOKEN}" \
     --get https://openai.inference.de-txl.ionos.com/v1/models

This query returns a JSON document listing each models name, which you’ll use to specify a model for text generation in later steps.

Step 2: Generate Text with Your Prompt

To generate text, send a prompt to the chat/completions endpoint.

Python

# Python example for text generation
import requests

IONOS_API_TOKEN = "[YOUR API TOKEN HERE]"
MODEL_NAME = "[MODEL NAME HERE]"
PROMPT = [
    {"role": "system", "content": "You are a helpful assistant."},
    {"role": "user", "content": "Hello!"}
  ]

endpoint = "https://openai.inference.de-txl.ionos.com/v1/chat/completions"

header = {
    "Authorization": f"Bearer {IONOS_API_TOKEN}", 
    "Content-Type": "application/json"
}
body = {
    "model": MODEL_NAME,
    "messages": PROMPT,
}
requests.post(endpoint, json=body, headers=header).json()

Bash

#!/bin/bash

IONOS_API_TOKEN=[YOUR API TOKEN HERE]
MODEL_NAME=meta-llama/Meta-Llama-3.1-8B-Instruct 
PROMPT='[
    {"role": "system", "content": "You are a helpful assistant."},
    {"role": "user", "content": "Hello!"}
]'

BODY="{ 
    \"model\": \"$MODEL_NAME\",
    \"messages\": $PROMPT
}"
echo $BODY

curl -H "Authorization: Bearer ${IONOS_API_TOKEN}" \
     -H "Content-Type: application/json" \
     -d "$BODY" \
     https://openai.inference.de-txl.ionos.com/v1/chat/completions

Step 3: Extract and Interpret the Result

The returned JSON includes several key fields, most importantly:

• choices.[].message.content: The generated text based on your prompt.
• usage.prompt_tokens: Token count for the input prompt.
• usage.completion_tokens: Token count for the generated output.

What you learned

In this guide, you learned how to:

1. Access available text generation models.
2. Use prompts to generate text responses, ideal for applications such as conversational agents, content creation, and more.

For information on image generation, see text-to-image models.