Llama 3.1 8B

Deprecated: Llama 3.1 8B is deprecated and will be removed on October 1, 2026. We recommend migrating to Qwen3.5-9B, its designated successor.

After removal, requests using this model ID receive an HTTP 400 Bad Request response with an "Invalid model name" error, instead of being served by the model.

Summary: Llama 3.1 8B is a compact, highly efficient language model from Meta's flagship Llama family, optimized for conversational agents and real-time applications. With an impressive 128k token context window and robust multilingual support, this model delivers exceptional performance for chatbots, virtual assistants, and interactive applications where speed, responsiveness, and accuracy are crucial while maintaining high-quality natural language understanding.

Intelligence	Speed	Input	Output
Low	High	Text	Text

Central parameters

Description: Latest small-sized model from Meta's Llama 3.1 series with optimized architecture for efficient inference.

Model identifier: meta-llama/Meta-Llama-3.1-8B-Instruct

IONOS CLOUD AI Model Hub Lifecycle and Alternatives

IONOS CLOUD start date	End of Life	Alternative	Successor
July 1, 2024	N/A	Nemo (12B)

Origin

Provider	Country	License	Flavor	Release
Meta	USA	License	Instruct	July 23, 2024

Technology

Context window	Parameters	Quantization	Multilingual	Further details
128k	8.03B	fp8	Yes	Hugging Face

Modalities

Text	Image	Audio
Input and output	Not supported	Not supported

Endpoints

Chat Completions	Embeddings	Image generation
v1/chat/completions	Not supported	Not supported

Features

Streaming	Reasoning	Tool calling
Supported	Not supported	Supported

Usage example

Chat completions

The following example demonstrates how to use Llama 3.1 8B for conversational tasks.

API Endpoint: POST https://openai.inference.de-txl.ionos.com/v1/chat/completions

Request:

{
  "model": "meta-llama/Meta-Llama-3.1-8B-Instruct",
  "messages": [
    {
      "role": "user",
      "content": "Compose a short poem about the sea."
    }
  ],
  "temperature": 0.7,
  "max_tokens": 100
}

Response:

{
  "id": "chatcmpl-123",
  "object": "chat.completion",
  "created": 1677652288,
  "model": "meta-llama/Meta-Llama-3.1-8B-Instruct",
  "choices": [{
    "index": 0,
    "message": {
      "role": "assistant",
      "content": "The waves whisper secrets to the sand,\nA salt-kissed breeze sweeps across the land.\nBlue horizons stretch endlessly wide,\nWith the rhythm of the eternal tide."
    },
    "finish_reason": "stop"
  }],
  "usage": {
    "prompt_tokens": 15,
    "completion_tokens": 30,
    "total_tokens": 45
  }
}

Rate limits

Rate limits ensure fair usage and reliable access to the AI Model Hub. In addition to the contract-wide rate limits, no model-specific limits apply.