Mistral Nemo 12B

Summary: Mistral Nemo is a compact yet powerful 12B-parameter language model co-developed with NVIDIA, designed specifically for conversational agents and virtual assistants. This French-engineered model features an advanced Tekken tokenizer that provides superior efficiency for European languages, making it ideal for applications requiring fast response times while maintaining high-quality multilingual performance across German, French, Spanish, Italian, and Portuguese.

Intelligence	Speed	Sovereignty	Input	Output
Low	High	Moderate	Text	Text

Central parameters

Description: Mistral Nemo replaces Mistral 7B as the latest generation small language model, offering enhanced performance with 12.2B parameters and a 128k context window. The model utilizes fp8 quantization for optimized inference efficiency.

Model identifier: mistralai/Mistral-Nemo-Instruct-2407

IONOS CLOUD AI Model Hub Lifecycle and Alternatives

IONOS start date	End of Life	Alternative	Successor
May 15, 2025	N/A	Llama 3.1 (8B)

Origin

Provider	Country	License	Flavor	Release
Mistral AI	France	License	Instruct	July 18, 2024

Technology

Context window	Parameters	Quantization	Multilingual	Further details
128k	12.2B	fp8	Yes	Hugging Face

Modalities

Text	Image	Audio
Input and output	Not supported	Not supported

Endpoints

Chat Completions	Embeddings	Image generation
v1/chat/completions	Not supported	Not supported

Features

Streaming	Reasoning	Tool calling
Supported	Not supported	Supported

Usage example

Chat completions

The following example demonstrates how to use Mistral Nemo for instructional tasks, using a descriptive prompt to explain complex concepts clearly.

API Endpoint: POST https://openai.inference.de-txl.ionos.com/v1/chat/completions

Request:

{
  "model": "mistralai/Mistral-Nemo-Instruct-2407",
  "messages": [
    {
      "role": "user",
      "content": "Explain the concept of quantum entanglement to a 5-year-old using simple analogies."
    }
  ],
  "temperature": 0.7,
  "top_p": 0.9,
  "n": 1,
  "stream": false,
  "max_tokens": 1000
}

Response:

{
  "id": "chatcmpl-456",
  "object": "chat.completion",
  "created": 1677652290,
  "model": "mistralai/Mistral-Nemo-Instruct-2407",
  "choices": [{
    "index": 0,
    "message": {
      "role": "assistant",
      "content": "Imagine you have two magic dice. No matter how far apart they are, even if one is on Earth and the other is on Mars, if you roll a 6 on one, the other one will instantly show a 6 too! They are connected in a special way that lets them 'talk' to each other instantly."
    },
    "finish_reason": "stop"
  }],
  "usage": {
    "prompt_tokens": 25,
    "completion_tokens": 60,
    "total_tokens": 85
  }
}

Rate limits

Rate limits ensure fair usage and reliable access to the AI Model Hub. In addition to the contract-wide rate limits, no model-specific limits apply.