Llama 3.1 8B

AI Model Hub for Free: From December 1, 2024, to June 30, 2025, IONOS is offering all foundation models in the AI Model Hub for free. Create your contract today and kickstart your AI journey!

Summary: Small sized US model for conversational agents and virtual assistants trained by Meta.

Intelligence	Speed	Sovereignty	Input	Output
Low	High	Low	Text	Text

Central parameters

Description: Meta Llama 3.1 8B is the most recent small-sized model that Meta trained. Meta Llama 3.1 8B is especially suited for use cases for which response time is crucial and natively supports various European languages but focuses on English.

Model identifier: meta-llama/Meta-Llama-3.1-8B-Instruct

IONOS AI Model Hub Lifecycle and Alternatives

IONOS Launch	End of Life	Alternative	Successor
July 1, 2024	N/A	Nemo (12B)

Origin

Provider	Country	License	Flavor	Release
Meta	USA	License	Instruct	July 23, 2024

Technology

Context window	Parameters	Quantization	Multilingual
128k	8.03B	fp8	Yes

Modalities

Text	Image	Audio
Input and output	Not supported	Not supported

Endpoints

Chat Completions	Embeddings	Image generation
v1/chat/completions	Not supported	Not supported

Features

Streaming	Tool calling
Supported	Supported

Rate limits

Rate limits ensure fair usage and reliable access to the AI Model Hub. In addition to the contract-wide rate limits, no model-specific limits apply.