Overview

The IONOS AI Model Hub is designed to simplify the deployment and management of advanced machine learning models, eliminating the complexities associated with hardware and infrastructure. This service hosts a range of powerful AI models that facilitate developers' implementation of sophisticated AI solutions without worrying about underlying hardware and operational overheads.

IONOS' AI Model Hub supports various use cases, including:

• Foundation Models: Utilize pre-trained Large Language Models (LLMs) and text-to-image models.

• Document Embeddings: Store and query extensive document collections based on semantic similarity.

• Retrieval Augmented Generation (RAG): Enhance responses by combining LLMs with contextually relevant documents stored in a vector database.

Features

The IONOS AI Model Hub Service offers a wide array of features tailored to meet the needs of modern developers:

1. Managed Hosting: Utilize AI models without needing to maintain the underlying infrastructure.

2. Security and Compliance: Keep your data secure and compliant with regulations, as data processing is confined within Germany. Your input data is not used for training purposes in any way.

3. Scalability: Scale your AI deployments seamlessly based on your needs.

4. Integration Options: Easily integrate with your applications using REST APIs, with support for popular programming languages like Python and Bash.

5. Diverse Model Offerings: Choose from various foundation models, including LLMs and text-to-image models, each capable of generating innovative and sophisticated AI outputs.

6. Document Embeddings: Store and manage document collections and perform semantic similarity searches to extract contextually relevant information.

7. Retrieval Augmented Generation: Combine vector databases and foundation models to generate enhanced outputs that are contextually aware, providing more accurate and helpful responses.

8. Token-based Billing: Pay for the services based on the number of tokens used, enabling cost-efficient usage and transparency in billing.

Concepts

Understanding the foundational concepts of the IONOS AI Model Hub will help you leverage its full potential:

Foundation Models

Foundation models are pre-trained on massive datasets to perform a wide range of language and image processing tasks. They can generate text, answer questions, and create images based on textual descriptions. With IONOS, you can access these models via APIs, simplifying the process of integrating advanced AI capabilities into your applications.

Key Points:

• Access various open-source LLMs and text-to-image models.

• Use models without managing underlying hardware.

• Maintain data privacy and comply with German data protection regulations.

Document Embeddings

Vector databases provide a way to store and manage document collections, enabling semantic similarity searches. Documents are converted to embeddings (vector representations), allowing the discovery of related content through similarity searches.

Key Points:

• Persist documents and search for semantically similar content.

• Use API endpoints to manage document collections and perform searches.

• Ensure document storage and processing stays within Germany.

Retrieval Augmented Generation (RAG)

RAG combines the capabilities of foundation models and vector databases to improve the quality of responses. By supplementing the inherent knowledge of LLMs with specific, contextually relevant information from document collections, RAG provides more accurate and detailed answers.

Key Points:

• Use foundation models together with document collections from vector databases.

• Improve response accuracy and relevance by incorporating additional context.

• Implement sophisticated AI solutions using a combination of querying and generation.

Components

API Endpoints

Use dedicated REST API endpoints to interact with various models and services. These endpoints are designed to facilitate the quick and easy integration of AI capabilities into your applications.

1. Model Management: Endpoints for retrieving model lists, querying models, and managing predictions.

2. Document Management: Endpoints for creating, modifying, retrieving, and deleting document collections and individual documents.

3. Querying and Generating: Endpoints for combining semantic searches with generative models to implement RAG scenarios.

Authentication and Authorization

Security is paramount, and IONOS provides robust mechanisms to authenticate and authorize API requests. Users must generate and use API tokens to access the AI services securely.

Data Privacy and Compliance

IONOS ensures that all data processing complies with German and European data protection regulations. Your data is processed within Germany, providing an additional layer of security and compliance.

Technical Support

IONOS offers expert technical support to help you troubleshoot and optimize your AI deployments. Whether you need assistance with API integration or model performance, the support and Professional Service team is available to ensure your success during German business hours.

Backup of Collections in Vector Database

IONOS does not backup the data saved to collections in the vector database. Please ensure that you can restore the content of your collections in case of deletion.