Modify the Log Retention Policy

Each log stream in your pipeline is initially assigned a default data retention policy of 30 days. The logs for each log stream are retained for the specified number of days. However, you can define a custom retention policy for each log stream. The available options for retention periods include 7, 14, and 30 days.

Note: You can alternatively use the PATCH request to update the retention policy of an existing pipeline.

The following is an example:

curl --location \
--request POST 'https://logging.de-txl.ionos.com/pipelines' \
--header 'Content-Type: application/json' \
--header 'Authorization: Bearer $TOKEN' \
--data '{
          "properties": {
    "name": "demo",
    "logs": [
      {
        "source": "kubernetes",
        "protocol": "http",
        "tag": "k8s",
        "destinations": [
          {
            "type": "loki",
            "retentionInDays": 7
          }
        ]
      }
    ]
  }
}'

Unlimited Log Retention

To set the retention period for each log stream to unlimited, use the following request:

curl --location \
--request POST 'https://logging.de-txl.ionos.com/pipelines' \
--header 'Content-Type: application/json' \
--header 'Authorization: Bearer $TOKEN' \
--data '{
          "properties": {
    "name": "demo",
    "logs": [
      {
        "source": "kubernetes",
        "protocol": "http",
        "tag": "k8s",
        "destinations": [
          {
            "type": "loki",
            "retentionInDays": 0
          }
        ]
      }
    ]
  }
}'

Note: The retention period is set to unlimited when the retentionInDays value is set to 0.

Access to the data

In Grafana, you can only access the data for a maximum of 30 days. To access the archived data (logs with unlimited retention), contact IONOS Cloud Support.

You must provide the following information while requesting access:

• Contract number

• Pipeline ID

• Log stream tag

• The date range for which you need access to the data

• S3 bucket information:

  • Name

  • Region

  • S3 endpoint

Note: Ensure that the S3 Canonical User ID you receive from IONOS Cloud Support is assigned to the designated bucket. Additionally, confirm that write access has been granted to this specific bucket.

After receiving the required information, IONOS transfers the archived data into the designated S3 bucket. Following the successful upload, the data becomes accessible from within the S3 bucket. To add the grantee to your bucket, see the instructions.

Note: Storing logs for an indefinite period will increase storage costs. Our pricing for long-term log storage aligns with our standard S3 pricing model.