Send Logs to the Platform

You can send logs to the Logging Service using Fluent Bit. Based on your infrastructure—Kubernetes, Docker, Linux Systemd, or HTTP—the configuration differs.

Prerequisites:

A Ready pipeline instance. To obtain tcpAddress or httpAddress, see Set Up a Logging Pipeline.
A key obtained from the REST API.
Fluent Bit installed on your system. For more information, refer to the Getting Started with Fluent Bit Documentation.

Obtain the pipeline endpoint

After creating a pipeline, the response includes either a tcpAddress or httpAddress. Save this value.

Example TCP endpoint:

12be6dbe134f-logs.3b0b424eb27f.logging.de-txl.ionos.com

Example HTTP endpoint:

https://12be6dbe134f-logs.3b0b424eb27f.logging.de-txl.ionos.com

Obtain a key

Use the Shared_Key (TCP) or APIKEY (HTTP) returned when you created the pipeline for authentication. To generate a new key, see Obtain a new Key.

Configure Fluent Bit

Each log source requires the pipeline endpoint and a key.

Install the Fluent Bit package for your Kubernetes distribution. For more information, refer to the Fluent Bit on Kubernetes Documentation.
Update the Fluent Bit configuration with the tcpAddress and Shared_Key.
Run Fluent Bit to forward logs to the Logging Service.

[OUTPUT]
    Name            forward
    Match           *
    Port            9000
    Tag             <TAG>
    Host            <TCP_ENDPOINT>
    tls             on
    Shared_Key      <KEY>

Warning: The port must be set to 9000 when using TCP.

Note: For more information, refer to the Kubernetes configuration examples.

Install the Fluent Bit package for Docker. For more information, refer to the Fluent Bit on Docker Documentation.
Update the Fluent Bit configuration with the tcpAddress and Shared_Key.
Run Fluent Bit to forward logs to the Logging Service.

[OUTPUT]
    Name            forward
    Match           *
    Port            9000
    Tag             <TAG>
    Host            <TCP_ENDPOINT>
    tls             on
    Shared_Key      <KEY>

Warning: The port must be set to 9000 when using TCP.

Note: For more information, refer to the Docker configuration examples.

Install the appropriate Fluent Bit package for your Linux distribution. For more information, refer to the Getting Started with Fluent Bit Documentation.
Update the Fluent Bit configuration with the tcpAddress and Shared_Key.
Run Fluent Bit to forward logs to the Logging Service.

[OUTPUT]
    Name            forward
    Match           *
    Port            9000
    Tag             <TAG>
    Host            <TCP_ENDPOINT>
    tls             on
    Shared_Key      <KEY>

Warning: The port must be set to 9000 when using TCP.

Note: For more information, refer to the Linux Systemd configuration examples.

Send logs directly via the HTTP REST endpoint. Only JSON-formatted logs are supported.

curl --location \
--request POST 'https://<HTTP_ENDPOINT>/<TAG>' \
--header 'Content-Type: application/json' \
--header 'APIKEY: <KEY>' \
--data '{
    "status": "Ready",
    "ts": 1580306777.04728,
    "pod": {
        "name": "Example Name",
        "namespace": "data"
    },
    "msg": "Pod status updated",
    "level": "error",
    "label_1": "test label"
}'

Alternatively, configure Fluent Bit to use the HTTP output plugin:

[OUTPUT]
    Name            http
    Match           *
    Host            <HTTPS_ENDPOINT>
    URI             /<TAG>
    Format          json
    Header          APIKEY <KEY>
    tls             on
    Port            443

Troubleshooting

Verify: Open the Logging Service dashboard and confirm that logs appear.
Invalid key: Check that you copied the correct Shared_Key or APIKEY.
Connection errors: Verify outbound access on port 9000 (TCP) or port 443 (HTTP).
No logs displayed: Enable verbose logging in Fluent Bit:

[OUTPUT]
    Log_Level      debug

For more information, see Fluent Bit global configuration.

PreviousQuick Start NextAccess Logs from the Platform

Last updated 10 days ago

Was this helpful?

Good morning

hashtagObtain the pipeline endpoint

hashtagObtain a key

hashtagConfigure Fluent Bit

hashtagTroubleshooting

Obtain the pipeline endpoint

Obtain a key

Configure Fluent Bit

Troubleshooting