In order to send logs to the logging platform, there are a few requirements you need to have:

1. A Ready pipeline instance so that you can obtain tcpAddress or httpAddress.

2. A key that you already obtained.

3. FluentBit log agent installed in your platform (see more).

Based on your infrastructure, whether it is kubernetes, docker, or systemd, you may follow different instructions to set up and install FluentBit. However, there are a few pieces of information that you always need to configure FluentBit's output section:

• The log server endpoint, which is tcpAddress or httpAddress based on your log source.

• The Key that is needed for the authentication.

• The Tag that you defined while creating the pipeline.

Here is an example of a FluentBit configuration that needs an Endpoint, Tag, and Key:

[OUTPUT]
    Name            forward
    Match           *
    Port            9000
    Tag             <TAG>
    Host            <TCP_ENDPOINT>
    tls             on
    Shared_Key      <KEY>

Troubleshooting

FluentBit can be configured to expose more verbose logs for troubleshooting purposes.

[OUTPUT]
    Log_Level      debug

For more information, see FluentBit global configuration.

Eventually, you need to be able to use a platform for visualization and report purposes. We are using Grafana to enable you to meet your visualization needs.

To obtain your Grafana instance address, you can send a GET request for a pipeline. In the response, you can find grafanaAddress. This information is available, and the same for all your pipelines.

After following the necessary steps to create a logging pipeline via the REST API, there are two main steps that need to be made to complete the whole logging pipeline process: