This feature is in beta. Please contact the Support team or your account manager to request early access.
To send your Prometheus application metrics to a Logz.io Infrastructure Monitoring account, use remote write to connect to Logz.io as the endpoint. Your data is formatted as JSON documents by the Logz.io listener.
Multiple server environments: If you have multiple Prometheus server instances, you’ll have to add Logz.io as an endpoint for each instance.
Reduce tagging: By default, all the metrics from your Prometheus server(s) are sent to Logz.io. To drop or send specific metrics, add Prometheus labeling before enabling the remote write, or as part of the remote write configuration. Learn more about Prometheus relabeling tricks here .
Paralleism levels: Set the parallelism level for sending data in the configuration file. This parameter determines the number of connections to open to the remote write listener. The default parallelism level is 1000. We recommend configuring much fewer connections. Of course, if you’re sending more data you’ll need to open more channels. (currently in development)
We’re currently refining our best practice recommendations for configuring connection channels when sending data.
Metrics metadata dashboards: If you have both Prometheus & Grafana, you can activate a dashboard as part of the remote write configuration that will show you the queue size and how many metrics you’re sending. If your queue size increases, it might be necessary to open an additional channel. (currently in development)
Learn more about Prometheus remote write tuning here .
Once your metrics are flowing, export your existing Prometheus and Grafana dashboards to Logz.io Infrastructure Monitoring as JSON files.
Configuring Remote Write to Logz.io
Get your Logz.io Infrastructure Monitoring account information
Within Logz.io, look up the Listener host for your region (URL) and the Logz.io Metrics Account token.
You’ll find the correct Region and Listener URL for your region in the Regions and Listener Hosts table.
Look up your Metrics account information in the Manage Accounts ( > Settings > Manage accounts) page of your Operations workspace. Click the relevant Metrics account plan to display its details, including your Metrics account token.
Add a remote_write url
Add the following parameters to your Prometheus yaml file:
|external_labels||Parameter to tag the metrics from this specific Prometheus server. Do not change the label
|remote_write||The remote write section configuration sets Logz.io as the endpoint for your Prometheus metrics data. Place this section at the same indentation level as the
|url||Logz.io Listener url for for your region, configured to use port 8052 for http traffic or port 8053 for https traffic. For more details, see the Prometheus configuration file remote write reference|
|bearer_token||Logz.io Metrics account token|
global: external_labels: p8s_logzio_name: <labelvalue> remote_write: - url: https://<the Logz.io Listener URL for your region>:8053 bearer_token: <your Logz.io Metrics account token> remote_timeout: 30s queue_config: batch_send_deadline: 5s #default = 5s max_shards: 10 #default = 1000 min_shards: 1 max_samples_per_send: 500 #default = 100 capacity: 10000 #default = 500
Verify the remote_write configuration
To check that the remote_write configuration is working properly, run a query on your local Prometheus for the metric
prometheus_remote_storage_succeeded_sample_total and verify that the result is greater than zero (n > 0) for the url.