Jenkins is an automation server for building, testing, and deploying software. This integration allows you to send logs from your Jenkins servers to your account.

Shipping Jenkins logs with Filebeat

Before you begin, you’ll need:

  • Filebeat installed
  • Root access
  • Port 5015 open
Download the public certificate to your credentials server

For HTTPS shipping, download the public certificate to your certificate authority folder.

sudo curl --create-dirs -o /etc/pki/tls/certs/COMODORSADomainValidationSecureServerCA.crt
Add Jenkins as an input

In the Filebeat configuration file (/etc/filebeat/filebeat.yml), add Jenkins to the filebeat.inputs section.

Replace <<LOG-SHIPPING-TOKEN>> with the token of the account you want to ship to. Replace <> with home location of your Jenkins installation

# ...
- type: log
  - /var/log/jenkins/jenkins.log
  - /var/<<JENKINS-HOME>>/jobs/*/builds/lastFailedBuild/log
    logzio_codec: plain

    # You can manage your tokens at
    token: <<LOG-SHIPPING-TOKEN>>
    type: jenkins
  fields_under_root: true
  encoding: utf-8
  ignore_older: 3h
    pattern: '^[A-Z]{1}[a-z]{2} {1,2}[0-9]{1,2}, [0-9]{4} {1,2}[0-9]{1,2}:[0-9]{2}:[0-9]{2}'
    negate: true
    match: after

If you’re running Filebeat 8.1+, the type of the filebeat.inputs is filestream instead of logs:

- type: filestream
    - /var/log/*.log

If you’re running Filebeat 7, paste this code block. Otherwise, you can leave it out.

# ... For Filebeat 7 only ...
filebeat.registry.path: /var/lib/filebeat
- rename:
    - from: "agent"
      to: "filebeat_agent"
    ignore_missing: true
- rename:
    - from: "log.file.path"
      to: "source"
    ignore_missing: true

If you’re running Filebeat 6, paste this code block.

# ... For Filebeat 6 only ...
registry_file: /var/lib/filebeat/registry

The above configuration assumes the following defaults:

  • Log location - /var/log/jenkins/jenkins.log
  • Log type - jenkins
Set as the output

If is not an output, add it now. Remove all other outputs.

Replace <<LISTENER-HOST>> with the host for your region. For example, if your account is hosted on AWS US East, or if hosted on Azure West Europe.

# ...
  hosts: ["<<LISTENER-HOST>>:5015"]
    certificate_authorities: ['/etc/pki/tls/certs/COMODORSADomainValidationSecureServerCA.crt']
Start Filebeat

Start or restart Filebeat for the changes to take effect.

Check for your logs

Give your logs some time to get from your system to ours, and then open Kibana. You can search for type:jenkins to filter for your Jenkins logs. Your logs should be already parsed thanks to the preconfigured parsing pipeline.

If you still don’t see your logs, see log shipping troubleshooting.