Configuration

Before you begin, you’ll need:

  • s3:ListBucket and s3:GetObject permissions for the required S3 bucket

  • File names in ascending alphanumeric order. This is important because the S3 fetcher’s offset is determined by the name of the last file fetched. We recommend using standard AWS naming conventions to determine the file name ordering and to avoid log duplication.

Send your logs to an S3 bucket

Logz.io fetches your VPC Flow logs from an S3 bucket. VPC Flow logs are not stored in S3 by default, so you’ll need to set up AWS to send your Flow logs to S3.

For help with this, see Publishing Flow Logs to Amazon S3 from AWS.

Add the S3 bucket information

To use the S3 fetcher, fill out the S3 bucket information on the VPC log shipping page. You must be logged in to Logz.io.

Check Logz.io for your logs

Give your logs some time to get from your system to ours, and then open Kibana.

If you still don’t see your logs, see log shipping troubleshooting.