Connect data through AWS S3

  • Updated on Oct 22, 2025
  • Published on Jul 6, 2023
Prev Next
📘Note

This document describes how to onboard logs from a variety of products into Hunters through AWS S3. Click here to learn how to onboard AWS logs to Hunters.

❗IMPORTANT 1

To maintain optimal pipeline performance and minimize the risk of disruptions, we currently support the ingestion of files of up to 50MB (after compression).

❗IMPORTANT 2

Please make sure all of your log files has suffix (.csv, .json, .txt, .cef etc..) otherwise - they won't be ingested well and the data source (dataflow) will FAIL.


This guide will teach you how to allow Hunters to access an S3 bucket to retrieve your logs. To complete the connection, follow all of the steps listed below:

  1. Create an S3 bucket
  2. Direct logs to your S3 bucket
  3. Set up bucket access
  4. Set up S3 streaming


💡Tip

If you don't have access to open an AWS S3 bucket, you can direct this data to a Hunters-operated bucket. Contact Hunters to learn more.