Once you have your data lake set up to receive data, it's time to connect your organization's products to continuously stream logs into the data lake.
Hunters integrates with hundreds of Data source products in multiple connection methods. You can also set up a custom data source connection if you can't find the specific product on our list of supported data sources. Each of these logs has different characteristics and variables.
TL;DR
This is a summary of different aspects in the Hunters log ingestion schema:
Data source | The name of the company or the product from which the logs originate. | AWS, Microsoft, Oracle, etc. |
Data type | The specific name of the logs. | AWS CloudTrail, Cisco AMP, etc. |
Collection method | The supported methods of collecting the logs. | Webhook, API, intermediary storage, etc. |
Format | The structure and language we expect to receive the logs in | JSON, CSV, CEF, etc. |
Here are a few terms that will help you navigate through log ingestion:
Data source
The technology or product supported by Hunters for ingestion. For instance, Microsoft, 1Password, Linux, Oracle, Okta.
Data type
The specific logs supported from the vendor/product. For instance, from Claroty, we currently support the following log types: Claroty SRA events and Claroty CTD events. Note that Hunters is constantly expanding to support more log types.
Collection Method
The supported methods of collecting the logs. Hunters provides several methods to collect your logs, depending on the vendor of the logs and the available connectivity options. Most log types can be collected using one method, but for some, multiple options are available.
The collection from some vendors/technologies may still be considered under BETA support, and is utilized by Hunters next-generation ingestion infrastructure consisting of generic API collectors such as Pullers or Streamers. While such collection methods may be utilized by Hunters for the ingestion of some log types, it is considered BETA and may not meet GA quality (e.g., performance, monitoring etc.).
📘Learn more
Learn more about collection methods here.
Format
Many technologies may have different ways of shipping their logs, whether it is CEF, CSV, NDJSON and so on. For each technology or product, it is stated what format is currently supported by Hunters.
Supported data sources
You can find the full list of supported data sources, logs, collection methods and log formats here.
📘In this section