Skip to content

Releases: criblpacks/cribl-splunk-uf-internal-redux

Change to default metrics destination

09 Dec 19:41
Compare
Choose a tag to compare

If you enable Aggregations on the metrics source, the default index is now _metrics. This should NOT impact your license. If you change to another index, it likely will. No guarantees made.

Better docs, better Suppression

08 Dec 00:46
Compare
Choose a tag to compare

Replaced the wonky Aggregation monster I had created and replaced with a straight Suppress play. It's much simpler and does the same thing. Comments were updated as well, to both reflect this new change as well as better describe what's happening.

Maintenance update of The Cribl Pack for Splunk UF Internal

28 Jul 17:43
Compare
Choose a tag to compare

Updated readme and comments. Updated regex for drop match to be more efficient

The Cribl Pack for Splunk Internal - Initial Release

28 Jul 00:19
d6ee482
Compare
Choose a tag to compare

Internal logs do not count against index, but they surely impact your resource utilization. In my experience, 5-7% of enterprise deployments' resources are consumed by UF internal logs. Some of these logs can be useful, but most are not.

In this case we are:

  • Dropping any splunkd logs at DEBUG or TRACE level
  • Aggregating repetitive splunkd.logs based on component-level ID in a lookup file
  • A repeat count will be added to the logs allowed through.
  • Dropping any metrics logs that are not either name and group =thruput, or group=per_*_thruput
  • Optionally aggregating these based on a lookup value for farm
  • Optionally:
  • Aggregation logs will still end up in _internal, with sourcetype and source == 'metrics:agg'
  • OR - Aggregated stats will be sent to a metrics store (metrics index is metrics, adjust as needed in the Aggregation functions)
  • Dropping any introspection logs
  • For splunkd and metrics logs that do make it through, optionally trim the timestamp off _raw
  • Trim source to just the file name (eg, ./splunkd.log)

The Cribl Pack for Splunk UF Internal - Initial Pack Release

28 Jul 00:15
d6ee482
Compare
Choose a tag to compare

Internal logs do not count against index, but they surely impact your resource utilization. In my experience, 5-7% of enterprise deployments' resources are consumed by UF internal logs. Some of these logs can be useful, but most are not.

In this case we are:

  • Dropping any splunkd logs at DEBUG or TRACE level
  • Aggregating repetitive splunkd.logs based on component-level ID in a lookup file
  • A repeat count will be added to the logs allowed through.
  • Dropping any metrics logs that are not either name and group =thruput, or group=per_*_thruput
  • Optionally aggregating these based on a lookup value for farm
  • Optionally:
  • Aggregation logs will still end up in _internal, with sourcetype and source == 'metrics:agg'
  • OR - Aggregated stats will be sent to a metrics store (metrics index is metrics, adjust as needed in the Aggregation functions)
  • Dropping any introspection logs
  • For splunkd and metrics logs that do make it through, optionally trim the timestamp off _raw
  • Trim source to just the file name (eg, ./splunkd.log)