forked from pivotal-cf/docs-ops-guide
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathlogging-config-opsman.html.md.erb
55 lines (41 loc) · 2.99 KB
/
logging-config-opsman.html.md.erb
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
---
title: Configuring System Logging in Elastic Runtime
owner: APM
---
<strong><%= modified_date %></strong>
This topic explains how to configure the Pivotal Cloud Foundry [Loggregator system](../loggregator/architecture.html) to scale its maximum throughput, and to forward logs to an external aggregator service.
## <a id='scaling'></a> Scaling Loggregator ##
Elastic Runtime system components and apps constantly generate log and metrics data. The [Metron](../loggregator/architecture.html#metron) agent running on each component or application VM collects and sends this data out to [Doppler](../loggregator/architecture.html#doppler) components, which temporarily buffer the data before periodically forwarding it to the [Traffic Controller](../loggregator/architecture.html#traffic-controller). The Traffic Controller then serves the aggregated data stream through the Firehose WebSocket endpoint.
When the log and metrics data input to a Doppler exceeds its buffer size for a given interval, data can be lost. You can take several actions to minimize this loss.
### Increase buffer size
1. In the **Pivotal Cloud Foundry (PCF) Ops Manager Installation Dashboard**, click the **Elastic Runtime** tile.
1. Select **System Logging**.
1. Increase the **Drain Buffer Size** to prevent loss of log data.
1. Click **Save**.
1. Click **Apply Changes**.
<%= image_tag 'sys-logging.png' %>
### Add Additional Doppler Instances
1. In the **PCF Ops Manager Installation Dashboard**, click the **Elastic Runtime** tile.
1. Select **Resource Config**.
1. Increase the number in the **Instances** column and the **Doppler Server** row.
<%= image_tag 'loggregator_config.png' %>
1. Click **Save**.
1. Click **Apply Changes**.
### Add Additional Traffic Controller Instances
1. In the **PCF Ops Manager Installation Dashboard**, click the **Elastic Runtime** tile.
1. Select **Resource Config**.
1. Increase the number in the **Instances** column and the **Loggregator Trafficcontroller** row.
<%= image_tag 'loggregator_config.png' %>
1. Click **Save**.
1. Click **Apply Changes**.
## <a id='syslog-forward'></a> Enabling System Log Forwarding ##
Elastic Runtime can forward log data to an external aggregator service instead of routing it to the Loggregator Firehose. System log forwarding for [Pivotal Cloud Foundry](https://network.pivotal.io/products/pivotal-cf) (PCF) is managed through the **PCF Ops Manager Installation Dashboard**. Complete the steps below to enable syslog forwarding:
1. Click the **Elastic Runtime** tile.
1. Select **System Logging**.
1. If you want to include security events in your log stream, select the **Enable Cloud Controller security event logging** checkbox.
The security log messages are in Common Event Format (CEF).
1. Enter the **Aggregator Hostname**, **Aggregator Port**, and **Network Protocol** for your third-party log management service.
1. (Optional) Increase the **Drain Buffer Size** to prevent loss of log data.
1. Click **Save**.
1. Click **Apply Changes**.
<%= image_tag 'sys-logging.png' %>