CloudDiscordGitHub
Ask or search…
⌃K
Links
Comment on page

Datadog

Use Datadog as an external monitoring tool to monitor Memphis

Introduction

As Datadog is one of the popular tools for centralized monitoring, Memphis provides a Prometheus exporter to enable Datadog users to monitor Memphis in K8S deployment only.
Please make sure you have the Datadog K8S agent installed.

Getting started

Step 1: Make sure your Memphis Prometheus exporter is on

If you haven't installed Memphis with the exporter.enabled yet
helm install memphis memphis/memphis \
--create-namespace --namespace memphis --wait \
--set \
global.cluster.enabled="true",\
exporter.enabled="true"
If Memphis is already installed -

Obtain the credentials used to hold the Metadata data on your current release:

export PASSWORD=$(kubectl get secret --namespace "memphis" memphis-metadata -o jsonpath="{.data.password}" | base64 -d)
export REPMGR_PASSWORD=$(kubectl get secret --namespace "memphis" memphis-metadata -o jsonpath="{.data.repmgr-password}" | base64 -d)
export ADMIN_PASSWORD=$(kubectl get secret --namespace "memphis" memphis-metadata-coordinator -o jsonpath="{.data.admin-password}" | base64 -d)

Use helm upgrade to add exporter to the deployment:

helm upgrade memphis memphis/memphis -n memphis --set exporter.enabled=true,metadata.postgresql.password=$PASSWORD,metadata.postgresql.repmgrPassword=$REPMGR_PASSWORD,metadata.pgpool.adminPassword=$ADMIN_PASSWORD

Step 2: Add Datadog annotation to Memphis statefulset

Add Datadog annotation to the memphis-broker statefulset to expose Prometheus metrics to datadog agent:
kubectl edit sts memphis-broker -n memphis
# (...)
spec:
# (...)
template:
metadata:
annotations:
# (...)
# Add the following section
ad.datadoghq.com/metrics.checks: |
{
"openmetrics": {
"instances": [
{
"openmetrics_endpoint": "http://%%host%%:%%port%%/metrics",
"namespace": "memphis",
"metrics": [".*"]
}
]
}
}
# (...)
spec:
name: metrics
Or, in a one-liner command -
cat <<EOF | kubectl -n memphis patch sts memphis-broker --patch '
spec:
template:
metadata:
annotations:
ad.datadoghq.com/metrics.checks: |
{
"openmetrics": {
"instances": [
{
"openmetrics_endpoint": "http://%%host%%:%%port%%/metrics",
"namespace": "memphis",
"metrics": [".*"]
}
]
}
}'
EOF

Step 3: Check Datadog for Memphis metrics

Reach your Datadog account -> Metrics -> Summary, and check if "memphis" metrics arrives.

Step 4: Import the Memphis dashboard

A Datadog tutorial on how to import a dashboard.
Memphis dashboard .json file to download -
Last modified 7mo ago