Redis enterprise prometheus v2 metrics

.codecov.yml

@@ -163,6 +163,10 @@ coverage:
         target: 75
         flags:
         - redisenterprise
+      Redis_Enterprise_Prometheus:
+        target: 75
+        flags:
+        - redis_enterprise_prometheus
       Redis_Enterprise_V2:
         target: 75
         flags:
@@ -575,6 +579,11 @@ flags:
     paths:
     - redis_enterprise/datadog_checks/redis_enterprise
     - redis_enterprise/tests
+  redis_enterprise_prometheus:
+    carryforward: true
+    paths:
+    - redis_enterprise_prometheus/datadog_checks/redis_enterprise_prometheus
+    - redis_enterprise_prometheus/tests
   redis_sentinel:
     carryforward: true
     paths:

.github/CODEOWNERS

@@ -164,6 +164,7 @@
 /redisenterprise/                        @maguec christian@redislabs.com @DataDog/ecosystems-review
 /redis_cloud/                            @redis-field-engineering field.engineers@redis.com
 /redis_enterprise/                       @redis-field-engineering field.engineers@redis.com
+/redis_enterprise_prometheus/            @redis-field-engineering field.engineers@redis.com
 /redis_sentinel/                         @DataDog/agent-integrations
 /redpanda/                               @redpanda-data support@redpanda.com
 /resilience4j/                           @willianccs willianccs@gmail.com

.github/workflows/test-all.yml

@@ -1018,6 +1018,25 @@ jobs:
       test-py3: ${{ inputs.test-py3 }}
       setup-env-vars: "${{ inputs.setup-env-vars }}"
     secrets: inherit
+  jd9748f1:
+    uses: DataDog/integrations-core/.github/workflows/test-target.yml@master
+    with:
+      job-name: Redis Enterprise Prometheus
+      target: redis_enterprise_prometheus
+      platform: linux
+      runner: '["ubuntu-22.04"]'
+      repo: "${{ inputs.repo }}"
+      python-version: "${{ inputs.python-version }}"
+      standard: ${{ inputs.standard }}
+      latest: ${{ inputs.latest }}
+      agent-image: "${{ inputs.agent-image }}"
+      agent-image-py2: "${{ inputs.agent-image-py2 }}"
+      agent-image-windows: "${{ inputs.agent-image-windows }}"
+      agent-image-windows-py2: "${{ inputs.agent-image-windows-py2 }}"
+      test-py2: ${{ inputs.test-py2 }}
+      test-py3: ${{ inputs.test-py3 }}
+      setup-env-vars: "${{ inputs.setup-env-vars }}"
+    secrets: inherit
   ja8f7203:
     uses: DataDog/integrations-core/.github/workflows/test-target.yml@master
     with:

redis_enterprise/assets/dashboards/redis_enterprise_proxy.json

@@ -1,4 +1,4 @@
-{
+ {
   "title": "Redis Enterprise - Proxy",
   "description": "Redis Enterprise Proxy presents a single, usable endpoint that hides topological complexity",
   "widgets": [

redis_enterprise_prometheus/CHANGELOG.md

@@ -0,0 +1,63 @@
+# CHANGELOG - Redis Enterprise
+
+## 2.0.1 / 2025-02-28
+
+***Added***:
+
+* Added Search metrics to metadata
+* Added Search Dashboard
+
+## 2.0.0 / 2025-02-28
+
+***Changed***:
+
+* Redis v2 metrics
+* Renamed prefix to rdse2
+* Renamed Groups
+
+***Added***:
+
+* Added Security Dashboard
+
+## 1.1.2 / 2025-02-28
+
+***Changed***:
+
+* Update `tls_verify` handling in check code to ensure default is set to 'True'
+
+## 1.1.1 / 2025-01-21
+
+***Changed***:
+
+* Represent used memory as a percentage in Shard and Database dashboards
+
+## 1.1.0 / 2024-10-06
+
+***Changed***:
+
+* Renamed Replication as Active-Active
+
+***Added***:
+
+* Added Shard dashboard
+* Added Proxy Threads dashboard
+
+## 1.0.1 / 2024-08-09
+
+***Changed***:
+
+* Fixed issue with extra_metrics not being reported
+* Updated configuration documentation
+
+***Added***:
+
+* Added Replication and Proxy Dashboards
+* Added tests to check all additional metrics
+* Added node_cert_expiration_seconds to Node metrics
+
+## 1.0.0 / 2024-05-02
+
+***Added***:
+
+* Initial Release
+

redis_enterprise_prometheus/README.md

@@ -0,0 +1,103 @@
+# Agent Check: Redis Enterprise Prometheus
+
+## Overview
+
+Redis is a fast, versatile data store that supports a variety of data structures, including strings, hashes, lists, sets, streams, and more. It also offers programmability, extensibility, persistence, clustering, and high availability. The community edition of Redis adds additional data models and capabilities, which include vector search, probabilistic data structures, JSON support, and full-text search.
+
+This integration works with on-premises and private cloud installations of [Redis Enterprise][1] using Prometheus metrics.
+The integration provides metrics for four critical cluster components: clusters, databases, nodes, and shards. This allows you to monitor database throughput, memory utilization, CPU usage, connection counts, replication health, and a variety of additional metrics within Datadog.
+You can use this information to understand the overall health of your Redis Enterprise clusters, diagnose application performance issues, and prevent downtime.
+
+For a full list of supported metrics, see the [Metrics](#metrics) section below.
+
+## Setup
+
+### Installation
+
+1. Run the following command to install the Agent integration:
+   ```shell
+   datadog-agent integration install -t datadog-redis_enterprise_prometheus==2.0.1
+   ```
+
+2. Configure the integration by setting the `openmetrics_endpoint` to your cluster's master node. See [Integration][2] for further information.
+
+3. [Restart][3] the agent.
+
+
+### Configuration
+
+Set the `openmetrics_endpoint` to point to your cluster. See the [example][4]. Leave `tls_verify` set to false.
+
+There are two optional parameters: `extra_metrics` and `excluded_metrics`, as noted in the example configuration file.
+
+The extra_metrics parameter takes a list of metric groups. The following are the available groups: REDIS2.REPLICATION, 
+REDIS2.SHARDREPL, REDIS2.LDAP, REDIS2.NETWORK, REDIS2.MEMORY, REDIS2.X509, REDIS2.DISK, REDIS2.FILESYSTEM, REDIS2.PROCESS, REDIS2.PRESSURE, REDIS2.FLASH, REDIS2.SEARCH. The default metrics groups RDSE2.REDIS_CLUSTER, 
+RDSE2.REDIS_DATABASE, RDSE2.REDIS_SHARD, RDSE2.REDIS_INFO, and RDSE2.REDIS_NODE are automatically inserted by the integration.
+
+The exclude_metrics parameter takes a list of individual metrics to exclude, meaning that this information will not be 
+passed on to Datadog. The individual metrics should be stripped of their prefix, e.g., 'rdse2.generation' would 
+become 'generation'. The full list of metrics is available on the 'Data Collected' tab of the integration page, or via the link in the [Metrics](#metrics) section. 
+The following groups use the associated prefixes, which can be used to search for individual metrics on 
+the data collected page.
+
+| Group                    | Prefix                      | Notes                                                |
+|--------------------------|----------------------------|------------------------------------------------------|
+| RDSE2.REDIS_CLUSTER      | rdse2.                     | Cluster-level metrics                               |
+| RDSE2.REDIS_DATABASE     | rdse2.endpoint_            | Database endpoint metrics                           |
+| RDSE2.REDIS_SHARD        | rdse2.redis_server_        | Shard-level Redis server metrics                   |
+| RDSE2.REDIS_NODE         | rdse2.node_                | Node-level metrics including x509 certificates     |
+| RDSE2.REDIS_INFO         | rdse2.node_                | Node information metrics                            |
+| REDIS2.REPLICATION       | rdse2.database_syncer_     | Database replication metrics                        |
+| REDIS2.SHARDREPL         | rdse2.redis_crdt_          | Shard-level CRDT replication metrics               |
+| REDIS2.LDAP              | rdse2.directory_           | LDAP directory service metrics                     |
+| REDIS2.NETWORK           | rdse2.node_network_        | Network interface metrics                           |
+| REDIS2.MEMORY            | rdse2.node_memory_         | Memory usage metrics                                |
+| REDIS2.X509              | rdse2.x509_                | X509 certificate metrics                            |
+| REDIS2.DISK              | rdse2.node_disk_           | Disk I/O metrics                                    |
+| REDIS2.FILESYSTEM        | rdse2.node_filesystem_     | Filesystem usage metrics                            |
+| REDIS2.PROCESS           | rdse2.node_processes_      | Process metrics                                     |
+| REDIS2.PRESSURE          | rdse2.node_pressure_       | System pressure metrics                             |
+| REDIS2.FLASH             | rdse2.node_*_flash         | Flash storage metrics                               |
+| REDIS2.SEARCH            | rdse2.redis_server_search_ | RediSearch module metrics                           |
+
+### Validation
+
+1. Ensure you can ping the machine, particularly in a cloud environment. Run `wget --no-check-certificate <endpoint>` 
+or `curl -k <endpoint>` to ensure that you can receive metrics.
+
+2. Check the [status][5] of the Datadog agent.
+
+
+## Data Collected
+
+The current release gathers all metrics for clusters, databases, nodes, and shards. By default, it collects metrics from the following groups: RDSE2.REDIS_CLUSTER, RDSE2.REDIS_DATABASE, RDSE2.REDIS_SHARD, RDSE2.REDIS_NODE, and RDSE2.REDIS_INFO. Optionally, via the extra_metrics parameter, 
+data for replication, LDAP, network, memory, X509 certificates, disk, filesystem, processes, pressure, flash storage, and search can be gathered; see the list in the [Configuration](#configuration) section.
+
+
+### Metrics
+
+See [metadata.csv][6] for a list of metrics provided by this integration.
+
+
+### Service Checks
+
+Redis Enterprise does not include any service checks.
+
+
+### Events
+
+Redis Enterprise does not include any events.
+
+
+## Troubleshooting
+
+Need help? Please contact [Redis Support][8].
+
+[1]: https://redis.com/redis-enterprise-software/overview/
+[2]: https://docs.datadoghq.com/getting_started/integrations/
+[3]: https://docs.datadoghq.com/agent/guide/agent-commands/#start-stop-and-restart-the-agent
+[4]: https://github.com/DataDog/integrations-extras/blob/master/redis_enterprise_prometheus/datadog_checks/redis_enterprise_prometheus/data/conf.yaml.example
+[5]: https://docs.datadoghq.com/agent/guide/agent-commands/#agent-status-and-information
+[6]: https://github.com/DataDog/integrations-extras/blob/master/redis_enterprise_prometheus/metadata.csv
+[7]: mailto:field.engineers@redis.com
+[8]: https://redis.io/support/

redis_enterprise_prometheus/assets/configuration/spec.yaml

@@ -0,0 +1,10 @@
+name: Redis Enterprise Prometheus
+files:
+- name: redis_enterprise_prometheus.yaml
+  options:
+  - template: init_config
+    options:
+    - template: init_config/default
+  - template: instances
+    options:
+    - template: instances/default