Docs Menu
Docs Home
/
Cloud Manager
/
Monitor Deployments
/
Third-Party Service Integrations

Integrate with Prometheus

On this page

  • Prerequisites
  • Procedure
  • Example Configurations
  • Import a Sample Grafana Dashboard
  • Performance Metrics Available to Prometheus
  • MongoDB Metric Labels
  • MongoDB Information Metrics
  • Hardware Metrics
  • Hardware Metric Labels

Prometheus collects metrics from configured targets at given intervals, evaluates rule expressions, displays the results, and can trigger alerts when it observes specific conditions.

Our integration allows you to configure Cloud Manager to send metric data about your deployment to your Prometheus instance.

Prerequisites

  • Prometheus integration is available in automation managed clusters that use MongoDB Agent 12.0.15.7646 or later. MongoDB Agent 12.0.15.7646 is released with Cloud Manager 6.0.7.

  • Have a working Prometheus instance. To set up a working instance, see their Installation Guide.

  • (Optional) Use Grafana to visualize your Prometheus metrics.

Procedure

To integrate Cloud Manager with Prometheus:

1

In MongoDB Cloud Manager, go to the Project Integrations page.

  1. If it's not already displayed, select the organization that contains your desired project from the Organizations menu in the navigation bar.

  2. If it's not already displayed, select your desired project from the Projects menu in the navigation bar.

  3. Next to the Projects menu, expand the Options menu, then click Integrations.

    The Project Integrations page displays.

2

Click Configure for the Prometheus integration card.

3

Enter your preferred username and password.

Prometheus authentication credentials are specifically designed for use with the Prometheus integration in Cloud Manager. Cloud Manager uses these credentials to only access the Prometheus discovery endpoint and scrape Prometheus metrics from Cloud Manager nodes. They are strictly limited to these functions and do not have any additional permissions or capabilities beyond accessing and collecting monitoring data.

Important

Copy your username and password in a secure location. You can't access the password after you leave this screen.

4

Enter your IP address and port.

Tip

The default value, 0.0.0.0:9216, scrapes metrics on port 9216 on all IPv4 addresses on the local machine.

5

(Optional) Encrypt all Prometheus metrics.

If you enable this setting, Cloud Manager assures that your Prometheus instance uses https to scrape metrics.

Fields
Description

TLS Certificate Key File Path

PEM file path that contains certificate and key required to spin up a https Prometheus scraping endpoint.

You are responsible for the following:

  • TLS Certificate Key File issuance and renewal.

  • Checking if the endpoint started correctly in the automation agent logs.

TLS Certificate Key File Password

Required if the certificate key file is encrypted.

6

Select your preferred service discovery method.

Discovery Method
Description

HTTP SD

This method requires Prometheus v2.28 and later. It generates the scrape_config part of your configuration file to discover targets over an HTTP endpoint.

File Service Discovery

This method allows Prometheus to read YAML or JSON documents to configure the targets to scrape from.

You are responsible for providing the targets by making a request to the Discovery API and storing its results in a targets.json file.

To make the request, substitute the placeholder text in one of the following tabs or create your own script in another language.

# Sets the `Authorization` header on every scrape
# request with the username and password from the
# previous step. The URL that Prometheus fetches the
# targets from.
# Replace the <group-id> with the project ID of your
# Atlas instance.
curl --header 'Accept: application/json' \
     --user <username>:<password> \
     --request GET "https://cloud.mongodb.com/prometheus/v1.0/groups/{GROUP-ID}/discovery"

If you need to install the requests library, see their Installation Guide.

import time, json, requests
# This script sets the `Authorization` header on every
# scrape request with the configured username and
# password. Then it tells Prometheus to fetch targets
# from the specified URL.
#
# Note: Replace the <username> and <password> with the
# values in the previous step, and <group-id> with the
# project ID of your Atlas instance.
basic_auth_user="<username>"
basic_auth_password="<password>"
discovery_api_url="https://cloud.mongodb.com/prometheus/v1.0/groups/{GROUP-ID}/discovery"
# The script updates your targets.json file every
# minute, if it successfully retrieves targets.
#
# Note: Replace the <path-to-targets.json> with the
# path to your targets.json file.
starttime = time.time()
while True:
  r = requests.get(discovery_api_url, auth=(basic_auth_user, basic_auth_password))
  if  r.status_code == 200:
    with open('<path-to-targets.json>', 'w') as f:
      json.dump(r.json(), f)
  time.sleep(60.0 - ((time.time() - starttime) % 60.0))

To learn more about the Discovery API, see Return the Latest Targets for Prometheus.

7

Click Save.

8

View Your Cluster Metrics on Prometheus.

  1. Copy the generated snippet into the scrape_configs section of your configuration file and substitute the placeholder text.

    For an example of the configuration file in either method, see Example Configurations.

  2. Restart your Prometheus instance.

  3. In your Prometheus instance, click Status in the top navigation bar, and click Targets to see the metrics of your deployment.

Example Configurations

The following shows examples of the configuration file when you use the HTTP Service Discovery or File Service Discovery method.

The configuration file in both methods contains the following fields:

Field
Description

scrape_interval

Time that indicates how frequently to scrape targets. This setting supports a minimum time of 10s.

job_name

Human-readable label assigned to scraped metrics.

metrics_path

HTTP resource path that indicates where to fetch metrics from targets.

scheme

Your Prometheus protocol scheme configured for requests, either http or https. If you configure https, you must specify tlsPemPath.

basic_auth

Authorization header to use on every scrape request.

HTTP Service Discovery

The HTTP Service Discovery method also contains the http_sd_configs field with the following sub-fields:

Field
Description

url

URL from which Prometheus fetches the targets.

refresh_interval

Time that indicates when to re-query the endpoint.

basic_auth

Credentials to use for authenticating to the API server.

global:
  scrape_interval: 15s
scrape_configs:
  - job_name: "CM-Testing-mongo-metrics"
    scrape_interval: 10s
    metrics_path: /metrics
    scheme : https
    basic_auth:
      username: prom_user_61e6e34e93eac1632d39f457
      password: V7hTyLfkjwiWQbv
    http_sd_configs:
      - url: https://cloud.mongodb.com/prometheus/v1.0/groups/61e6e34e93eac1632d39f457/discovery
        refresh_interval: 60s
        basic_auth:
          username: prom_user_61e6e34e93eac1632d39f457
          password: V7hTyLfkjwiWQbv

File Service Discovery

The File Service Discovery method also contains the file_sd_configs field with the following sub-field:

Field
Description

files

List that contains the files from which to extract the metrics scraping targets.

global:
  scrape_interval: 15s
scrape_configs:
  - job_name: "CM-Testing-mongo-metrics"
    scrape_interval: 10s
    metrics_path: /metrics
    scheme : https
    basic_auth:
      username: prom_user_61e6e34e93eac1632d39f457
      password: V7hTyLfkjwiWQbv
    file_sd_configs:
      - files:
        - /usr/local/etc/targets.json

Import a Sample Grafana Dashboard

To import a sample Grafana dashboard:

1

Navigate to the Import screen.

In the Grafana UI, click the button, and then click Import.

2

Click Upload JSON File.

3

Copy over the mongo-metrics.json or the hardware-metrics.json file to create a dashboard.

mongo-metrics.json

1{
2 "__inputs": [
3   {
4     "name": "DS_THANOS",
5     "label": "thanos",
6     "description": "",
7     "type": "datasource",
8     "pluginId": "prometheus",
9     "pluginName": "Prometheus"
10   }
11 ],
12 "__elements": [],
13 "__requires": [
14   {
15     "type": "grafana",
16     "id": "grafana",
17     "name": "Grafana",
18     "version": "8.5.6"
19   },
20   {
21     "type": "panel",
22     "id": "graph",
23     "name": "Graph (old)",
24     "version": ""
25   },
26   {
27     "type": "datasource",
28     "id": "prometheus",
29     "name": "Prometheus",
30     "version": "1.0.0"
31   },
32   {
33     "type": "panel",
34     "id": "table",
35     "name": "Table",
36     "version": ""
37   }
38 ],
39 "annotations": {
40   "list": [
41     {
42       "builtIn": 1,
43       "datasource": {
44         "type": "datasource",
45         "uid": "grafana"
46       },
47       "enable": true,
48       "hide": true,
49       "iconColor": "rgba(0, 211, 255, 1)",
50       "name": "Annotations & Alerts",
51       "target": {
52         "limit": 100,
53         "matchAny": false,
54         "tags": [],
55         "type": "dashboard"
56       },
57       "type": "dashboard"
58     }
59   ]
60 },
61 "editable": true,
62 "fiscalYearStartMonth": 0,
63 "graphTooltip": 0,
64 "id": null,
65 "iteration": 1657202032408,
66 "links": [],
67 "liveNow": false,
68 "panels": [
69   {
70     "collapsed": false,
71     "datasource": {
72       "type": "prometheus",
73       "uid": "000000010"
74     },
75     "gridPos": {
76       "h": 1,
77       "w": 24,
78       "x": 0,
79       "y": 0
80     },
81     "id": 10,
82     "panels": [],
83     "title": "Overview",
84     "type": "row"
85   },
86   {
87     "datasource": {
88       "type": "prometheus",
89       "uid": "${DS_THANOS}"
90     },
91     "fieldConfig": {
92       "defaults": {
93         "color": {
94           "mode": "thresholds"
95         },
96         "custom": {
97           "align": "auto",
98           "displayMode": "auto",
99           "inspect": false
100         },
101         "decimals": 2,
102         "displayName": "",
103         "mappings": [],
104         "thresholds": {
105           "mode": "absolute",
106           "steps": [
107             {
108               "color": "green",
109               "value": null
110             },
111             {
112               "color": "red",
113               "value": 80
114             }
115           ]
116         },
117         "unit": "short"
118       },
119       "overrides": [
120         {
121           "matcher": {
122             "id": "byName",
123             "options": "Value"
124           },
125           "properties": [
126             {
127               "id": "unit",
128               "value": "short"
129             },
130             {
131               "id": "decimals",
132               "value": 2
133             },
134             {
135               "id": "custom.align"
136             }
137           ]
138         }
139       ]
140     },
141     "gridPos": {
142       "h": 4,
143       "w": 24,
144       "x": 0,
145       "y": 1
146     },
147     "id": 41,
148     "options": {
149       "footer": {
150         "fields": "",
151         "reducer": [
152           "sum"
153         ],
154         "show": false
155       },
156       "showHeader": true
157     },
158     "pluginVersion": "8.5.6",
159     "targets": [
160       {
161         "datasource": {
162           "type": "prometheus",
163           "uid": "${DS_THANOS}"
164         },
165         "exemplar": false,
166         "expr": "label_replace( sum(mongodb_info{group_id=~\"$group_id\", cl_name=~\"$cl_name\", instance=~\"$host.*\"}) by (group_id, org_id, rs_nm, cl_name), \"hostname\", \"$1\", \"instance\", \"(.*)\")\n",
167         "format": "table",
168         "instant": true,
169         "interval": "",
170         "legendFormat": "",
171         "refId": "A"
172       }
173     ],
174     "title": "Group Metadata",
175     "transformations": [
176       {
177         "id": "organize",
178         "options": {
179           "excludeByName": {
180             "Time": true,
181             "Value #A": true,
182             "instance": true,
183             "rs_nm": false
184           },
185           "indexByName": {
186             "": 2,
187             "Time": 0,
188             "Value #A": 6,
189             "cl_name": 4,
190             "group_id": 3,
191             "org_id": 1,
192             "rs_nm": 5
193           },
194           "renameByName": {
195             "": "Group Name ",
196             "Time": "",
197             "cl_name": "Cluster Name",
198             "group_id": "Group Id",
199             "hostname": "Host",
200             "instance": "",
201             "org_id": "Org Id",
202             "process_port": "Port",
203             "replica_state": "ReplicaSet State",
204             "rs_nm": "ReplicaSet Name"
205           }
206         }
207       },
208       {
209         "id": "groupBy",
210         "options": {
211           "fields": {
212             "Cluster Name": {
213               "aggregations": [],
214               "operation": "groupby"
215             },
216             "Group Id": {
217               "aggregations": [],
218               "operation": "groupby"
219             },
220             "Group Name ": {
221               "aggregations": [],
222               "operation": "groupby"
223             },
224             "Host": {
225               "aggregations": [],
226               "operation": "groupby"
227             },
228             "Host ": {
229               "aggregations": [],
230               "operation": "groupby"
231             },
232             "Org Id": {
233               "aggregations": [],
234               "operation": "groupby"
235             },
236             "Port": {
237               "aggregations": [],
238               "operation": "groupby"
239             },
240             "Replica set state": {
241               "aggregations": [],
242               "operation": "groupby"
243             },
244             "ReplicaSet Name": {
245               "aggregations": [],
246               "operation": "groupby"
247             },
248             "ReplicaSet State": {
249               "aggregations": [],
250               "operation": "groupby"
251             },
252             "host ": {
253               "aggregations": [],
254               "operation": "groupby"
255             },
256             "hostname": {
257               "aggregations": [],
258               "operation": "groupby"
259             },
260             "instance": {
261               "aggregations": [],
262               "operation": "groupby"
263             },
264             "port": {
265               "aggregations": [],
266               "operation": "groupby"
267             },
268             "process_port": {
269               "aggregations": [],
270               "operation": "groupby"
271             },
272             "replica set": {
273               "aggregations": [],
274               "operation": "groupby"
275             },
276             "replica set state": {
277               "aggregations": [],
278               "operation": "groupby"
279             },
280             "replica_state": {
281               "aggregations": [],
282               "operation": "groupby"
283             },
284             "rs_nm": {
285               "aggregations": [],
286               "operation": "groupby"
287             }
288           }
289         }
290       },
291       {
292         "id": "merge",
293         "options": {
294           "reducers": []
295         }
296       }
297     ],
298     "type": "table"
299   },
300   {
301     "datasource": {
302       "type": "prometheus",
303       "uid": "${DS_THANOS}"
304     },
305     "fieldConfig": {
306       "defaults": {
307         "color": {
308           "mode": "thresholds"
309         },
310         "custom": {
311           "align": "auto",
312           "displayMode": "auto",
313           "inspect": false
314         },
315         "decimals": 0,
316         "displayName": "",
317         "mappings": [],
318         "thresholds": {
319           "mode": "absolute",
320           "steps": [
321             {
322               "color": "green",
323               "value": null
324             },
325             {
326               "color": "red",
327               "value": 80
328             }
329           ]
330         },
331         "unit": "none"
332       },
333       "overrides": []
334     },
335     "gridPos": {
336       "h": 6,
337       "w": 24,
338       "x": 0,
339       "y": 5
340     },
341     "id": 42,
342     "options": {
343       "footer": {
344         "fields": "",
345         "reducer": [
346           "sum"
347         ],
348         "show": false
349       },
350       "showHeader": true
351     },
352     "pluginVersion": "8.5.6",
353     "targets": [
354       {
355         "datasource": {
356           "type": "prometheus",
357           "uid": "${DS_THANOS}"
358         },
359         "exemplar": false,
360         "expr": "label_replace( sum(mongodb_info{group_id=~\"$group_id\", cl_name=~\"$cl_name\", instance=~\"$host.*\"}) by (instance, replica_state_name, process_port, rs_nm, process_type), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")\n",
361         "format": "table",
362         "instant": true,
363         "interval": "",
364         "legendFormat": "",
365         "refId": "A"
366       }
367     ],
368     "title": "Cluster host list",
369     "transformations": [
370       {
371         "id": "organize",
372         "options": {
373           "excludeByName": {
374             "Time": true,
375             "Value #A": true,
376             "instance": false,
377             "rs_nm": false
378           },
379           "indexByName": {
380             "Time": 0,
381             "Value": 6,
382             "instance": 1,
383             "process_port": 2,
384             "process_type": 4,
385             "replica_state_name": 5,
386             "rs_nm": 3
387           },
388           "renameByName": {
389             "Time": "",
390             "Value": "",
391             "hostname": "Host",
392             "instance": "Hostname",
393             "process_port": "Port",
394             "process_type": "Process Type",
395             "replica_state": "ReplicaSet State",
396             "replica_state_name": "Replica State",
397             "rs_nm": "ReplicaSet Name"
398           }
399         }
400       },
401       {
402         "id": "groupBy",
403         "options": {
404           "fields": {
405             "Host": {
406               "aggregations": [],
407               "operation": "groupby"
408             },
409             "Host ": {
410               "aggregations": [],
411               "operation": "groupby"
412             },
413             "Hostname": {
414               "aggregations": [],
415               "operation": "groupby"
416             },
417             "Port": {
418               "aggregations": [],
419               "operation": "groupby"
420             },
421             "Process Type": {
422               "aggregations": [],
423               "operation": "groupby"
424             },
425             "Replica State": {
426               "aggregations": [],
427               "operation": "groupby"
428             },
429             "Replica set state": {
430               "aggregations": [],
431               "operation": "groupby"
432             },
433             "ReplicaSet Name": {
434               "aggregations": [],
435               "operation": "groupby"
436             },
437             "ReplicaSet State": {
438               "aggregations": [],
439               "operation": "groupby"
440             },
441             "host ": {
442               "aggregations": [],
443               "operation": "groupby"
444             },
445             "hostname": {
446               "aggregations": [],
447               "operation": "groupby"
448             },
449             "instance": {
450               "aggregations": [],
451               "operation": "groupby"
452             },
453             "port": {
454               "aggregations": [],
455               "operation": "groupby"
456             },
457             "process_port": {
458               "aggregations": [],
459               "operation": "groupby"
460             },
461             "replica set": {
462               "aggregations": [],
463               "operation": "groupby"
464             },
465             "replica set state": {
466               "aggregations": [],
467               "operation": "groupby"
468             },
469             "replica_state": {
470               "aggregations": [],
471               "operation": "groupby"
472             },
473             "rs_nm": {
474               "aggregations": [],
475               "operation": "groupby"
476             }
477           }
478         }
479       },
480       {
481         "id": "merge",
482         "options": {
483           "reducers": []
484         }
485       }
486     ],
487     "type": "table"
488   },
489   {
490     "collapsed": false,
491     "datasource": {
492       "type": "prometheus",
493       "uid": "000000010"
494     },
495     "gridPos": {
496       "h": 1,
497       "w": 24,
498       "x": 0,
499       "y": 11
500     },
501     "id": 8,
502     "panels": [],
503     "title": "Memory",
504     "type": "row"
505   },
506   {
507     "aliasColors": {},
508     "bars": false,
509     "dashLength": 10,
510     "dashes": false,
511     "datasource": {
512       "type": "prometheus",
513       "uid": "${DS_THANOS}"
514     },
515     "description": "The number of megabytes resident. MMAPv1: It is typical over time, on a dedicated database server, for this number to approach the amount of physical ram on the box. WiredTiger: In a standard deployment resident is the amount of memory used by the WiredTiger cache plus the memory dedicated to other in memory structures used by the mongod process. By default, mongod with WiredTiger reserves 50% of the total physical memory on the server for the cache and at steady state, WiredTiger tries to limit cache usage to 80% of that total. For example, if a server has 16GB of memory, WiredTiger will assume it can use 8GB for cache and at steady state should use about 6.5GB.",
516     "fieldConfig": {
517       "defaults": {
518         "links": [],
519         "unit": "decmbytes"
520       },
521       "overrides": []
522     },
523     "fill": 1,
524     "fillGradient": 0,
525     "gridPos": {
526       "h": 8,
527       "w": 12,
528       "x": 0,
529       "y": 12
530     },
531     "hiddenSeries": false,
532     "id": 2,
533     "legend": {
534       "avg": false,
535       "current": false,
536       "max": false,
537       "min": false,
538       "show": true,
539       "total": false,
540       "values": false
541     },
542     "lines": true,
543     "linewidth": 1,
544     "nullPointMode": "null",
545     "options": {
546       "alertThreshold": true,
547       "legend": {
548         "calcs": [],
549         "displayMode": "list",
550         "placement": "bottom"
551       },
552       "tooltip": {
553         "mode": "single"
554       }
555     },
556     "percentage": false,
557     "pluginVersion": "8.5.6",
558     "pointradius": 2,
559     "points": false,
560     "renderer": "flot",
561     "seriesOverrides": [],
562     "spaceLength": 10,
563     "stack": false,
564     "steppedLine": false,
565     "targets": [
566       {
567         "exemplar": true,
568         "expr": "label_replace(sum(mongodb_mem_resident{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
569         "interval": "",
570         "legendFormat": "{{hostname}}:{{process_port}}",
571         "refId": "A",
572         "datasource": {
573           "type": "prometheus",
574           "uid": "${DS_THANOS}"
575         }
576       }
577     ],
578     "thresholds": [],
579     "timeRegions": [],
580     "title": "Memory - Resident",
581     "tooltip": {
582       "shared": true,
583       "sort": 0,
584       "value_type": "individual"
585     },
586     "type": "graph",
587     "xaxis": {
588       "mode": "time",
589       "show": true,
590       "values": []
591     },
592     "yaxes": [
593       {
594         "format": "decmbytes",
595         "logBase": 1,
596         "show": true
597       },
598       {
599         "format": "short",
600         "logBase": 1,
601         "show": true
602       }
603     ],
604     "yaxis": {
605       "align": false
606     }
607   },
608   {
609     "aliasColors": {},
610     "bars": false,
611     "dashLength": 10,
612     "dashes": false,
613     "datasource": {
614       "type": "prometheus",
615       "uid": "${DS_THANOS}"
616     },
617     "description": "The virtual megabytes for the mongod process. MMAPv1: Generally virtual should be a little larger than mapped (or 2x with --journal), but if virtual is many gigabytes larger, it indicates that excessive memory is being used by other aspects than the memory mapping of files -- that would be bad/suboptimal. The most common case of usage of a high amount of memory for non-mapped is that there are very many connections to the database. Each connection has a thread stack and the memory for those stacks can add up to a considerable amount. WiredTiger: Generally virtual should be a little larger than mapped, but if virtual is many gigabytes larger, it indicates that excessive memory is being used by other aspects than the memory mapping of files -- that would be bad/suboptimal. The most common case of usage of a high amount of memory for non-mapped is that there are very many connections to the database. Each connection has a thread stack and the memory for those stacks can add up to a considerable amount.",
618     "fieldConfig": {
619       "defaults": {
620         "links": [],
621         "unit": "decmbytes"
622       },
623       "overrides": []
624     },
625     "fill": 1,
626     "fillGradient": 0,
627     "gridPos": {
628       "h": 8,
629       "w": 12,
630       "x": 12,
631       "y": 12
632     },
633     "hiddenSeries": false,
634     "id": 72,
635     "legend": {
636       "avg": false,
637       "current": false,
638       "max": false,
639       "min": false,
640       "show": true,
641       "total": false,
642       "values": false
643     },
644     "lines": true,
645     "linewidth": 1,
646     "nullPointMode": "null",
647     "options": {
648       "alertThreshold": true,
649       "legend": {
650         "calcs": [],
651         "displayMode": "list",
652         "placement": "bottom"
653       },
654       "tooltip": {
655         "mode": "single"
656       }
657     },
658     "percentage": false,
659     "pluginVersion": "8.5.6",
660     "pointradius": 2,
661     "points": false,
662     "renderer": "flot",
663     "seriesOverrides": [],
664     "spaceLength": 10,
665     "stack": false,
666     "steppedLine": false,
667     "targets": [
668       {
669         "exemplar": true,
670         "expr": "label_replace(sum(mongodb_mem_virtual{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
671         "interval": "",
672         "legendFormat": "{{hostname}}:{{process_port}}",
673         "refId": "A",
674         "datasource": {
675           "type": "prometheus",
676           "uid": "${DS_THANOS}"
677         }
678       }
679     ],
680     "thresholds": [],
681     "timeRegions": [],
682     "title": "Memory - Virtual",
683     "tooltip": {
684       "shared": true,
685       "sort": 0,
686       "value_type": "individual"
687     },
688     "type": "graph",
689     "xaxis": {
690       "mode": "time",
691       "show": true,
692       "values": []
693     },
694     "yaxes": [
695       {
696         "format": "decmbytes",
697         "logBase": 1,
698         "show": true
699       },
700       {
701         "format": "short",
702         "logBase": 1,
703         "show": true
704       }
705     ],
706     "yaxis": {
707       "align": false
708     }
709   },
710   {
711     "collapsed": false,
712     "datasource": {
713       "type": "prometheus",
714       "uid": "000000010"
715     },
716     "gridPos": {
717       "h": 1,
718       "w": 24,
719       "x": 0,
720       "y": 20
721     },
722     "id": 17,
723     "panels": [],
724     "title": "Asserts",
725     "type": "row"
726   },
727   {
728     "aliasColors": {},
729     "bars": false,
730     "dashLength": 10,
731     "dashes": false,
732     "datasource": {
733       "type": "prometheus",
734       "uid": "${DS_THANOS}"
735     },
736     "description": "The average rate of regular asserts raised per second over the selected sample period\n",
737     "fieldConfig": {
738       "defaults": {
739         "links": [],
740         "unit": "/s"
741       },
742       "overrides": []
743     },
744     "fill": 1,
745     "fillGradient": 0,
746     "gridPos": {
747       "h": 8,
748       "w": 6,
749       "x": 0,
750       "y": 21
751     },
752     "hiddenSeries": false,
753     "id": 73,
754     "legend": {
755       "avg": false,
756       "current": false,
757       "max": false,
758       "min": false,
759       "show": true,
760       "total": false,
761       "values": false
762     },
763     "lines": true,
764     "linewidth": 1,
765     "nullPointMode": "null",
766     "options": {
767       "alertThreshold": true,
768       "legend": {
769         "calcs": [],
770         "displayMode": "list",
771         "placement": "bottom"
772       },
773       "tooltip": {
774         "mode": "single"
775       }
776     },
777     "percentage": false,
778     "pluginVersion": "8.5.6",
779     "pointradius": 2,
780     "points": false,
781     "renderer": "flot",
782     "seriesOverrides": [],
783     "spaceLength": 10,
784     "stack": false,
785     "steppedLine": false,
786     "targets": [
787       {
788         "exemplar": true,
789         "expr": "label_replace(sum(rate(mongodb_asserts_regular{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
790         "interval": "",
791         "legendFormat": "{{hostname}}:{{process_port}}",
792         "refId": "A",
793         "datasource": {
794           "type": "prometheus",
795           "uid": "${DS_THANOS}"
796         }
797       }
798     ],
799     "thresholds": [],
800     "timeRegions": [],
801     "title": "Asserts - Regular",
802     "tooltip": {
803       "shared": true,
804       "sort": 0,
805       "value_type": "individual"
806     },
807     "type": "graph",
808     "xaxis": {
809       "mode": "time",
810       "show": true,
811       "values": []
812     },
813     "yaxes": [
814       {
815         "format": "/s",
816         "logBase": 1,
817         "show": true
818       },
819       {
820         "format": "short",
821         "logBase": 1,
822         "show": true
823       }
824     ],
825     "yaxis": {
826       "align": false
827     }
828   },
829   {
830     "aliasColors": {},
831     "bars": false,
832     "dashLength": 10,
833     "dashes": false,
834     "datasource": {
835       "type": "prometheus",
836       "uid": "${DS_THANOS}"
837     },
838     "description": "The average rate of warnings per second over the selected sample period",
839     "fieldConfig": {
840       "defaults": {
841         "links": [],
842         "unit": "/s"
843       },
844       "overrides": []
845     },
846     "fill": 1,
847     "fillGradient": 0,
848     "gridPos": {
849       "h": 8,
850       "w": 6,
851       "x": 6,
852       "y": 21
853     },
854     "hiddenSeries": false,
855     "id": 74,
856     "legend": {
857       "avg": false,
858       "current": false,
859       "max": false,
860       "min": false,
861       "show": true,
862       "total": false,
863       "values": false
864     },
865     "lines": true,
866     "linewidth": 1,
867     "nullPointMode": "null",
868     "options": {
869       "alertThreshold": true,
870       "legend": {
871         "calcs": [],
872         "displayMode": "list",
873         "placement": "bottom"
874       },
875       "tooltip": {
876         "mode": "single"
877       }
878     },
879     "percentage": false,
880     "pluginVersion": "8.5.6",
881     "pointradius": 2,
882     "points": false,
883     "renderer": "flot",
884     "seriesOverrides": [],
885     "spaceLength": 10,
886     "stack": false,
887     "steppedLine": false,
888     "targets": [
889       {
890         "exemplar": true,
891         "expr": "label_replace(sum(rate(mongodb_asserts_warning{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
892         "interval": "",
893         "legendFormat": "{{hostname}}:{{process_port}}",
894         "refId": "A",
895         "datasource": {
896           "type": "prometheus",
897           "uid": "${DS_THANOS}"
898         }
899       }
900     ],
901     "thresholds": [],
902     "timeRegions": [],
903     "title": "Asserts - Warning",
904     "tooltip": {
905       "shared": true,
906       "sort": 0,
907       "value_type": "individual"
908     },
909     "type": "graph",
910     "xaxis": {
911       "mode": "time",
912       "show": true,
913       "values": []
914     },
915     "yaxes": [
916       {
917         "format": "/s",
918         "logBase": 1,
919         "show": true
920       },
921       {
922         "format": "short",
923         "logBase": 1,
924         "show": true
925       }
926     ],
927     "yaxis": {
928       "align": false
929     }
930   },
931   {
932     "aliasColors": {},
933     "bars": false,
934     "dashLength": 10,
935     "dashes": false,
936     "datasource": {
937       "type": "prometheus",
938       "uid": "${DS_THANOS}"
939     },
940     "description": "The average rate of message asserts per second over the selected sample period. These are internal server errors that have a well defined text string. Stack traces are logged for these",
941     "fieldConfig": {
942       "defaults": {
943         "links": [],
944         "unit": "/s"
945       },
946       "overrides": []
947     },
948     "fill": 1,
949     "fillGradient": 0,
950     "gridPos": {
951       "h": 8,
952       "w": 6,
953       "x": 12,
954       "y": 21
955     },
956     "hiddenSeries": false,
957     "id": 75,
958     "legend": {
959       "avg": false,
960       "current": false,
961       "max": false,
962       "min": false,
963       "show": true,
964       "total": false,
965       "values": false
966     },
967     "lines": true,
968     "linewidth": 1,
969     "nullPointMode": "null",
970     "options": {
971       "alertThreshold": true,
972       "legend": {
973         "calcs": [],
974         "displayMode": "list",
975         "placement": "bottom"
976       },
977       "tooltip": {
978         "mode": "single"
979       }
980     },
981     "percentage": false,
982     "pluginVersion": "8.5.6",
983     "pointradius": 2,
984     "points": false,
985     "renderer": "flot",
986     "seriesOverrides": [],
987     "spaceLength": 10,
988     "stack": false,
989     "steppedLine": false,
990     "targets": [
991       {
992         "exemplar": true,
993         "expr": "label_replace(sum(rate(mongodb_asserts_msg{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
994         "interval": "",
995         "legendFormat": "{{hostname}}:{{process_port}}",
996         "refId": "A",
997         "datasource": {
998           "type": "prometheus",
999           "uid": "${DS_THANOS}"
1000         }
1001       }
1002     ],
1003     "thresholds": [],
1004     "timeRegions": [],
1005     "title": "Asserts - Message",
1006     "tooltip": {
1007       "shared": true,
1008       "sort": 0,
1009       "value_type": "individual"
1010     },
1011     "type": "graph",
1012     "xaxis": {
1013       "mode": "time",
1014       "show": true,
1015       "values": []
1016     },
1017     "yaxes": [
1018       {
1019         "format": "/s",
1020         "logBase": 1,
1021         "show": true
1022       },
1023       {
1024         "format": "short",
1025         "logBase": 1,
1026         "show": true
1027       }
1028     ],
1029     "yaxis": {
1030       "align": false
1031     }
1032   },
1033   {
1034     "aliasColors": {},
1035     "bars": false,
1036     "dashLength": 10,
1037     "dashes": false,
1038     "datasource": {
1039       "type": "prometheus",
1040       "uid": "${DS_THANOS}"
1041     },
1042     "description": "The average rate of user asserts per second over the selected sample period. These are errors that can be generated by a user such as out of disk space or duplicate key",
1043     "fieldConfig": {
1044       "defaults": {
1045         "links": [],
1046         "unit": "/s"
1047       },
1048       "overrides": []
1049     },
1050     "fill": 1,
1051     "fillGradient": 0,
1052     "gridPos": {
1053       "h": 8,
1054       "w": 6,
1055       "x": 18,
1056       "y": 21
1057     },
1058     "hiddenSeries": false,
1059     "id": 76,
1060     "legend": {
1061       "avg": false,
1062       "current": false,
1063       "max": false,
1064       "min": false,
1065       "show": true,
1066       "total": false,
1067       "values": false
1068     },
1069     "lines": true,
1070     "linewidth": 1,
1071     "nullPointMode": "null",
1072     "options": {
1073       "alertThreshold": true,
1074       "legend": {
1075         "calcs": [],
1076         "displayMode": "list",
1077         "placement": "bottom"
1078       },
1079       "tooltip": {
1080         "mode": "single"
1081       }
1082     },
1083     "percentage": false,
1084     "pluginVersion": "8.5.6",
1085     "pointradius": 2,
1086     "points": false,
1087     "renderer": "flot",
1088     "seriesOverrides": [],
1089     "spaceLength": 10,
1090     "stack": false,
1091     "steppedLine": false,
1092     "targets": [
1093       {
1094         "exemplar": true,
1095         "expr": "label_replace(sum(rate(mongodb_asserts_user{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1096         "interval": "",
1097         "legendFormat": "{{hostname}}:{{process_port}}",
1098         "refId": "A",
1099         "datasource": {
1100           "type": "prometheus",
1101           "uid": "${DS_THANOS}"
1102         }
1103       }
1104     ],
1105     "thresholds": [],
1106     "timeRegions": [],
1107     "title": "Asserts - User",
1108     "tooltip": {
1109       "shared": true,
1110       "sort": 0,
1111       "value_type": "individual"
1112     },
1113     "type": "graph",
1114     "xaxis": {
1115       "mode": "time",
1116       "show": true,
1117       "values": []
1118     },
1119     "yaxes": [
1120       {
1121         "format": "/s",
1122         "logBase": 1,
1123         "show": true
1124       },
1125       {
1126         "format": "short",
1127         "logBase": 1,
1128         "show": true
1129       }
1130     ],
1131     "yaxis": {
1132       "align": false
1133     }
1134   },
1135   {
1136     "collapsed": false,
1137     "datasource": {
1138       "type": "prometheus",
1139       "uid": "000000010"
1140     },
1141     "gridPos": {
1142       "h": 1,
1143       "w": 24,
1144       "x": 0,
1145       "y": 29
1146     },
1147     "id": 44,
1148     "panels": [],
1149     "title": "Cache",
1150     "type": "row"
1151   },
1152   {
1153     "aliasColors": {},
1154     "bars": false,
1155     "dashLength": 10,
1156     "dashes": false,
1157     "datasource": {
1158       "type": "prometheus",
1159       "uid": "${DS_THANOS}"
1160     },
1161     "description": "The average rate of bytes per second read into WiredTiger's cache over the selected sample period.",
1162     "fieldConfig": {
1163       "defaults": {
1164         "links": [],
1165         "unit": "Bps"
1166       },
1167       "overrides": []
1168     },
1169     "fill": 1,
1170     "fillGradient": 0,
1171     "gridPos": {
1172       "h": 8,
1173       "w": 6,
1174       "x": 0,
1175       "y": 30
1176     },
1177     "hiddenSeries": false,
1178     "id": 77,
1179     "legend": {
1180       "avg": false,
1181       "current": false,
1182       "max": false,
1183       "min": false,
1184       "show": true,
1185       "total": false,
1186       "values": false
1187     },
1188     "lines": true,
1189     "linewidth": 1,
1190     "nullPointMode": "null",
1191     "options": {
1192       "alertThreshold": true,
1193       "legend": {
1194         "calcs": [],
1195         "displayMode": "list",
1196         "placement": "bottom"
1197       },
1198       "tooltip": {
1199         "mode": "single"
1200       }
1201     },
1202     "percentage": false,
1203     "pluginVersion": "8.5.6",
1204     "pointradius": 2,
1205     "points": false,
1206     "renderer": "flot",
1207     "seriesOverrides": [],
1208     "spaceLength": 10,
1209     "stack": false,
1210     "steppedLine": false,
1211     "targets": [
1212       {
1213         "exemplar": true,
1214         "expr": "label_replace(sum(irate(mongodb_wiredTiger_cache_bytes_read_into_cache{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1215         "interval": "",
1216         "legendFormat": "{{hostname}}:{{process_port}}",
1217         "refId": "A",
1218         "datasource": {
1219           "type": "prometheus",
1220           "uid": "${DS_THANOS}"
1221         }
1222       }
1223     ],
1224     "thresholds": [],
1225     "timeRegions": [],
1226     "title": "Cache Activity - Read Into",
1227     "tooltip": {
1228       "shared": true,
1229       "sort": 0,
1230       "value_type": "individual"
1231     },
1232     "type": "graph",
1233     "xaxis": {
1234       "mode": "time",
1235       "show": true,
1236       "values": []
1237     },
1238     "yaxes": [
1239       {
1240         "format": "Bps",
1241         "logBase": 1,
1242         "show": true
1243       },
1244       {
1245         "format": "short",
1246         "logBase": 1,
1247         "show": true
1248       }
1249     ],
1250     "yaxis": {
1251       "align": false
1252     }
1253   },
1254   {
1255     "aliasColors": {},
1256     "bars": false,
1257     "dashLength": 10,
1258     "dashes": false,
1259     "datasource": {
1260       "type": "prometheus",
1261       "uid": "${DS_THANOS}"
1262     },
1263     "description": "The average rate of bytes per second written from WiredTiger's cache over the selected sample period.\n",
1264     "fieldConfig": {
1265       "defaults": {
1266         "links": [],
1267         "unit": "Bps"
1268       },
1269       "overrides": []
1270     },
1271     "fill": 1,
1272     "fillGradient": 0,
1273     "gridPos": {
1274       "h": 8,
1275       "w": 6,
1276       "x": 6,
1277       "y": 30
1278     },
1279     "hiddenSeries": false,
1280     "id": 78,
1281     "legend": {
1282       "avg": false,
1283       "current": false,
1284       "max": false,
1285       "min": false,
1286       "show": true,
1287       "total": false,
1288       "values": false
1289     },
1290     "lines": true,
1291     "linewidth": 1,
1292     "nullPointMode": "null",
1293     "options": {
1294       "alertThreshold": true,
1295       "legend": {
1296         "calcs": [],
1297         "displayMode": "list",
1298         "placement": "bottom"
1299       },
1300       "tooltip": {
1301         "mode": "single"
1302       }
1303     },
1304     "percentage": false,
1305     "pluginVersion": "8.5.6",
1306     "pointradius": 2,
1307     "points": false,
1308     "renderer": "flot",
1309     "seriesOverrides": [],
1310     "spaceLength": 10,
1311     "stack": false,
1312     "steppedLine": false,
1313     "targets": [
1314       {
1315         "exemplar": true,
1316         "expr": "label_replace(sum(irate(mongodb_wiredTiger_cache_bytes_written_from_cache{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1317         "interval": "",
1318         "legendFormat": "{{hostname}}:{{process_port}}",
1319         "refId": "A",
1320         "datasource": {
1321           "type": "prometheus",
1322           "uid": "${DS_THANOS}"
1323         }
1324       }
1325     ],
1326     "thresholds": [],
1327     "timeRegions": [],
1328     "title": "Cache Activity - Write From",
1329     "tooltip": {
1330       "shared": true,
1331       "sort": 0,
1332       "value_type": "individual"
1333     },
1334     "type": "graph",
1335     "xaxis": {
1336       "mode": "time",
1337       "show": true,
1338       "values": []
1339     },
1340     "yaxes": [
1341       {
1342         "format": "Bps",
1343         "logBase": 1,
1344         "show": true
1345       },
1346       {
1347         "format": "short",
1348         "logBase": 1,
1349         "show": true
1350       }
1351     ],
1352     "yaxis": {
1353       "align": false
1354     }
1355   },
1356   {
1357     "aliasColors": {},
1358     "bars": false,
1359     "dashLength": 10,
1360     "dashes": false,
1361     "datasource": {
1362       "type": "prometheus",
1363       "uid": "${DS_THANOS}"
1364     },
1365     "description": "The number of bytes currently in the WiredTiger cache.",
1366     "fieldConfig": {
1367       "defaults": {
1368         "links": [],
1369         "unit": "bytes"
1370       },
1371       "overrides": []
1372     },
1373     "fill": 1,
1374     "fillGradient": 0,
1375     "gridPos": {
1376       "h": 8,
1377       "w": 6,
1378       "x": 12,
1379       "y": 30
1380     },
1381     "hiddenSeries": false,
1382     "id": 79,
1383     "legend": {
1384       "avg": false,
1385       "current": false,
1386       "max": false,
1387       "min": false,
1388       "show": true,
1389       "total": false,
1390       "values": false
1391     },
1392     "lines": true,
1393     "linewidth": 1,
1394     "nullPointMode": "null",
1395     "options": {
1396       "alertThreshold": true,
1397       "legend": {
1398         "calcs": [],
1399         "displayMode": "list",
1400         "placement": "bottom"
1401       },
1402       "tooltip": {
1403         "mode": "single"
1404       }
1405     },
1406     "percentage": false,
1407     "pluginVersion": "8.5.6",
1408     "pointradius": 2,
1409     "points": false,
1410     "renderer": "flot",
1411     "seriesOverrides": [],
1412     "spaceLength": 10,
1413     "stack": false,
1414     "steppedLine": false,
1415     "targets": [
1416       {
1417         "exemplar": true,
1418         "expr": "label_replace(sum(mongodb_wiredTiger_cache_bytes_currently_in_the_cache{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1419         "interval": "",
1420         "legendFormat": "{{hostname}}:{{process_port}}",
1421         "refId": "A",
1422         "datasource": {
1423           "type": "prometheus",
1424           "uid": "${DS_THANOS}"
1425         }
1426       }
1427     ],
1428     "thresholds": [],
1429     "timeRegions": [],
1430     "title": "Cache Usage - Used",
1431     "tooltip": {
1432       "shared": true,
1433       "sort": 0,
1434       "value_type": "individual"
1435     },
1436     "type": "graph",
1437     "xaxis": {
1438       "mode": "time",
1439       "show": true,
1440       "values": []
1441     },
1442     "yaxes": [
1443       {
1444         "format": "bytes",
1445         "logBase": 1,
1446         "show": true
1447       },
1448       {
1449         "format": "short",
1450         "logBase": 1,
1451         "show": true
1452       }
1453     ],
1454     "yaxis": {
1455       "align": false
1456     }
1457   },
1458   {
1459     "aliasColors": {},
1460     "bars": false,
1461     "dashLength": 10,
1462     "dashes": false,
1463     "datasource": {
1464       "type": "prometheus",
1465       "uid": "${DS_THANOS}"
1466     },
1467     "description": "The number of tracked dirty bytes currently in the WiredTiger cache.",
1468     "fieldConfig": {
1469       "defaults": {
1470         "links": [],
1471         "unit": "bytes"
1472       },
1473       "overrides": []
1474     },
1475     "fill": 1,
1476     "fillGradient": 0,
1477     "gridPos": {
1478       "h": 8,
1479       "w": 6,
1480       "x": 18,
1481       "y": 30
1482     },
1483     "hiddenSeries": false,
1484     "id": 80,
1485     "legend": {
1486       "avg": false,
1487       "current": false,
1488       "max": false,
1489       "min": false,
1490       "show": true,
1491       "total": false,
1492       "values": false
1493     },
1494     "lines": true,
1495     "linewidth": 1,
1496     "nullPointMode": "null",
1497     "options": {
1498       "alertThreshold": true,
1499       "legend": {
1500         "calcs": [],
1501         "displayMode": "list",
1502         "placement": "bottom"
1503       },
1504       "tooltip": {
1505         "mode": "single"
1506       }
1507     },
1508     "percentage": false,
1509     "pluginVersion": "8.5.6",
1510     "pointradius": 2,
1511     "points": false,
1512     "renderer": "flot",
1513     "seriesOverrides": [],
1514     "spaceLength": 10,
1515     "stack": false,
1516     "steppedLine": false,
1517     "targets": [
1518       {
1519         "exemplar": true,
1520         "expr": "label_replace(sum(mongodb_wiredTiger_cache_tracked_dirty_bytes_in_the_cache{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1521         "interval": "",
1522         "legendFormat": "{{hostname}}:{{process_port}}",
1523         "refId": "A",
1524         "datasource": {
1525           "type": "prometheus",
1526           "uid": "${DS_THANOS}"
1527         }
1528       }
1529     ],
1530     "thresholds": [],
1531     "timeRegions": [],
1532     "title": "Cache Usage - Dirty",
1533     "tooltip": {
1534       "shared": true,
1535       "sort": 0,
1536       "value_type": "individual"
1537     },
1538     "type": "graph",
1539     "xaxis": {
1540       "mode": "time",
1541       "show": true,
1542       "values": []
1543     },
1544     "yaxes": [
1545       {
1546         "format": "bytes",
1547         "logBase": 1,
1548         "show": true
1549       },
1550       {
1551         "format": "short",
1552         "logBase": 1,
1553         "show": true
1554       }
1555     ],
1556     "yaxis": {
1557       "align": false
1558     }
1559   },
1560   {
1561     "collapsed": false,
1562     "datasource": {
1563       "type": "prometheus",
1564       "uid": "000000010"
1565     },
1566     "gridPos": {
1567       "h": 1,
1568       "w": 24,
1569       "x": 0,
1570       "y": 38
1571     },
1572     "id": 28,
1573     "panels": [],
1574     "title": "Connections",
1575     "type": "row"
1576   },
1577   {
1578     "aliasColors": {},
1579     "bars": false,
1580     "dashLength": 10,
1581     "dashes": false,
1582     "datasource": {
1583       "type": "prometheus",
1584       "uid": "${DS_THANOS}"
1585     },
1586     "description": "The number of currently active connections to this server. A stack is allocated per connection; thus very many connections can result in significant RAM usage.",
1587     "fieldConfig": {
1588       "defaults": {
1589         "links": [],
1590         "unit": "none"
1591       },
1592       "overrides": []
1593     },
1594     "fill": 1,
1595     "fillGradient": 0,
1596     "gridPos": {
1597       "h": 9,
1598       "w": 24,
1599       "x": 0,
1600       "y": 39
1601     },
1602     "hiddenSeries": false,
1603     "id": 81,
1604     "legend": {
1605       "avg": false,
1606       "current": false,
1607       "max": false,
1608       "min": false,
1609       "show": true,
1610       "total": false,
1611       "values": false
1612     },
1613     "lines": true,
1614     "linewidth": 1,
1615     "nullPointMode": "null",
1616     "options": {
1617       "alertThreshold": true,
1618       "legend": {
1619         "calcs": [],
1620         "displayMode": "list",
1621         "placement": "bottom"
1622       },
1623       "tooltip": {
1624         "mode": "single"
1625       }
1626     },
1627     "percentage": false,
1628     "pluginVersion": "8.5.6",
1629     "pointradius": 2,
1630     "points": false,
1631     "renderer": "flot",
1632     "seriesOverrides": [],
1633     "spaceLength": 10,
1634     "stack": false,
1635     "steppedLine": false,
1636     "targets": [
1637       {
1638         "exemplar": true,
1639         "expr": "label_replace(sum(mongodb_connections_current{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1640         "interval": "",
1641         "legendFormat": "{{hostname}}:{{process_port}}",
1642         "refId": "A",
1643         "datasource": {
1644           "type": "prometheus",
1645           "uid": "${DS_THANOS}"
1646         }
1647       }
1648     ],
1649     "thresholds": [],
1650     "timeRegions": [],
1651     "title": "Connections - Current",
1652     "tooltip": {
1653       "shared": true,
1654       "sort": 0,
1655       "value_type": "individual"
1656     },
1657     "type": "graph",
1658     "xaxis": {
1659       "mode": "time",
1660       "show": true,
1661       "values": []
1662     },
1663     "yaxes": [
1664       {
1665         "format": "none",
1666         "logBase": 1,
1667         "show": true
1668       },
1669       {
1670         "format": "short",
1671         "logBase": 1,
1672         "show": true
1673       }
1674     ],
1675     "yaxis": {
1676       "align": false
1677     }
1678   },
1679   {
1680     "collapsed": false,
1681     "datasource": {
1682       "type": "prometheus",
1683       "uid": "000000010"
1684     },
1685     "gridPos": {
1686       "h": 1,
1687       "w": 24,
1688       "x": 0,
1689       "y": 48
1690     },
1691     "id": 30,
1692     "panels": [],
1693     "title": "Cursors",
1694     "type": "row"
1695   },
1696   {
1697     "aliasColors": {},
1698     "bars": false,
1699     "dashLength": 10,
1700     "dashes": false,
1701     "datasource": {
1702       "type": "prometheus",
1703       "uid": "${DS_THANOS}"
1704     },
1705     "description": "The number of cursors that the server is maintaining for clients. Because MongoDB exhausts unused cursors, typically this value is small or zero. However, if there is a queue, stale tailable cursors, or a large number of operations this value may rise.",
1706     "fieldConfig": {
1707       "defaults": {
1708         "links": [],
1709         "unit": "none"
1710       },
1711       "overrides": []
1712     },
1713     "fill": 1,
1714     "fillGradient": 0,
1715     "gridPos": {
1716       "h": 8,
1717       "w": 13,
1718       "x": 0,
1719       "y": 49
1720     },
1721     "hiddenSeries": false,
1722     "id": 82,
1723     "legend": {
1724       "avg": false,
1725       "current": false,
1726       "max": false,
1727       "min": false,
1728       "show": true,
1729       "total": false,
1730       "values": false
1731     },
1732     "lines": true,
1733     "linewidth": 1,
1734     "nullPointMode": "null",
1735     "options": {
1736       "alertThreshold": true,
1737       "legend": {
1738         "calcs": [],
1739         "displayMode": "list",
1740         "placement": "bottom"
1741       },
1742       "tooltip": {
1743         "mode": "single"
1744       }
1745     },
1746     "percentage": false,
1747     "pluginVersion": "8.5.6",
1748     "pointradius": 2,
1749     "points": false,
1750     "renderer": "flot",
1751     "seriesOverrides": [],
1752     "spaceLength": 10,
1753     "stack": false,
1754     "steppedLine": false,
1755     "targets": [
1756       {
1757         "exemplar": true,
1758         "expr": "label_replace(sum(mongodb_metrics_cursor_open_total{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1759         "interval": "",
1760         "legendFormat": "{{hostname}}:{{process_port}}",
1761         "refId": "A",
1762         "datasource": {
1763           "type": "prometheus",
1764           "uid": "${DS_THANOS}"
1765         }
1766       }
1767     ],
1768     "thresholds": [],
1769     "timeRegions": [],
1770     "title": "Cursors - Total Open",
1771     "tooltip": {
1772       "shared": true,
1773       "sort": 0,
1774       "value_type": "individual"
1775     },
1776     "type": "graph",
1777     "xaxis": {
1778       "mode": "time",
1779       "show": true,
1780       "values": []
1781     },
1782     "yaxes": [
1783       {
1784         "format": "none",
1785         "logBase": 1,
1786         "show": true
1787       },
1788       {
1789         "format": "short",
1790         "logBase": 1,
1791         "show": true
1792       }
1793     ],
1794     "yaxis": {
1795       "align": false
1796     }
1797   },
1798   {
1799     "aliasColors": {},
1800     "bars": false,
1801     "dashLength": 10,
1802     "dashes": false,
1803     "datasource": {
1804       "type": "prometheus",
1805       "uid": "${DS_THANOS}"
1806     },
1807     "description": "The average rate of cursors that have timed out per second over the selected sample period",
1808     "fieldConfig": {
1809       "defaults": {
1810         "links": [],
1811         "unit": "none"
1812       },
1813       "overrides": []
1814     },
1815     "fill": 1,
1816     "fillGradient": 0,
1817     "gridPos": {
1818       "h": 8,
1819       "w": 11,
1820       "x": 13,
1821       "y": 49
1822     },
1823     "hiddenSeries": false,
1824     "id": 83,
1825     "legend": {
1826       "avg": false,
1827       "current": false,
1828       "max": false,
1829       "min": false,
1830       "show": true,
1831       "total": false,
1832       "values": false
1833     },
1834     "lines": true,
1835     "linewidth": 1,
1836     "nullPointMode": "null",
1837     "options": {
1838       "alertThreshold": true,
1839       "legend": {
1840         "calcs": [],
1841         "displayMode": "list",
1842         "placement": "bottom"
1843       },
1844       "tooltip": {
1845         "mode": "single"
1846       }
1847     },
1848     "percentage": false,
1849     "pluginVersion": "8.5.6",
1850     "pointradius": 2,
1851     "points": false,
1852     "renderer": "flot",
1853     "seriesOverrides": [],
1854     "spaceLength": 10,
1855     "stack": false,
1856     "steppedLine": false,
1857     "targets": [
1858       {
1859         "exemplar": true,
1860         "expr": "label_replace(sum(mongodb_metrics_cursor_timedOut{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1861         "interval": "",
1862         "legendFormat": "{{hostname}}:{{process_port}}",
1863         "refId": "A",
1864         "datasource": {
1865           "type": "prometheus",
1866           "uid": "${DS_THANOS}"
1867         }
1868       }
1869     ],
1870     "thresholds": [],
1871     "timeRegions": [],
1872     "title": "Cursors - Timed Out",
1873     "tooltip": {
1874       "shared": true,
1875       "sort": 0,
1876       "value_type": "individual"
1877     },
1878     "type": "graph",
1879     "xaxis": {
1880       "mode": "time",
1881       "show": true,
1882       "values": []
1883     },
1884     "yaxes": [
1885       {
1886         "format": "none",
1887         "logBase": 1,
1888         "show": true
1889       },
1890       {
1891         "format": "short",
1892         "logBase": 1,
1893         "show": true
1894       }
1895     ],
1896     "yaxis": {
1897       "align": false
1898     }
1899   },
1900   {
1901     "collapsed": false,
1902     "datasource": {
1903       "type": "prometheus",
1904       "uid": "000000010"
1905     },
1906     "gridPos": {
1907       "h": 1,
1908       "w": 24,
1909       "x": 0,
1910       "y": 57
1911     },
1912     "id": 32,
1913     "panels": [],
1914     "title": "Document Metrics",
1915     "type": "row"
1916   },
1917   {
1918     "aliasColors": {},
1919     "bars": false,
1920     "dashLength": 10,
1921     "dashes": false,
1922     "datasource": {
1923       "type": "prometheus",
1924       "uid": "${DS_THANOS}"
1925     },
1926     "description": "The average rate per second of documents returned by queries over the selected sample period.",
1927     "fieldConfig": {
1928       "defaults": {
1929         "links": [],
1930         "unit": "/s"
1931       },
1932       "overrides": []
1933     },
1934     "fill": 1,
1935     "fillGradient": 0,
1936     "gridPos": {
1937       "h": 8,
1938       "w": 6,
1939       "x": 0,
1940       "y": 58
1941     },
1942     "hiddenSeries": false,
1943     "id": 84,
1944     "legend": {
1945       "avg": false,
1946       "current": false,
1947       "max": false,
1948       "min": false,
1949       "show": true,
1950       "total": false,
1951       "values": false
1952     },
1953     "lines": true,
1954     "linewidth": 1,
1955     "nullPointMode": "null",
1956     "options": {
1957       "alertThreshold": true,
1958       "legend": {
1959         "calcs": [],
1960         "displayMode": "list",
1961         "placement": "bottom"
1962       },
1963       "tooltip": {
1964         "mode": "single"
1965       }
1966     },
1967     "percentage": false,
1968     "pluginVersion": "8.5.6",
1969     "pointradius": 2,
1970     "points": false,
1971     "renderer": "flot",
1972     "seriesOverrides": [],
1973     "spaceLength": 10,
1974     "stack": false,
1975     "steppedLine": false,
1976     "targets": [
1977       {
1978         "exemplar": true,
1979         "expr": "label_replace(sum(irate(mongodb_metrics_document_returned{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
1980         "interval": "",
1981         "legendFormat": "{{hostname}}:{{process_port}}",
1982         "refId": "A",
1983         "datasource": {
1984           "type": "prometheus",
1985           "uid": "${DS_THANOS}"
1986         }
1987       }
1988     ],
1989     "thresholds": [],
1990     "timeRegions": [],
1991     "title": "Document Metrics - Returned",
1992     "tooltip": {
1993       "shared": true,
1994       "sort": 0,
1995       "value_type": "individual"
1996     },
1997     "type": "graph",
1998     "xaxis": {
1999       "mode": "time",
2000       "show": true,
2001       "values": []
2002     },
2003     "yaxes": [
2004       {
2005         "format": "/s",
2006         "logBase": 1,
2007         "show": true
2008       },
2009       {
2010         "format": "short",
2011         "logBase": 1,
2012         "show": true
2013       }
2014     ],
2015     "yaxis": {
2016       "align": false
2017     }
2018   },
2019   {
2020     "aliasColors": {},
2021     "bars": false,
2022     "dashLength": 10,
2023     "dashes": false,
2024     "datasource": {
2025       "type": "prometheus",
2026       "uid": "${DS_THANOS}"
2027     },
2028     "description": "The average rate per second of documents inserted over the selected sample period.",
2029     "fieldConfig": {
2030       "defaults": {
2031         "links": [],
2032         "unit": "/s"
2033       },
2034       "overrides": []
2035     },
2036     "fill": 1,
2037     "fillGradient": 0,
2038     "gridPos": {
2039       "h": 8,
2040       "w": 6,
2041       "x": 6,
2042       "y": 58
2043     },
2044     "hiddenSeries": false,
2045     "id": 87,
2046     "legend": {
2047       "avg": false,
2048       "current": false,
2049       "max": false,
2050       "min": false,
2051       "show": true,
2052       "total": false,
2053       "values": false
2054     },
2055     "lines": true,
2056     "linewidth": 1,
2057     "nullPointMode": "null",
2058     "options": {
2059       "alertThreshold": true,
2060       "legend": {
2061         "calcs": [],
2062         "displayMode": "list",
2063         "placement": "bottom"
2064       },
2065       "tooltip": {
2066         "mode": "single"
2067       }
2068     },
2069     "percentage": false,
2070     "pluginVersion": "8.5.6",
2071     "pointradius": 2,
2072     "points": false,
2073     "renderer": "flot",
2074     "seriesOverrides": [],
2075     "spaceLength": 10,
2076     "stack": false,
2077     "steppedLine": false,
2078     "targets": [
2079       {
2080         "exemplar": true,
2081         "expr": "label_replace(sum(irate(mongodb_metrics_document_inserted{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2082         "interval": "",
2083         "legendFormat": "{{hostname}}:{{process_port}}",
2084         "refId": "A",
2085         "datasource": {
2086           "type": "prometheus",
2087           "uid": "${DS_THANOS}"
2088         }
2089       }
2090     ],
2091     "thresholds": [],
2092     "timeRegions": [],
2093     "title": "Document Metrics - Inserted",
2094     "tooltip": {
2095       "shared": true,
2096       "sort": 0,
2097       "value_type": "individual"
2098     },
2099     "type": "graph",
2100     "xaxis": {
2101       "mode": "time",
2102       "show": true,
2103       "values": []
2104     },
2105     "yaxes": [
2106       {
2107         "format": "/s",
2108         "logBase": 1,
2109         "show": true
2110       },
2111       {
2112         "format": "short",
2113         "logBase": 1,
2114         "show": true
2115       }
2116     ],
2117     "yaxis": {
2118       "align": false
2119     }
2120   },
2121   {
2122     "aliasColors": {},
2123     "bars": false,
2124     "dashLength": 10,
2125     "dashes": false,
2126     "datasource": {
2127       "type": "prometheus",
2128       "uid": "${DS_THANOS}"
2129     },
2130     "description": "The average rate per second of documents updated over the selected sample period.",
2131     "fieldConfig": {
2132       "defaults": {
2133         "links": [],
2134         "unit": "/s"
2135       },
2136       "overrides": []
2137     },
2138     "fill": 1,
2139     "fillGradient": 0,
2140     "gridPos": {
2141       "h": 8,
2142       "w": 6,
2143       "x": 12,
2144       "y": 58
2145     },
2146     "hiddenSeries": false,
2147     "id": 86,
2148     "legend": {
2149       "avg": false,
2150       "current": false,
2151       "max": false,
2152       "min": false,
2153       "show": true,
2154       "total": false,
2155       "values": false
2156     },
2157     "lines": true,
2158     "linewidth": 1,
2159     "nullPointMode": "null",
2160     "options": {
2161       "alertThreshold": true,
2162       "legend": {
2163         "calcs": [],
2164         "displayMode": "list",
2165         "placement": "bottom"
2166       },
2167       "tooltip": {
2168         "mode": "single"
2169       }
2170     },
2171     "percentage": false,
2172     "pluginVersion": "8.5.6",
2173     "pointradius": 2,
2174     "points": false,
2175     "renderer": "flot",
2176     "seriesOverrides": [],
2177     "spaceLength": 10,
2178     "stack": false,
2179     "steppedLine": false,
2180     "targets": [
2181       {
2182         "exemplar": true,
2183         "expr": "label_replace(sum(irate(mongodb_metrics_document_updated{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2184         "interval": "",
2185         "legendFormat": "{{hostname}}:{{process_port}}",
2186         "refId": "A",
2187         "datasource": {
2188           "type": "prometheus",
2189           "uid": "${DS_THANOS}"
2190         }
2191       }
2192     ],
2193     "thresholds": [],
2194     "timeRegions": [],
2195     "title": "Document Metrics - Updated",
2196     "tooltip": {
2197       "shared": true,
2198       "sort": 0,
2199       "value_type": "individual"
2200     },
2201     "type": "graph",
2202     "xaxis": {
2203       "mode": "time",
2204       "show": true,
2205       "values": []
2206     },
2207     "yaxes": [
2208       {
2209         "format": "/s",
2210         "logBase": 1,
2211         "show": true
2212       },
2213       {
2214         "format": "short",
2215         "logBase": 1,
2216         "show": true
2217       }
2218     ],
2219     "yaxis": {
2220       "align": false
2221     }
2222   },
2223   {
2224     "aliasColors": {},
2225     "bars": false,
2226     "dashLength": 10,
2227     "dashes": false,
2228     "datasource": {
2229       "type": "prometheus",
2230       "uid": "${DS_THANOS}"
2231     },
2232     "description": "The average rate per second of documents deleted over the selected sample period.",
2233     "fieldConfig": {
2234       "defaults": {
2235         "links": [],
2236         "unit": "/s"
2237       },
2238       "overrides": []
2239     },
2240     "fill": 1,
2241     "fillGradient": 0,
2242     "gridPos": {
2243       "h": 8,
2244       "w": 6,
2245       "x": 18,
2246       "y": 58
2247     },
2248     "hiddenSeries": false,
2249     "id": 85,
2250     "legend": {
2251       "avg": false,
2252       "current": false,
2253       "max": false,
2254       "min": false,
2255       "show": true,
2256       "total": false,
2257       "values": false
2258     },
2259     "lines": true,
2260     "linewidth": 1,
2261     "nullPointMode": "null",
2262     "options": {
2263       "alertThreshold": true,
2264       "legend": {
2265         "calcs": [],
2266         "displayMode": "list",
2267         "placement": "bottom"
2268       },
2269       "tooltip": {
2270         "mode": "single"
2271       }
2272     },
2273     "percentage": false,
2274     "pluginVersion": "8.5.6",
2275     "pointradius": 2,
2276     "points": false,
2277     "renderer": "flot",
2278     "seriesOverrides": [],
2279     "spaceLength": 10,
2280     "stack": false,
2281     "steppedLine": false,
2282     "targets": [
2283       {
2284         "exemplar": true,
2285         "expr": "label_replace(sum(irate(mongodb_metrics_document_deleted{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2286         "interval": "",
2287         "legendFormat": "{{hostname}}:{{process_port}}",
2288         "refId": "A",
2289         "datasource": {
2290           "type": "prometheus",
2291           "uid": "${DS_THANOS}"
2292         }
2293       }
2294     ],
2295     "thresholds": [],
2296     "timeRegions": [],
2297     "title": "Document Metrics - Deleted",
2298     "tooltip": {
2299       "shared": true,
2300       "sort": 0,
2301       "value_type": "individual"
2302     },
2303     "type": "graph",
2304     "xaxis": {
2305       "mode": "time",
2306       "show": true,
2307       "values": []
2308     },
2309     "yaxes": [
2310       {
2311         "format": "/s",
2312         "logBase": 1,
2313         "show": true
2314       },
2315       {
2316         "format": "short",
2317         "logBase": 1,
2318         "show": true
2319       }
2320     ],
2321     "yaxis": {
2322       "align": false
2323     }
2324   },
2325   {
2326     "collapsed": false,
2327     "datasource": {
2328       "type": "prometheus",
2329       "uid": "000000010"
2330     },
2331     "gridPos": {
2332       "h": 1,
2333       "w": 24,
2334       "x": 0,
2335       "y": 66
2336     },
2337     "id": 69,
2338     "panels": [],
2339     "title": "Network",
2340     "type": "row"
2341   },
2342   {
2343     "aliasColors": {},
2344     "bars": false,
2345     "dashLength": 10,
2346     "dashes": false,
2347     "datasource": {
2348       "type": "prometheus",
2349       "uid": "${DS_THANOS}"
2350     },
2351     "description": "The average rate of requests sent to this database server per second over the selected sample period",
2352     "fieldConfig": {
2353       "defaults": {
2354         "links": [],
2355         "unit": "/s"
2356       },
2357       "overrides": []
2358     },
2359     "fill": 1,
2360     "fillGradient": 0,
2361     "gridPos": {
2362       "h": 8,
2363       "w": 8,
2364       "x": 0,
2365       "y": 67
2366     },
2367     "hiddenSeries": false,
2368     "id": 88,
2369     "legend": {
2370       "avg": false,
2371       "current": false,
2372       "max": false,
2373       "min": false,
2374       "show": true,
2375       "total": false,
2376       "values": false
2377     },
2378     "lines": true,
2379     "linewidth": 1,
2380     "nullPointMode": "null",
2381     "options": {
2382       "alertThreshold": true,
2383       "legend": {
2384         "calcs": [],
2385         "displayMode": "list",
2386         "placement": "bottom"
2387       },
2388       "tooltip": {
2389         "mode": "single"
2390       }
2391     },
2392     "percentage": false,
2393     "pluginVersion": "8.5.6",
2394     "pointradius": 2,
2395     "points": false,
2396     "renderer": "flot",
2397     "seriesOverrides": [],
2398     "spaceLength": 10,
2399     "stack": false,
2400     "steppedLine": false,
2401     "targets": [
2402       {
2403         "exemplar": true,
2404         "expr": "label_replace(sum(irate(mongodb_network_numRequests{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2405         "interval": "",
2406         "legendFormat": "{{hostname}}:{{process_port}}",
2407         "refId": "A",
2408         "datasource": {
2409           "type": "prometheus",
2410           "uid": "${DS_THANOS}"
2411         }
2412       }
2413     ],
2414     "thresholds": [],
2415     "timeRegions": [],
2416     "title": "Network - Num Requests",
2417     "tooltip": {
2418       "shared": true,
2419       "sort": 0,
2420       "value_type": "individual"
2421     },
2422     "type": "graph",
2423     "xaxis": {
2424       "mode": "time",
2425       "show": true,
2426       "values": []
2427     },
2428     "yaxes": [
2429       {
2430         "format": "/s",
2431         "logBase": 1,
2432         "show": true
2433       },
2434       {
2435         "format": "short",
2436         "logBase": 1,
2437         "show": true
2438       }
2439     ],
2440     "yaxis": {
2441       "align": false
2442     }
2443   },
2444   {
2445     "aliasColors": {},
2446     "bars": false,
2447     "dashLength": 10,
2448     "dashes": false,
2449     "datasource": {
2450       "type": "prometheus",
2451       "uid": "${DS_THANOS}"
2452     },
2453     "description": "The average rate of physical (after any wire compression) bytes sent to this database server per second over the selected sample period",
2454     "fieldConfig": {
2455       "defaults": {
2456         "links": [],
2457         "unit": "binBps"
2458       },
2459       "overrides": []
2460     },
2461     "fill": 1,
2462     "fillGradient": 0,
2463     "gridPos": {
2464       "h": 8,
2465       "w": 16,
2466       "x": 8,
2467       "y": 67
2468     },
2469     "hiddenSeries": false,
2470     "id": 90,
2471     "legend": {
2472       "avg": false,
2473       "current": false,
2474       "max": false,
2475       "min": false,
2476       "show": true,
2477       "total": false,
2478       "values": false
2479     },
2480     "lines": true,
2481     "linewidth": 1,
2482     "nullPointMode": "null",
2483     "options": {
2484       "alertThreshold": true,
2485       "legend": {
2486         "calcs": [],
2487         "displayMode": "list",
2488         "placement": "bottom"
2489       },
2490       "tooltip": {
2491         "mode": "single"
2492       }
2493     },
2494     "percentage": false,
2495     "pluginVersion": "8.5.6",
2496     "pointradius": 2,
2497     "points": false,
2498     "renderer": "flot",
2499     "seriesOverrides": [],
2500     "spaceLength": 10,
2501     "stack": false,
2502     "steppedLine": false,
2503     "targets": [
2504       {
2505         "exemplar": true,
2506         "expr": "label_replace(sum(irate(mongodb_network_bytesIn{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2507         "interval": "",
2508         "legendFormat": "rx - {{hostname}}:{{process_port}}",
2509         "refId": "A",
2510         "datasource": {
2511           "type": "prometheus",
2512           "uid": "${DS_THANOS}"
2513         }
2514       },
2515       {
2516         "expr": "label_replace(-1 * sum(irate(mongodb_network_bytesOut{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2517         "legendFormat": "tx - {{hostname}}:{{process_port}}",
2518         "refId": "B",
2519         "datasource": {
2520           "type": "prometheus",
2521           "uid": "${DS_THANOS}"
2522         }
2523       }
2524     ],
2525     "thresholds": [],
2526     "timeRegions": [],
2527     "title": "Network - Bytes In",
2528     "tooltip": {
2529       "shared": true,
2530       "sort": 0,
2531       "value_type": "individual"
2532     },
2533     "type": "graph",
2534     "xaxis": {
2535       "mode": "time",
2536       "show": true,
2537       "values": []
2538     },
2539     "yaxes": [
2540       {
2541         "format": "binBps",
2542         "logBase": 1,
2543         "show": true
2544       },
2545       {
2546         "format": "short",
2547         "logBase": 1,
2548         "show": true
2549       }
2550     ],
2551     "yaxis": {
2552       "align": false
2553     }
2554   },
2555   {
2556     "collapsed": false,
2557     "datasource": {
2558       "type": "prometheus",
2559       "uid": "000000010"
2560     },
2561     "gridPos": {
2562       "h": 1,
2563       "w": 24,
2564       "x": 0,
2565       "y": 75
2566     },
2567     "id": 93,
2568     "panels": [],
2569     "title": "Opcounters",
2570     "type": "row"
2571   },
2572   {
2573     "aliasColors": {},
2574     "bars": false,
2575     "dashLength": 10,
2576     "dashes": false,
2577     "datasource": {
2578       "type": "prometheus",
2579       "uid": "${DS_THANOS}"
2580     },
2581     "description": "The average rate of commands performed per second over the selected sample period",
2582     "fieldConfig": {
2583       "defaults": {
2584         "links": [],
2585         "unit": "/s"
2586       },
2587       "overrides": []
2588     },
2589     "fill": 1,
2590     "fillGradient": 0,
2591     "gridPos": {
2592       "h": 8,
2593       "w": 8,
2594       "x": 0,
2595       "y": 76
2596     },
2597     "hiddenSeries": false,
2598     "id": 96,
2599     "legend": {
2600       "avg": false,
2601       "current": false,
2602       "max": false,
2603       "min": false,
2604       "show": true,
2605       "total": false,
2606       "values": false
2607     },
2608     "lines": true,
2609     "linewidth": 1,
2610     "nullPointMode": "null",
2611     "options": {
2612       "alertThreshold": true,
2613       "legend": {
2614         "calcs": [],
2615         "displayMode": "list",
2616         "placement": "bottom"
2617       },
2618       "tooltip": {
2619         "mode": "single"
2620       }
2621     },
2622     "percentage": false,
2623     "pluginVersion": "8.5.6",
2624     "pointradius": 2,
2625     "points": false,
2626     "renderer": "flot",
2627     "seriesOverrides": [],
2628     "spaceLength": 10,
2629     "stack": false,
2630     "steppedLine": false,
2631     "targets": [
2632       {
2633         "exemplar": true,
2634         "expr": "label_replace(sum(irate(mongodb_opcounters_command{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2635         "interval": "",
2636         "legendFormat": "{{hostname}}:{{process_port}}",
2637         "refId": "A",
2638         "datasource": {
2639           "type": "prometheus",
2640           "uid": "${DS_THANOS}"
2641         }
2642       }
2643     ],
2644     "thresholds": [],
2645     "timeRegions": [],
2646     "title": "Opcounters - Command",
2647     "tooltip": {
2648       "shared": true,
2649       "sort": 0,
2650       "value_type": "individual"
2651     },
2652     "type": "graph",
2653     "xaxis": {
2654       "mode": "time",
2655       "show": true,
2656       "values": []
2657     },
2658     "yaxes": [
2659       {
2660         "format": "/s",
2661         "logBase": 1,
2662         "show": true
2663       },
2664       {
2665         "format": "short",
2666         "logBase": 1,
2667         "show": true
2668       }
2669     ],
2670     "yaxis": {
2671       "align": false
2672     }
2673   },
2674   {
2675     "aliasColors": {},
2676     "bars": false,
2677     "dashLength": 10,
2678     "dashes": false,
2679     "datasource": {
2680       "type": "prometheus",
2681       "uid": "${DS_THANOS}"
2682     },
2683     "description": "The average rate of queries performed per second over the selected sample period",
2684     "fieldConfig": {
2685       "defaults": {
2686         "links": [],
2687         "unit": "/s"
2688       },
2689       "overrides": []
2690     },
2691     "fill": 1,
2692     "fillGradient": 0,
2693     "gridPos": {
2694       "h": 8,
2695       "w": 8,
2696       "x": 8,
2697       "y": 76
2698     },
2699     "hiddenSeries": false,
2700     "id": 101,
2701     "legend": {
2702       "avg": false,
2703       "current": false,
2704       "max": false,
2705       "min": false,
2706       "show": true,
2707       "total": false,
2708       "values": false
2709     },
2710     "lines": true,
2711     "linewidth": 1,
2712     "nullPointMode": "null",
2713     "options": {
2714       "alertThreshold": true,
2715       "legend": {
2716         "calcs": [],
2717         "displayMode": "list",
2718         "placement": "bottom"
2719       },
2720       "tooltip": {
2721         "mode": "single"
2722       }
2723     },
2724     "percentage": false,
2725     "pluginVersion": "8.5.6",
2726     "pointradius": 2,
2727     "points": false,
2728     "renderer": "flot",
2729     "seriesOverrides": [],
2730     "spaceLength": 10,
2731     "stack": false,
2732     "steppedLine": false,
2733     "targets": [
2734       {
2735         "exemplar": true,
2736         "expr": "label_replace(sum(irate(mongodb_opcounters_query{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2737         "interval": "",
2738         "legendFormat": "{{hostname}}:{{process_port}}",
2739         "refId": "A",
2740         "datasource": {
2741           "type": "prometheus",
2742           "uid": "${DS_THANOS}"
2743         }
2744       }
2745     ],
2746     "thresholds": [],
2747     "timeRegions": [],
2748     "title": "Opcounters - Query",
2749     "tooltip": {
2750       "shared": true,
2751       "sort": 0,
2752       "value_type": "individual"
2753     },
2754     "type": "graph",
2755     "xaxis": {
2756       "mode": "time",
2757       "show": true,
2758       "values": []
2759     },
2760     "yaxes": [
2761       {
2762         "format": "/s",
2763         "logBase": 1,
2764         "show": true
2765       },
2766       {
2767         "format": "short",
2768         "logBase": 1,
2769         "show": true
2770       }
2771     ],
2772     "yaxis": {
2773       "align": false
2774     }
2775   },
2776   {
2777     "aliasColors": {},
2778     "bars": false,
2779     "dashLength": 10,
2780     "dashes": false,
2781     "datasource": {
2782       "type": "prometheus",
2783       "uid": "${DS_THANOS}"
2784     },
2785     "description": "The average rate of updates performed per second over the selected sample period",
2786     "fieldConfig": {
2787       "defaults": {
2788         "links": [],
2789         "unit": "/s"
2790       },
2791       "overrides": []
2792     },
2793     "fill": 1,
2794     "fillGradient": 0,
2795     "gridPos": {
2796       "h": 8,
2797       "w": 8,
2798       "x": 16,
2799       "y": 76
2800     },
2801     "hiddenSeries": false,
2802     "id": 100,
2803     "legend": {
2804       "avg": false,
2805       "current": false,
2806       "max": false,
2807       "min": false,
2808       "show": true,
2809       "total": false,
2810       "values": false
2811     },
2812     "lines": true,
2813     "linewidth": 1,
2814     "nullPointMode": "null",
2815     "options": {
2816       "alertThreshold": true,
2817       "legend": {
2818         "calcs": [],
2819         "displayMode": "list",
2820         "placement": "bottom"
2821       },
2822       "tooltip": {
2823         "mode": "single"
2824       }
2825     },
2826     "percentage": false,
2827     "pluginVersion": "8.5.6",
2828     "pointradius": 2,
2829     "points": false,
2830     "renderer": "flot",
2831     "seriesOverrides": [],
2832     "spaceLength": 10,
2833     "stack": false,
2834     "steppedLine": false,
2835     "targets": [
2836       {
2837         "exemplar": true,
2838         "expr": "label_replace(sum(irate(mongodb_opcounters_update{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2839         "interval": "",
2840         "legendFormat": "{{hostname}}:{{process_port}}",
2841         "refId": "A",
2842         "datasource": {
2843           "type": "prometheus",
2844           "uid": "${DS_THANOS}"
2845         }
2846       }
2847     ],
2848     "thresholds": [],
2849     "timeRegions": [],
2850     "title": "Opcounters - Update",
2851     "tooltip": {
2852       "shared": true,
2853       "sort": 0,
2854       "value_type": "individual"
2855     },
2856     "type": "graph",
2857     "xaxis": {
2858       "mode": "time",
2859       "show": true,
2860       "values": []
2861     },
2862     "yaxes": [
2863       {
2864         "format": "/s",
2865         "logBase": 1,
2866         "show": true
2867       },
2868       {
2869         "format": "short",
2870         "logBase": 1,
2871         "show": true
2872       }
2873     ],
2874     "yaxis": {
2875       "align": false
2876     }
2877   },
2878   {
2879     "aliasColors": {},
2880     "bars": false,
2881     "dashLength": 10,
2882     "dashes": false,
2883     "datasource": {
2884       "type": "prometheus",
2885       "uid": "${DS_THANOS}"
2886     },
2887     "description": "The average rate of deletes performed per second over the selected sample period",
2888     "fieldConfig": {
2889       "defaults": {
2890         "links": [],
2891         "unit": "/s"
2892       },
2893       "overrides": []
2894     },
2895     "fill": 1,
2896     "fillGradient": 0,
2897     "gridPos": {
2898       "h": 8,
2899       "w": 8,
2900       "x": 0,
2901       "y": 84
2902     },
2903     "hiddenSeries": false,
2904     "id": 99,
2905     "legend": {
2906       "avg": false,
2907       "current": false,
2908       "max": false,
2909       "min": false,
2910       "show": true,
2911       "total": false,
2912       "values": false
2913     },
2914     "lines": true,
2915     "linewidth": 1,
2916     "nullPointMode": "null",
2917     "options": {
2918       "alertThreshold": true,
2919       "legend": {
2920         "calcs": [],
2921         "displayMode": "list",
2922         "placement": "bottom"
2923       },
2924       "tooltip": {
2925         "mode": "single"
2926       }
2927     },
2928     "percentage": false,
2929     "pluginVersion": "8.5.6",
2930     "pointradius": 2,
2931     "points": false,
2932     "renderer": "flot",
2933     "seriesOverrides": [],
2934     "spaceLength": 10,
2935     "stack": false,
2936     "steppedLine": false,
2937     "targets": [
2938       {
2939         "exemplar": true,
2940         "expr": "label_replace(sum(irate(mongodb_opcounters_delete{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
2941         "interval": "",
2942         "legendFormat": "{{hostname}}:{{process_port}}",
2943         "refId": "A",
2944         "datasource": {
2945           "type": "prometheus",
2946           "uid": "${DS_THANOS}"
2947         }
2948       }
2949     ],
2950     "thresholds": [],
2951     "timeRegions": [],
2952     "title": "Opcounters - Delete",
2953     "tooltip": {
2954       "shared": true,
2955       "sort": 0,
2956       "value_type": "individual"
2957     },
2958     "type": "graph",
2959     "xaxis": {
2960       "mode": "time",
2961       "show": true,
2962       "values": []
2963     },
2964     "yaxes": [
2965       {
2966         "format": "/s",
2967         "logBase": 1,
2968         "show": true
2969       },
2970       {
2971         "format": "short",
2972         "logBase": 1,
2973         "show": true
2974       }
2975     ],
2976     "yaxis": {
2977       "align": false
2978     }
2979   },
2980   {
2981     "aliasColors": {},
2982     "bars": false,
2983     "dashLength": 10,
2984     "dashes": false,
2985     "datasource": {
2986       "type": "prometheus",
2987       "uid": "${DS_THANOS}"
2988     },
2989     "description": "The average rate of getMores performed per second on any cursor over the selected sample period. On a primary, this number can be high even if the query count is low as the secondaries \"getMore\" from the primary often as part of replication.",
2990     "fieldConfig": {
2991       "defaults": {
2992         "links": [],
2993         "unit": "/s"
2994       },
2995       "overrides": []
2996     },
2997     "fill": 1,
2998     "fillGradient": 0,
2999     "gridPos": {
3000       "h": 8,
3001       "w": 8,
3002       "x": 8,
3003       "y": 84
3004     },
3005     "hiddenSeries": false,
3006     "id": 97,
3007     "legend": {
3008       "avg": false,
3009       "current": false,
3010       "max": false,
3011       "min": false,
3012       "show": true,
3013       "total": false,
3014       "values": false
3015     },
3016     "lines": true,
3017     "linewidth": 1,
3018     "nullPointMode": "null",
3019     "options": {
3020       "alertThreshold": true,
3021       "legend": {
3022         "calcs": [],
3023         "displayMode": "list",
3024         "placement": "bottom"
3025       },
3026       "tooltip": {
3027         "mode": "single"
3028       }
3029     },
3030     "percentage": false,
3031     "pluginVersion": "8.5.6",
3032     "pointradius": 2,
3033     "points": false,
3034     "renderer": "flot",
3035     "seriesOverrides": [],
3036     "spaceLength": 10,
3037     "stack": false,
3038     "steppedLine": false,
3039     "targets": [
3040       {
3041         "exemplar": true,
3042         "expr": "label_replace(sum(irate(mongodb_opcounters_getmore{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3043         "interval": "",
3044         "legendFormat": "{{hostname}}:{{process_port}}",
3045         "refId": "A",
3046         "datasource": {
3047           "type": "prometheus",
3048           "uid": "${DS_THANOS}"
3049         }
3050       }
3051     ],
3052     "thresholds": [],
3053     "timeRegions": [],
3054     "title": "Opcounters - Getmore",
3055     "tooltip": {
3056       "shared": true,
3057       "sort": 0,
3058       "value_type": "individual"
3059     },
3060     "type": "graph",
3061     "xaxis": {
3062       "mode": "time",
3063       "show": true,
3064       "values": []
3065     },
3066     "yaxes": [
3067       {
3068         "format": "/s",
3069         "logBase": 1,
3070         "show": true
3071       },
3072       {
3073         "format": "short",
3074         "logBase": 1,
3075         "show": true
3076       }
3077     ],
3078     "yaxis": {
3079       "align": false
3080     }
3081   },
3082   {
3083     "aliasColors": {},
3084     "bars": false,
3085     "dashLength": 10,
3086     "dashes": false,
3087     "datasource": {
3088       "type": "prometheus",
3089       "uid": "${DS_THANOS}"
3090     },
3091     "description": "The average rate of inserts performed per second over the selected sample period",
3092     "fieldConfig": {
3093       "defaults": {
3094         "links": [],
3095         "unit": "/s"
3096       },
3097       "overrides": []
3098     },
3099     "fill": 1,
3100     "fillGradient": 0,
3101     "gridPos": {
3102       "h": 8,
3103       "w": 8,
3104       "x": 16,
3105       "y": 84
3106     },
3107     "hiddenSeries": false,
3108     "id": 98,
3109     "legend": {
3110       "avg": false,
3111       "current": false,
3112       "max": false,
3113       "min": false,
3114       "show": true,
3115       "total": false,
3116       "values": false
3117     },
3118     "lines": true,
3119     "linewidth": 1,
3120     "nullPointMode": "null",
3121     "options": {
3122       "alertThreshold": true,
3123       "legend": {
3124         "calcs": [],
3125         "displayMode": "list",
3126         "placement": "bottom"
3127       },
3128       "tooltip": {
3129         "mode": "single"
3130       }
3131     },
3132     "percentage": false,
3133     "pluginVersion": "8.5.6",
3134     "pointradius": 2,
3135     "points": false,
3136     "renderer": "flot",
3137     "seriesOverrides": [],
3138     "spaceLength": 10,
3139     "stack": false,
3140     "steppedLine": false,
3141     "targets": [
3142       {
3143         "exemplar": true,
3144         "expr": "label_replace(sum(irate(mongodb_opcounters_insert{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3145         "interval": "",
3146         "legendFormat": "{{hostname}}:{{process_port}}",
3147         "refId": "A",
3148         "datasource": {
3149           "type": "prometheus",
3150           "uid": "${DS_THANOS}"
3151         }
3152       }
3153     ],
3154     "thresholds": [],
3155     "timeRegions": [],
3156     "title": "Opcounters - Insert",
3157     "tooltip": {
3158       "shared": true,
3159       "sort": 0,
3160       "value_type": "individual"
3161     },
3162     "type": "graph",
3163     "xaxis": {
3164       "mode": "time",
3165       "show": true,
3166       "values": []
3167     },
3168     "yaxes": [
3169       {
3170         "format": "/s",
3171         "logBase": 1,
3172         "show": true
3173       },
3174       {
3175         "format": "short",
3176         "logBase": 1,
3177         "show": true
3178       }
3179     ],
3180     "yaxis": {
3181       "align": false
3182     }
3183   },
3184   {
3185     "collapsed": false,
3186     "datasource": {
3187       "type": "prometheus",
3188       "uid": "000000010"
3189     },
3190     "gridPos": {
3191       "h": 1,
3192       "w": 24,
3193       "x": 0,
3194       "y": 92
3195     },
3196     "id": 95,
3197     "panels": [],
3198     "title": "Operation Execution Times",
3199     "type": "row"
3200   },
3201   {
3202     "aliasColors": {},
3203     "bars": false,
3204     "dashLength": 10,
3205     "dashes": false,
3206     "datasource": {
3207       "type": "prometheus",
3208       "uid": "${DS_THANOS}"
3209     },
3210     "description": "The average execution time in milliseconds per read operation over the selected sample period.",
3211     "fieldConfig": {
3212       "defaults": {
3213         "links": [],
3214         "unit": "µs"
3215       },
3216       "overrides": []
3217     },
3218     "fill": 1,
3219     "fillGradient": 0,
3220     "gridPos": {
3221       "h": 8,
3222       "w": 8,
3223       "x": 0,
3224       "y": 93
3225     },
3226     "hiddenSeries": false,
3227     "id": 102,
3228     "legend": {
3229       "avg": false,
3230       "current": false,
3231       "max": false,
3232       "min": false,
3233       "show": true,
3234       "total": false,
3235       "values": false
3236     },
3237     "lines": true,
3238     "linewidth": 1,
3239     "nullPointMode": "null",
3240     "options": {
3241       "alertThreshold": true,
3242       "legend": {
3243         "calcs": [],
3244         "displayMode": "list",
3245         "placement": "bottom"
3246       },
3247       "tooltip": {
3248         "mode": "single"
3249       }
3250     },
3251     "percentage": false,
3252     "pluginVersion": "8.5.6",
3253     "pointradius": 2,
3254     "points": false,
3255     "renderer": "flot",
3256     "seriesOverrides": [],
3257     "spaceLength": 10,
3258     "stack": false,
3259     "steppedLine": false,
3260     "targets": [
3261       {
3262         "exemplar": true,
3263         "expr": "label_replace(sum(irate(mongodb_opLatencies_reads_latency{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])/irate(mongodb_opLatencies_reads_ops{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3264         "interval": "",
3265         "legendFormat": "{{hostname}}:{{process_port}}",
3266         "refId": "A",
3267         "datasource": {
3268           "type": "prometheus",
3269           "uid": "${DS_THANOS}"
3270         }
3271       }
3272     ],
3273     "thresholds": [],
3274     "timeRegions": [],
3275     "title": "Operation Execution Times - Avg Ms/Read",
3276     "tooltip": {
3277       "shared": true,
3278       "sort": 0,
3279       "value_type": "individual"
3280     },
3281     "type": "graph",
3282     "xaxis": {
3283       "mode": "time",
3284       "show": true,
3285       "values": []
3286     },
3287     "yaxes": [
3288       {
3289         "format": "µs",
3290         "logBase": 1,
3291         "show": true
3292       },
3293       {
3294         "format": "short",
3295         "logBase": 1,
3296         "show": true
3297       }
3298     ],
3299     "yaxis": {
3300       "align": false
3301     }
3302   },
3303   {
3304     "aliasColors": {},
3305     "bars": false,
3306     "dashLength": 10,
3307     "dashes": false,
3308     "datasource": {
3309       "type": "prometheus",
3310       "uid": "${DS_THANOS}"
3311     },
3312     "description": "The average execution time in milliseconds per write operation over the selected sample period.",
3313     "fieldConfig": {
3314       "defaults": {
3315         "links": [],
3316         "unit": "µs"
3317       },
3318       "overrides": []
3319     },
3320     "fill": 1,
3321     "fillGradient": 0,
3322     "gridPos": {
3323       "h": 8,
3324       "w": 8,
3325       "x": 8,
3326       "y": 93
3327     },
3328     "hiddenSeries": false,
3329     "id": 104,
3330     "legend": {
3331       "avg": false,
3332       "current": false,
3333       "max": false,
3334       "min": false,
3335       "show": true,
3336       "total": false,
3337       "values": false
3338     },
3339     "lines": true,
3340     "linewidth": 1,
3341     "nullPointMode": "null",
3342     "options": {
3343       "alertThreshold": true,
3344       "legend": {
3345         "calcs": [],
3346         "displayMode": "list",
3347         "placement": "bottom"
3348       },
3349       "tooltip": {
3350         "mode": "single"
3351       }
3352     },
3353     "percentage": false,
3354     "pluginVersion": "8.5.6",
3355     "pointradius": 2,
3356     "points": false,
3357     "renderer": "flot",
3358     "seriesOverrides": [],
3359     "spaceLength": 10,
3360     "stack": false,
3361     "steppedLine": false,
3362     "targets": [
3363       {
3364         "exemplar": true,
3365         "expr": "label_replace(sum(irate(mongodb_opLatencies_writes_latency{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])/irate(mongodb_opLatencies_writes_ops{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3366         "interval": "",
3367         "legendFormat": "{{hostname}}:{{process_port}}",
3368         "refId": "A",
3369         "datasource": {
3370           "type": "prometheus",
3371           "uid": "${DS_THANOS}"
3372         }
3373       }
3374     ],
3375     "thresholds": [],
3376     "timeRegions": [],
3377     "title": "Operation Execution Times - Avg Ms/Write",
3378     "tooltip": {
3379       "shared": true,
3380       "sort": 0,
3381       "value_type": "individual"
3382     },
3383     "type": "graph",
3384     "xaxis": {
3385       "mode": "time",
3386       "show": true,
3387       "values": []
3388     },
3389     "yaxes": [
3390       {
3391         "format": "µs",
3392         "logBase": 1,
3393         "show": true
3394       },
3395       {
3396         "format": "short",
3397         "logBase": 1,
3398         "show": true
3399       }
3400     ],
3401     "yaxis": {
3402       "align": false
3403     }
3404   },
3405   {
3406     "aliasColors": {},
3407     "bars": false,
3408     "dashLength": 10,
3409     "dashes": false,
3410     "datasource": {
3411       "type": "prometheus",
3412       "uid": "${DS_THANOS}"
3413     },
3414     "description": "The average execution time in milliseconds per command operation over the selected sample period.",
3415     "fieldConfig": {
3416       "defaults": {
3417         "links": [],
3418         "unit": "µs"
3419       },
3420       "overrides": []
3421     },
3422     "fill": 1,
3423     "fillGradient": 0,
3424     "gridPos": {
3425       "h": 8,
3426       "w": 8,
3427       "x": 16,
3428       "y": 93
3429     },
3430     "hiddenSeries": false,
3431     "id": 103,
3432     "legend": {
3433       "avg": false,
3434       "current": false,
3435       "max": false,
3436       "min": false,
3437       "show": true,
3438       "total": false,
3439       "values": false
3440     },
3441     "lines": true,
3442     "linewidth": 1,
3443     "nullPointMode": "null",
3444     "options": {
3445       "alertThreshold": true,
3446       "legend": {
3447         "calcs": [],
3448         "displayMode": "list",
3449         "placement": "bottom"
3450       },
3451       "tooltip": {
3452         "mode": "single"
3453       }
3454     },
3455     "percentage": false,
3456     "pluginVersion": "8.5.6",
3457     "pointradius": 2,
3458     "points": false,
3459     "renderer": "flot",
3460     "seriesOverrides": [],
3461     "spaceLength": 10,
3462     "stack": false,
3463     "steppedLine": false,
3464     "targets": [
3465       {
3466         "exemplar": true,
3467         "expr": "label_replace(sum(irate(mongodb_opLatencies_commands_latency{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])/irate(mongodb_opLatencies_commands_ops{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3468         "interval": "",
3469         "legendFormat": "{{hostname}}:{{process_port}}",
3470         "refId": "A",
3471         "datasource": {
3472           "type": "prometheus",
3473           "uid": "${DS_THANOS}"
3474         }
3475       }
3476     ],
3477     "thresholds": [],
3478     "timeRegions": [],
3479     "title": "Operation Execution Times - Avg Ms/Command",
3480     "tooltip": {
3481       "shared": true,
3482       "sort": 0,
3483       "value_type": "individual"
3484     },
3485     "type": "graph",
3486     "xaxis": {
3487       "mode": "time",
3488       "show": true,
3489       "values": []
3490     },
3491     "yaxes": [
3492       {
3493         "format": "µs",
3494         "logBase": 1,
3495         "show": true
3496       },
3497       {
3498         "format": "short",
3499         "logBase": 1,
3500         "show": true
3501       }
3502     ],
3503     "yaxis": {
3504       "align": false
3505     }
3506   },
3507   {
3508     "collapsed": false,
3509     "datasource": {
3510       "type": "prometheus",
3511       "uid": "000000010"
3512     },
3513     "gridPos": {
3514       "h": 1,
3515       "w": 24,
3516       "x": 0,
3517       "y": 101
3518     },
3519     "id": 106,
3520     "panels": [],
3521     "title": "Page Faults",
3522     "type": "row"
3523   },
3524   {
3525     "aliasColors": {},
3526     "bars": false,
3527     "dashLength": 10,
3528     "dashes": false,
3529     "datasource": {
3530       "type": "prometheus",
3531       "uid": "${DS_THANOS}"
3532     },
3533     "description": "The average rate of page faults on this process per second over the selected sample period. In non-Windows environments this is hard page faults only.",
3534     "fieldConfig": {
3535       "defaults": {
3536         "links": [],
3537         "unit": "/s"
3538       },
3539       "overrides": []
3540     },
3541     "fill": 1,
3542     "fillGradient": 0,
3543     "gridPos": {
3544       "h": 8,
3545       "w": 24,
3546       "x": 0,
3547       "y": 102
3548     },
3549     "hiddenSeries": false,
3550     "id": 107,
3551     "legend": {
3552       "avg": false,
3553       "current": false,
3554       "max": false,
3555       "min": false,
3556       "show": true,
3557       "total": false,
3558       "values": false
3559     },
3560     "lines": true,
3561     "linewidth": 1,
3562     "nullPointMode": "null",
3563     "options": {
3564       "alertThreshold": true,
3565       "legend": {
3566         "calcs": [],
3567         "displayMode": "list",
3568         "placement": "bottom"
3569       },
3570       "tooltip": {
3571         "mode": "single"
3572       }
3573     },
3574     "percentage": false,
3575     "pluginVersion": "8.5.6",
3576     "pointradius": 2,
3577     "points": false,
3578     "renderer": "flot",
3579     "seriesOverrides": [],
3580     "spaceLength": 10,
3581     "stack": false,
3582     "steppedLine": false,
3583     "targets": [
3584       {
3585         "exemplar": true,
3586         "expr": "label_replace(sum(irate(mongodb_extra_info_page_faults{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3587         "interval": "",
3588         "legendFormat": "{{hostname}}:{{process_port}}",
3589         "refId": "A",
3590         "datasource": {
3591           "type": "prometheus",
3592           "uid": "${DS_THANOS}"
3593         }
3594       }
3595     ],
3596     "thresholds": [],
3597     "timeRegions": [],
3598     "title": "Page Faults",
3599     "tooltip": {
3600       "shared": true,
3601       "sort": 0,
3602       "value_type": "individual"
3603     },
3604     "type": "graph",
3605     "xaxis": {
3606       "mode": "time",
3607       "show": true,
3608       "values": []
3609     },
3610     "yaxes": [
3611       {
3612         "format": "/s",
3613         "logBase": 1,
3614         "show": true
3615       },
3616       {
3617         "format": "short",
3618         "logBase": 1,
3619         "show": true
3620       }
3621     ],
3622     "yaxis": {
3623       "align": false
3624     }
3625   },
3626   {
3627     "collapsed": false,
3628     "datasource": {
3629       "type": "prometheus",
3630       "uid": "000000010"
3631     },
3632     "gridPos": {
3633       "h": 1,
3634       "w": 24,
3635       "x": 0,
3636       "y": 110
3637     },
3638     "id": 111,
3639     "panels": [],
3640     "title": "Query Executor",
3641     "type": "row"
3642   },
3643   {
3644     "aliasColors": {},
3645     "bars": false,
3646     "dashLength": 10,
3647     "dashes": false,
3648     "datasource": {
3649       "type": "prometheus",
3650       "uid": "${DS_THANOS}"
3651     },
3652     "description": "The average rate per second over the selected sample period of index items scanned during queries and query-plan evaluation. This rate is driven by the same value as totalKeysExamined in the output of explain().",
3653     "fieldConfig": {
3654       "defaults": {
3655         "links": [],
3656         "unit": "/s"
3657       },
3658       "overrides": []
3659     },
3660     "fill": 1,
3661     "fillGradient": 0,
3662     "gridPos": {
3663       "h": 8,
3664       "w": 12,
3665       "x": 0,
3666       "y": 111
3667     },
3668     "hiddenSeries": false,
3669     "id": 108,
3670     "legend": {
3671       "avg": false,
3672       "current": false,
3673       "max": false,
3674       "min": false,
3675       "show": true,
3676       "total": false,
3677       "values": false
3678     },
3679     "lines": true,
3680     "linewidth": 1,
3681     "nullPointMode": "null",
3682     "options": {
3683       "alertThreshold": true,
3684       "legend": {
3685         "calcs": [],
3686         "displayMode": "list",
3687         "placement": "bottom"
3688       },
3689       "tooltip": {
3690         "mode": "single"
3691       }
3692     },
3693     "percentage": false,
3694     "pluginVersion": "8.5.6",
3695     "pointradius": 2,
3696     "points": false,
3697     "renderer": "flot",
3698     "seriesOverrides": [],
3699     "spaceLength": 10,
3700     "stack": false,
3701     "steppedLine": false,
3702     "targets": [
3703       {
3704         "exemplar": true,
3705         "expr": "label_replace(sum(irate(mongodb_metrics_queryExecutor_scanned{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3706         "interval": "",
3707         "legendFormat": "{{hostname}}:{{process_port}}",
3708         "refId": "A",
3709         "datasource": {
3710           "type": "prometheus",
3711           "uid": "${DS_THANOS}"
3712         }
3713       }
3714     ],
3715     "thresholds": [],
3716     "timeRegions": [],
3717     "title": "Query Executor - Scanned",
3718     "tooltip": {
3719       "shared": true,
3720       "sort": 0,
3721       "value_type": "individual"
3722     },
3723     "type": "graph",
3724     "xaxis": {
3725       "mode": "time",
3726       "show": true,
3727       "values": []
3728     },
3729     "yaxes": [
3730       {
3731         "format": "/s",
3732         "logBase": 1,
3733         "show": true
3734       },
3735       {
3736         "format": "short",
3737         "logBase": 1,
3738         "show": true
3739       }
3740     ],
3741     "yaxis": {
3742       "align": false
3743     }
3744   },
3745   {
3746     "aliasColors": {},
3747     "bars": false,
3748     "dashLength": 10,
3749     "dashes": false,
3750     "datasource": {
3751       "type": "prometheus",
3752       "uid": "${DS_THANOS}"
3753     },
3754     "description": "The average rate per second over the selected sample period of documents scanned during queries and query-plan evaluation. This rate is driven by the same value as totalDocsExamined in the output of explain().",
3755     "fieldConfig": {
3756       "defaults": {
3757         "links": [],
3758         "unit": "/s"
3759       },
3760       "overrides": []
3761     },
3762     "fill": 1,
3763     "fillGradient": 0,
3764     "gridPos": {
3765       "h": 8,
3766       "w": 12,
3767       "x": 12,
3768       "y": 111
3769     },
3770     "hiddenSeries": false,
3771     "id": 109,
3772     "legend": {
3773       "avg": false,
3774       "current": false,
3775       "max": false,
3776       "min": false,
3777       "show": true,
3778       "total": false,
3779       "values": false
3780     },
3781     "lines": true,
3782     "linewidth": 1,
3783     "nullPointMode": "null",
3784     "options": {
3785       "alertThreshold": true,
3786       "legend": {
3787         "calcs": [],
3788         "displayMode": "list",
3789         "placement": "bottom"
3790       },
3791       "tooltip": {
3792         "mode": "single"
3793       }
3794     },
3795     "percentage": false,
3796     "pluginVersion": "8.5.6",
3797     "pointradius": 2,
3798     "points": false,
3799     "renderer": "flot",
3800     "seriesOverrides": [],
3801     "spaceLength": 10,
3802     "stack": false,
3803     "steppedLine": false,
3804     "targets": [
3805       {
3806         "exemplar": true,
3807         "expr": "label_replace(sum(irate(mongodb_metrics_queryExecutor_scannedObjects{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3808         "interval": "",
3809         "legendFormat": "{{hostname}}:{{process_port}}",
3810         "refId": "A",
3811         "datasource": {
3812           "type": "prometheus",
3813           "uid": "${DS_THANOS}"
3814         }
3815       }
3816     ],
3817     "thresholds": [],
3818     "timeRegions": [],
3819     "title": "Query Executor - Scanned Objects",
3820     "tooltip": {
3821       "shared": true,
3822       "sort": 0,
3823       "value_type": "individual"
3824     },
3825     "type": "graph",
3826     "xaxis": {
3827       "mode": "time",
3828       "show": true,
3829       "values": []
3830     },
3831     "yaxes": [
3832       {
3833         "format": "/s",
3834         "logBase": 1,
3835         "show": true
3836       },
3837       {
3838         "format": "short",
3839         "logBase": 1,
3840         "show": true
3841       }
3842     ],
3843     "yaxis": {
3844       "align": false
3845     }
3846   },
3847   {
3848     "collapsed": false,
3849     "datasource": {
3850       "type": "prometheus",
3851       "uid": "000000010"
3852     },
3853     "gridPos": {
3854       "h": 1,
3855       "w": 24,
3856       "x": 0,
3857       "y": 119
3858     },
3859     "id": 113,
3860     "panels": [],
3861     "title": "Queues",
3862     "type": "row"
3863   },
3864   {
3865     "aliasColors": {},
3866     "bars": false,
3867     "dashLength": 10,
3868     "dashes": false,
3869     "datasource": {
3870       "type": "prometheus",
3871       "uid": "${DS_THANOS}"
3872     },
3873     "description": "The number of operations queued waiting for any lock",
3874     "fieldConfig": {
3875       "defaults": {
3876         "links": [],
3877         "unit": "none"
3878       },
3879       "overrides": []
3880     },
3881     "fill": 1,
3882     "fillGradient": 0,
3883     "gridPos": {
3884       "h": 8,
3885       "w": 8,
3886       "x": 0,
3887       "y": 120
3888     },
3889     "hiddenSeries": false,
3890     "id": 114,
3891     "legend": {
3892       "avg": false,
3893       "current": false,
3894       "max": false,
3895       "min": false,
3896       "show": true,
3897       "total": false,
3898       "values": false
3899     },
3900     "lines": true,
3901     "linewidth": 1,
3902     "nullPointMode": "null",
3903     "options": {
3904       "alertThreshold": true,
3905       "legend": {
3906         "calcs": [],
3907         "displayMode": "list",
3908         "placement": "bottom"
3909       },
3910       "tooltip": {
3911         "mode": "single"
3912       }
3913     },
3914     "percentage": false,
3915     "pluginVersion": "8.5.6",
3916     "pointradius": 2,
3917     "points": false,
3918     "renderer": "flot",
3919     "seriesOverrides": [],
3920     "spaceLength": 10,
3921     "stack": false,
3922     "steppedLine": false,
3923     "targets": [
3924       {
3925         "exemplar": true,
3926         "expr": "label_replace(sum(mongodb_globalLock_currentQueue_total{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
3927         "interval": "",
3928         "legendFormat": "{{hostname}}:{{process_port}}",
3929         "refId": "A",
3930         "datasource": {
3931           "type": "prometheus",
3932           "uid": "${DS_THANOS}"
3933         }
3934       }
3935     ],
3936     "thresholds": [],
3937     "timeRegions": [],
3938     "title": "Queues - Total",
3939     "tooltip": {
3940       "shared": true,
3941       "sort": 0,
3942       "value_type": "individual"
3943     },
3944     "type": "graph",
3945     "xaxis": {
3946       "mode": "time",
3947       "show": true,
3948       "values": []
3949     },
3950     "yaxes": [
3951       {
3952         "format": "none",
3953         "logBase": 1,
3954         "show": true
3955       },
3956       {
3957         "format": "short",
3958         "logBase": 1,
3959         "show": true
3960       }
3961     ],
3962     "yaxis": {
3963       "align": false
3964     }
3965   },
3966   {
3967     "aliasColors": {},
3968     "bars": false,
3969     "dashLength": 10,
3970     "dashes": false,
3971     "datasource": {
3972       "type": "prometheus",
3973       "uid": "${DS_THANOS}"
3974     },
3975     "description": "The number of operations queued waiting for a read lock",
3976     "fieldConfig": {
3977       "defaults": {
3978         "links": [],
3979         "unit": "none"
3980       },
3981       "overrides": []
3982     },
3983     "fill": 1,
3984     "fillGradient": 0,
3985     "gridPos": {
3986       "h": 8,
3987       "w": 8,
3988       "x": 8,
3989       "y": 120
3990     },
3991     "hiddenSeries": false,
3992     "id": 115,
3993     "legend": {
3994       "avg": false,
3995       "current": false,
3996       "max": false,
3997       "min": false,
3998       "show": true,
3999       "total": false,
4000       "values": false
4001     },
4002     "lines": true,
4003     "linewidth": 1,
4004     "nullPointMode": "null",
4005     "options": {
4006       "alertThreshold": true,
4007       "legend": {
4008         "calcs": [],
4009         "displayMode": "list",
4010         "placement": "bottom"
4011       },
4012       "tooltip": {
4013         "mode": "single"
4014       }
4015     },
4016     "percentage": false,
4017     "pluginVersion": "8.5.6",
4018     "pointradius": 2,
4019     "points": false,
4020     "renderer": "flot",
4021     "seriesOverrides": [],
4022     "spaceLength": 10,
4023     "stack": false,
4024     "steppedLine": false,
4025     "targets": [
4026       {
4027         "exemplar": true,
4028         "expr": "label_replace(sum(mongodb_globalLock_currentQueue_readers{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
4029         "interval": "",
4030         "legendFormat": "{{hostname}}:{{process_port}}",
4031         "refId": "A",
4032         "datasource": {
4033           "type": "prometheus",
4034           "uid": "${DS_THANOS}"
4035         }
4036       }
4037     ],
4038     "thresholds": [],
4039     "timeRegions": [],
4040     "title": "Queues - Readers",
4041     "tooltip": {
4042       "shared": true,
4043       "sort": 0,
4044       "value_type": "individual"
4045     },
4046     "type": "graph",
4047     "xaxis": {
4048       "mode": "time",
4049       "show": true,
4050       "values": []
4051     },
4052     "yaxes": [
4053       {
4054         "format": "none",
4055         "logBase": 1,
4056         "show": true
4057       },
4058       {
4059         "format": "short",
4060         "logBase": 1,
4061         "show": true
4062       }
4063     ],
4064     "yaxis": {
4065       "align": false
4066     }
4067   },
4068   {
4069     "aliasColors": {},
4070     "bars": false,
4071     "dashLength": 10,
4072     "dashes": false,
4073     "datasource": {
4074       "type": "prometheus",
4075       "uid": "${DS_THANOS}"
4076     },
4077     "description": "The number of operations queued waiting for a write lock",
4078     "fieldConfig": {
4079       "defaults": {
4080         "links": [],
4081         "unit": "none"
4082       },
4083       "overrides": []
4084     },
4085     "fill": 1,
4086     "fillGradient": 0,
4087     "gridPos": {
4088       "h": 8,
4089       "w": 8,
4090       "x": 16,
4091       "y": 120
4092     },
4093     "hiddenSeries": false,
4094     "id": 116,
4095     "legend": {
4096       "avg": false,
4097       "current": false,
4098       "max": false,
4099       "min": false,
4100       "show": true,
4101       "total": false,
4102       "values": false
4103     },
4104     "lines": true,
4105     "linewidth": 1,
4106     "nullPointMode": "null",
4107     "options": {
4108       "alertThreshold": true,
4109       "legend": {
4110         "calcs": [],
4111         "displayMode": "list",
4112         "placement": "bottom"
4113       },
4114       "tooltip": {
4115         "mode": "single"
4116       }
4117     },
4118     "percentage": false,
4119     "pluginVersion": "8.5.6",
4120     "pointradius": 2,
4121     "points": false,
4122     "renderer": "flot",
4123     "seriesOverrides": [],
4124     "spaceLength": 10,
4125     "stack": false,
4126     "steppedLine": false,
4127     "targets": [
4128       {
4129         "exemplar": true,
4130         "expr": "label_replace(sum(mongodb_globalLock_currentQueue_writers{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
4131         "interval": "",
4132         "legendFormat": "{{hostname}}:{{process_port}}",
4133         "refId": "A",
4134         "datasource": {
4135           "type": "prometheus",
4136           "uid": "${DS_THANOS}"
4137         }
4138       }
4139     ],
4140     "thresholds": [],
4141     "timeRegions": [],
4142     "title": "Queues - Writers",
4143     "tooltip": {
4144       "shared": true,
4145       "sort": 0,
4146       "value_type": "individual"
4147     },
4148     "type": "graph",
4149     "xaxis": {
4150       "mode": "time",
4151       "show": true,
4152       "values": []
4153     },
4154     "yaxes": [
4155       {
4156         "format": "none",
4157         "logBase": 1,
4158         "show": true
4159       },
4160       {
4161         "format": "short",
4162         "logBase": 1,
4163         "show": true
4164       }
4165     ],
4166     "yaxis": {
4167       "align": false
4168     }
4169   },
4170   {
4171     "collapsed": false,
4172     "datasource": {
4173       "type": "prometheus",
4174       "uid": "000000010"
4175     },
4176     "gridPos": {
4177       "h": 1,
4178       "w": 24,
4179       "x": 0,
4180       "y": 128
4181     },
4182     "id": 118,
4183     "panels": [],
4184     "title": "Scan and Order",
4185     "type": "row"
4186   },
4187   {
4188     "aliasColors": {},
4189     "bars": false,
4190     "dashLength": 10,
4191     "dashes": false,
4192     "datasource": {
4193       "type": "prometheus",
4194       "uid": "${DS_THANOS}"
4195     },
4196     "description": "The average rate per second over the selected sample period of queries that return sorted results that cannot perform the sort operation using an index.",
4197     "fieldConfig": {
4198       "defaults": {
4199         "links": [],
4200         "unit": "/s"
4201       },
4202       "overrides": []
4203     },
4204     "fill": 1,
4205     "fillGradient": 0,
4206     "gridPos": {
4207       "h": 8,
4208       "w": 24,
4209       "x": 0,
4210       "y": 129
4211     },
4212     "hiddenSeries": false,
4213     "id": 119,
4214     "legend": {
4215       "avg": false,
4216       "current": false,
4217       "max": false,
4218       "min": false,
4219       "show": true,
4220       "total": false,
4221       "values": false
4222     },
4223     "lines": true,
4224     "linewidth": 1,
4225     "nullPointMode": "null",
4226     "options": {
4227       "alertThreshold": true,
4228       "legend": {
4229         "calcs": [],
4230         "displayMode": "list",
4231         "placement": "bottom"
4232       },
4233       "tooltip": {
4234         "mode": "single"
4235       }
4236     },
4237     "percentage": false,
4238     "pluginVersion": "8.5.6",
4239     "pointradius": 2,
4240     "points": false,
4241     "renderer": "flot",
4242     "seriesOverrides": [],
4243     "spaceLength": 10,
4244     "stack": false,
4245     "steppedLine": false,
4246     "targets": [
4247       {
4248         "exemplar": true,
4249         "expr": "label_replace(sum(irate(mongodb_metrics_operation_scanAndOrder{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}[$Interval])) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
4250         "interval": "",
4251         "legendFormat": "{{hostname}}:{{process_port}}",
4252         "refId": "A",
4253         "datasource": {
4254           "type": "prometheus",
4255           "uid": "${DS_THANOS}"
4256         }
4257       }
4258     ],
4259     "thresholds": [],
4260     "timeRegions": [],
4261     "title": "Scan and Order",
4262     "tooltip": {
4263       "shared": true,
4264       "sort": 0,
4265       "value_type": "individual"
4266     },
4267     "type": "graph",
4268     "xaxis": {
4269       "mode": "time",
4270       "show": true,
4271       "values": []
4272     },
4273     "yaxes": [
4274       {
4275         "format": "/s",
4276         "logBase": 1,
4277         "show": true
4278       },
4279       {
4280         "format": "short",
4281         "logBase": 1,
4282         "show": true
4283       }
4284     ],
4285     "yaxis": {
4286       "align": false
4287     }
4288   },
4289   {
4290     "collapsed": false,
4291     "datasource": {
4292       "type": "prometheus",
4293       "uid": "000000010"
4294     },
4295     "gridPos": {
4296       "h": 1,
4297       "w": 24,
4298       "x": 0,
4299       "y": 137
4300     },
4301     "id": 123,
4302     "panels": [],
4303     "title": "Tickets Available",
4304     "type": "row"
4305   },
4306   {
4307     "aliasColors": {},
4308     "bars": false,
4309     "dashLength": 10,
4310     "dashes": false,
4311     "datasource": {
4312       "type": "prometheus",
4313       "uid": "${DS_THANOS}"
4314     },
4315     "description": "The number of read tickets available to the WiredTiger storage engine. Read tickets represent the number of concurrent read operations allowed into the storage engine. When this value reaches zero new read requests may queue until a read ticket becomes available.",
4316     "fieldConfig": {
4317       "defaults": {
4318         "links": [],
4319         "unit": "none"
4320       },
4321       "overrides": []
4322     },
4323     "fill": 1,
4324     "fillGradient": 0,
4325     "gridPos": {
4326       "h": 8,
4327       "w": 12,
4328       "x": 0,
4329       "y": 138
4330     },
4331     "hiddenSeries": false,
4332     "id": 120,
4333     "legend": {
4334       "avg": false,
4335       "current": false,
4336       "max": false,
4337       "min": false,
4338       "show": true,
4339       "total": false,
4340       "values": false
4341     },
4342     "lines": true,
4343     "linewidth": 1,
4344     "nullPointMode": "null",
4345     "options": {
4346       "alertThreshold": true,
4347       "legend": {
4348         "calcs": [],
4349         "displayMode": "list",
4350         "placement": "bottom"
4351       },
4352       "tooltip": {
4353         "mode": "single"
4354       }
4355     },
4356     "percentage": false,
4357     "pluginVersion": "8.5.6",
4358     "pointradius": 2,
4359     "points": false,
4360     "renderer": "flot",
4361     "seriesOverrides": [],
4362     "spaceLength": 10,
4363     "stack": false,
4364     "steppedLine": false,
4365     "targets": [
4366       {
4367         "exemplar": true,
4368         "expr": "label_replace(sum(mongodb_wiredTiger_concurrentTransactions_read_available{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
4369         "interval": "",
4370         "legendFormat": "{{hostname}}:{{process_port}}",
4371         "refId": "A",
4372         "datasource": {
4373           "type": "prometheus",
4374           "uid": "${DS_THANOS}"
4375         }
4376       }
4377     ],
4378     "thresholds": [],
4379     "timeRegions": [],
4380     "title": "Tickets Available - Reads",
4381     "tooltip": {
4382       "shared": true,
4383       "sort": 0,
4384       "value_type": "individual"
4385     },
4386     "type": "graph",
4387     "xaxis": {
4388       "mode": "time",
4389       "show": true,
4390       "values": []
4391     },
4392     "yaxes": [
4393       {
4394         "format": "none",
4395         "logBase": 1,
4396         "show": true
4397       },
4398       {
4399         "format": "short",
4400         "logBase": 1,
4401         "show": true
4402       }
4403     ],
4404     "yaxis": {
4405       "align": false
4406     }
4407   },
4408   {
4409     "aliasColors": {},
4410     "bars": false,
4411     "dashLength": 10,
4412     "dashes": false,
4413     "datasource": {
4414       "type": "prometheus",
4415       "uid": "${DS_THANOS}"
4416     },
4417     "description": "The number of write tickets available to the WiredTiger storage engine. Write tickets represent the number of concurrent write operations allowed into the storage engine. When this value reaches zero new write requests may queue until a write ticket becomes available.",
4418     "fieldConfig": {
4419       "defaults": {
4420         "links": [],
4421         "unit": "none"
4422       },
4423       "overrides": []
4424     },
4425     "fill": 1,
4426     "fillGradient": 0,
4427     "gridPos": {
4428       "h": 8,
4429       "w": 12,
4430       "x": 12,
4431       "y": 138
4432     },
4433     "hiddenSeries": false,
4434     "id": 121,
4435     "legend": {
4436       "avg": false,
4437       "current": false,
4438       "max": false,
4439       "min": false,
4440       "show": true,
4441       "total": false,
4442       "values": false
4443     },
4444     "lines": true,
4445     "linewidth": 1,
4446     "nullPointMode": "null",
4447     "options": {
4448       "alertThreshold": true,
4449       "legend": {
4450         "calcs": [],
4451         "displayMode": "list",
4452         "placement": "bottom"
4453       },
4454       "tooltip": {
4455         "mode": "single"
4456       }
4457     },
4458     "percentage": false,
4459     "pluginVersion": "8.5.6",
4460     "pointradius": 2,
4461     "points": false,
4462     "renderer": "flot",
4463     "seriesOverrides": [],
4464     "spaceLength": 10,
4465     "stack": false,
4466     "steppedLine": false,
4467     "targets": [
4468       {
4469         "exemplar": true,
4470         "expr": "label_replace(sum(mongodb_wiredTiger_concurrentTransactions_write_available{group_id=~\"$group_id\", cl_name=~\"$cl_name\", rs_nm=~\"$rs_nm\", instance=~\"$host.*\",  process_port=~\"$process_port\"}) by (instance, process_port) , \"hostname\", \"$1\", \"instance\", \"(.*)\")",
4471         "interval": "",
4472         "legendFormat": "{{hostname}}:{{process_port}}",
4473         "refId": "A",
4474         "datasource": {
4475           "type": "prometheus",
4476           "uid": "${DS_THANOS}"
4477         }
4478       }
4479     ],
4480     "thresholds": [],
4481     "timeRegions": [],
4482     "title": "Tickets Available - Writes",
4483     "tooltip": {
4484       "shared": true,
4485       "sort": 0,
4486       "value_type": "individual"
4487     },
4488     "type": "graph",
4489     "xaxis": {
4490       "mode": "time",
4491       "show": true,
4492       "values": []
4493     },
4494     "yaxes": [
4495       {
4496         "format": "none",
4497         "logBase": 1,
4498         "show": true
4499       },
4500       {
4501         "format": "short",
4502         "logBase": 1,
4503         "show": true
4504       }
4505     ],
4506     "yaxis": {
4507       "align": false
4508     }
4509   }
4510 ],
4511 "schemaVersion": 36,
4512 "style": "dark",
4513 "tags": [],
4514 "templating": {
4515   "list": [
4516     {
4517       "auto": true,
4518       "auto_count": 30,
4519       "auto_min": "1m",
4520       "current": {
4521         "selected": false,
4522         "text": "1m",
4523         "value": "1m"
4524       },
4525       "hide": 0,
4526       "name": "Interval",
4527       "options": [
4528         {
4529           "selected": false,
4530           "text": "auto",
4531           "value": "$__auto_interval_Interval"
4532         },
4533         {
4534           "selected": false,
4535           "text": "30s",
4536           "value": "30s"
4537         },
4538         {
4539           "selected": true,
4540           "text": "1m",
4541           "value": "1m"
4542         },
4543         {
4544           "selected": false,
4545           "text": "5m",
4546           "value": "5m"
4547         },
4548         {
4549           "selected": false,
4550           "text": "1h",
4551           "value": "1h"
4552         },
4553         {
4554           "selected": false,
4555           "text": "1d",
4556           "value": "1d"
4557         }
4558       ],
4559       "query": "30s,1m,5m,1h,1d",
4560       "queryValue": "",
4561       "refresh": 2,
4562       "skipUrlSync": false,
4563       "type": "interval"
4564     },
4565     {
4566       "current": {
4567         "selected": false,
4568         "text": "thanos",
4569         "value": "thanos"
4570       },
4571       "hide": 0,
4572       "includeAll": false,
4573       "multi": false,
4574       "name": "Datasource",
4575       "options": [],
4576       "query": "prometheus",
4577       "queryValue": "",
4578       "refresh": 1,
4579       "regex": "/thanos.*/",
4580       "skipUrlSync": false,
4581       "type": "datasource"
4582     },
4583     {
4584       "current": {},
4585       "datasource": {
4586         "type": "prometheus",
4587         "uid": "$Datasource"
4588       },
4589       "definition": "label_values(mongodb_up, job)",
4590       "hide": 0,
4591       "includeAll": false,
4592       "multi": false,
4593       "name": "job",
4594       "options": [],
4595       "query": {
4596         "query": "label_values(mongodb_up, job)",
4597         "refId": "thanos-job-Variable-Query"
4598       },
4599       "refresh": 2,
4600       "regex": "",
4601       "skipUrlSync": false,
4602       "sort": 0,
4603       "tagValuesQuery": "",
4604       "tagsQuery": "",
4605       "type": "query",
4606       "useTags": false
4607     },
4608     {
4609       "current": {},
4610       "datasource": {
4611         "type": "prometheus",
4612         "uid": "$Datasource"
4613       },
4614       "definition": "label_values(mongodb_up{job=\"$job\"}, group_id)",
4615       "hide": 0,
4616       "includeAll": false,
4617       "label": "Group Id",
4618       "multi": false,
4619       "name": "group_id",
4620       "options": [],
4621       "query": {
4622         "query": "label_values(mongodb_up{job=\"$job\"}, group_id)",
4623         "refId": "thanos-group_id-Variable-Query"
4624       },
4625       "refresh": 1,
4626       "regex": "",
4627       "skipUrlSync": false,
4628       "sort": 5,
4629       "tagValuesQuery": "",
4630       "tagsQuery": "",
4631       "type": "query",
4632       "useTags": false
4633     },
4634     {
4635       "current": {},
4636       "datasource": {
4637         "type": "prometheus",
4638         "uid": "$Datasource"
4639       },
4640       "definition": "label_values(mongodb_up{group_id='$group_id'}, cl_name)",
4641       "hide": 0,
4642       "includeAll": false,
4643       "label": "Cluster Name",
4644       "multi": false,
4645       "name": "cl_name",
4646       "options": [],
4647       "query": {
4648         "query": "label_values(mongodb_up{group_id='$group_id'}, cl_name)",
4649         "refId": "thanos-cl_name-Variable-Query"
4650       },
4651       "refresh": 2,
4652       "regex": "",
4653       "skipUrlSync": false,
4654       "sort": 5,
4655       "tagValuesQuery": "",
4656       "tagsQuery": "",
4657       "type": "query",
4658       "useTags": false
4659     },
4660     {
4661       "current": {},
4662       "datasource": {
4663         "type": "prometheus",
4664         "uid": "$Datasource"
4665       },
4666       "definition": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name'}, rs_nm)",
4667       "hide": 0,
4668       "includeAll": true,
4669       "label": "ReplicaSet Name",
4670       "multi": true,
4671       "name": "rs_nm",
4672       "options": [],
4673       "query": {
4674         "query": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name'}, rs_nm)",
4675         "refId": "thanos-rs_nm-Variable-Query"
4676       },
4677       "refresh": 1,
4678       "regex": "",
4679       "skipUrlSync": false,
4680       "sort": 5,
4681       "tagValuesQuery": "",
4682       "tagsQuery": "",
4683       "type": "query",
4684       "useTags": false
4685     },
4686     {
4687       "current": {},
4688       "datasource": {
4689         "type": "prometheus",
4690         "uid": "$Datasource"
4691       },
4692       "definition": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name',rs_nm='$rs_nm'},instance)",
4693       "hide": 0,
4694       "includeAll": true,
4695       "label": "Host",
4696       "multi": true,
4697       "name": "host",
4698       "options": [],
4699       "query": {
4700         "query": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name',rs_nm='$rs_nm'},instance)",
4701         "refId": "thanos-host-Variable-Query"
4702       },
4703       "refresh": 2,
4704       "regex": "",
4705       "skipUrlSync": false,
4706       "sort": 5,
4707       "tagValuesQuery": "",
4708       "tagsQuery": "",
4709       "type": "query",
4710       "useTags": false
4711     },
4712     {
4713       "current": {},
4714       "datasource": {
4715         "type": "prometheus",
4716         "uid": "$Datasource"
4717       },
4718       "definition": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name',rs_nm='$rs_nm'},process_port)",
4719       "description": "Only applicable for process level metrics",
4720       "hide": 0,
4721       "includeAll": true,
4722       "label": "Process Port",
4723       "multi": true,
4724       "name": "process_port",
4725       "options": [],
4726       "query": {
4727         "query": "label_values(mongodb_up{group_id='$group_id', cl_name='$cl_name',rs_nm='$rs_nm'},process_port)",
4728         "refId": "thanos-process_port-Variable-Query"
4729       },
4730       "refresh": 1,
4731       "regex": "",
4732       "skipUrlSync": false,
4733       "sort": 5,
4734       "tagValuesQuery": "",
4735       "tagsQuery": "",
4736       "type": "query",
4737       "useTags": false
4738     }
4739   ]
4740 },
4741 "time": {
4742   "from": "now-6h",
4743   "to": "now"
4744 },
4745 "timepicker": {
4746   "refresh_intervals": [
4747     "5s",
4748     "10s",
4749     "30s",
4750     "1m",
4751     "5m",
4752     "15m",
4753     "30m",
4754     "1h",
4755     "2h",
4756     "1d"
4757   ]
4758 },
4759 "timezone": "",
4760 "title": "Dedicated Atlas Clusters - Mongo Metrics",
4761 "uid": "W0lo7Gx7z",
4762 "version": 17,
4763 "weekStart": ""
4764}

hardware-metrics.json

1{
2 "annotations": {
3   "list": [
4     {
5       "builtIn": 1,
6       "datasource": "-- Grafana --",
7       "enable": true,
8       "hide": true,
9       "iconColor": "rgba(0, 211, 255, 1)",
10       "name": "Annotations & Alerts",
11       "target": {
12         "limit": 100,
13         "matchAny": false,
14         "tags": [],
15         "type": "dashboard"
16       },
17       "type": "dashboard"
18     }
19   ]
20 },
21 "description": "",
22 "editable": true,
23 "fiscalYearStartMonth": 0,
24 "gnetId": null,
25 "graphTooltip": 0,
26 "id": 8,
27 "iteration": 1639495636182,
28 "links": [],
29 "liveNow": false,
30 "panels": [
31   {
32     "collapsed": false,
33     "datasource": null,
34     "gridPos": {
35       "h": 1,
36       "w": 24,
37       "x": 0,
38       "y": 0
39     },
40     "id": 10,
41     "panels": [],
42     "title": "Overview",
43     "type": "row"
44   },
45   {
46     "datasource": null,
47     "fieldConfig": {
48       "defaults": {
49         "color": {
50           "mode": "thresholds"
51         },
52         "custom": {
53           "align": "auto",
54           "displayMode": "color-text",
55           "filterable": false
56         },
57         "mappings": [],
58         "thresholds": {
59           "mode": "absolute",
60           "steps": [
61             {
62               "color": "green",
63               "value": null
64             },
65             {
66               "color": "red",
67               "value": 80
68             }
69           ]
70         }
71       },
72       "overrides": [
73         {
74           "matcher": {
75             "id": "byName",
76             "options": "instance"
77           },
78           "properties": [
79             {
80               "id": "custom.width",
81               "value": 409
82             }
83           ]
84         }
85       ]
86     },
87     "gridPos": {
88       "h": 3,
89       "w": 11,
90       "x": 0,
91       "y": 1
92     },
93     "id": 41,
94     "options": {
95       "frameIndex": 0,
96       "showHeader": true,
97       "sortBy": [
98         {
99           "desc": true,
100           "displayName": "Value #A"
101         }
102       ]
103     },
104     "pluginVersion": "8.2.2",
105     "targets": [
106       {
107         "exemplar": true,
108         "expr": "label_replace( sum(mongodb_up{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (group_name, group_id, org_id, replica_set_name, cluster_name), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")\n",
109         "format": "table",
110         "interval": "",
111         "legendFormat": "",
112         "refId": "A"
113       }
114     ],
115     "title": "Group Metadata",
116     "transformations": [
117       {
118         "id": "organize",
119         "options": {
120           "excludeByName": {
121             "Time": true,
122             "Value #A": true,
123             "instance": true,
124             "replica_set_name": false
125           },
126           "indexByName": {
127             "Time": 0,
128             "Value #A": 6,
129             "cluster_name": 4,
130             "group_id": 3,
131             "group_name": 2,
132             "org_id": 1,
133             "replica_set_name": 5
134           },
135           "renameByName": {
136             "Time": "",
137             "cluster_name": "Cluster Name",
138             "group_id": "Group Id",
139             "group_name": "Group Name ",
140             "hostname": "Host",
141             "instance": "",
142             "org_id": "Org Id",
143             "process_port": "Port",
144             "replica_set_name": "ReplicaSet Name",
145             "replica_state": "ReplicaSet State"
146           }
147         }
148       },
149       {
150         "id": "groupBy",
151         "options": {
152           "fields": {
153             "Cluster Name": {
154               "aggregations": [],
155               "operation": "groupby"
156             },
157             "Group Id": {
158               "aggregations": [],
159               "operation": "groupby"
160             },
161             "Group Name ": {
162               "aggregations": [],
163               "operation": "groupby"
164             },
165             "Host": {
166               "aggregations": [],
167               "operation": "groupby"
168             },
169             "Host ": {
170               "aggregations": [],
171               "operation": "groupby"
172             },
173             "Org Id": {
174               "aggregations": [],
175               "operation": "groupby"
176             },
177             "Port": {
178               "aggregations": [],
179               "operation": "groupby"
180             },
181             "Replica set state": {
182               "aggregations": [],
183               "operation": "groupby"
184             },
185             "ReplicaSet Name": {
186               "aggregations": [],
187               "operation": "groupby"
188             },
189             "ReplicaSet State": {
190               "aggregations": [],
191               "operation": "groupby"
192             },
193             "host ": {
194               "aggregations": [],
195               "operation": "groupby"
196             },
197             "hostname": {
198               "aggregations": [],
199               "operation": "groupby"
200             },
201             "instance": {
202               "aggregations": [],
203               "operation": "groupby"
204             },
205             "port": {
206               "aggregations": [],
207               "operation": "groupby"
208             },
209             "process_port": {
210               "aggregations": [],
211               "operation": "groupby"
212             },
213             "replica set": {
214               "aggregations": [],
215               "operation": "groupby"
216             },
217             "replica set state": {
218               "aggregations": [],
219               "operation": "groupby"
220             },
221             "replica_set_name": {
222               "aggregations": [],
223               "operation": "groupby"
224             },
225             "replica_state": {
226               "aggregations": [],
227               "operation": "groupby"
228             }
229           }
230         }
231       }
232     ],
233     "type": "table"
234   },
235   {
236     "datasource": null,
237     "fieldConfig": {
238       "defaults": {
239         "color": {
240           "mode": "thresholds"
241         },
242         "custom": {
243           "align": "auto",
244           "displayMode": "color-text",
245           "filterable": false
246         },
247         "mappings": [],
248         "thresholds": {
249           "mode": "absolute",
250           "steps": [
251             {
252               "color": "green",
253               "value": null
254             },
255             {
256               "color": "red",
257               "value": 80
258             }
259           ]
260         }
261       },
262       "overrides": [
263         {
264           "matcher": {
265             "id": "byName",
266             "options": "instance"
267           },
268           "properties": [
269             {
270               "id": "custom.width",
271               "value": 409
272             }
273           ]
274         },
275         {
276           "matcher": {
277             "id": "byName",
278             "options": "Port"
279           },
280           "properties": [
281             {
282               "id": "custom.width",
283               "value": 80
284             }
285           ]
286         },
287         {
288           "matcher": {
289             "id": "byName",
290             "options": "ReplicaSet State"
291           },
292           "properties": [
293             {
294               "id": "custom.width",
295               "value": 135
296             }
297           ]
298         },
299         {
300           "matcher": {
301             "id": "byName",
302             "options": "ReplicaSet Name"
303           },
304           "properties": [
305             {
306               "id": "custom.width",
307               "value": 198
308             }
309           ]
310         },
311         {
312           "matcher": {
313             "id": "byName",
314             "options": "Host"
315           },
316           "properties": [
317             {
318               "id": "custom.width",
319               "value": 356
320             }
321           ]
322         }
323       ]
324     },
325     "gridPos": {
326       "h": 5,
327       "w": 13,
328       "x": 11,
329       "y": 1
330     },
331     "id": 42,
332     "options": {
333       "frameIndex": 0,
334       "showHeader": true,
335       "sortBy": []
336     },
337     "pluginVersion": "8.2.2",
338     "targets": [
339       {
340         "exemplar": true,
341         "expr": "label_replace( sum(mongodb_up{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance, replica_state, process_port, replica_set_name, process_type), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")\n",
342         "format": "table",
343         "interval": "",
344         "legendFormat": "",
345         "refId": "A"
346       }
347     ],
348     "title": "Cluster host list",
349     "transformations": [
350       {
351         "id": "organize",
352         "options": {
353           "excludeByName": {
354             "Time": true,
355             "Value #A": true,
356             "instance": true,
357             "process_type": false,
358             "replica_set_name": false
359           },
360           "indexByName": {
361             "Time": 0,
362             "Value #A": 6,
363             "hostname": 1,
364             "instance": 2,
365             "process_port": 3,
366             "replica_set_name": 5,
367             "replica_state": 4
368           },
369           "renameByName": {
370             "Time": "",
371             "hostname": "Host",
372             "instance": "",
373             "process_port": "Port",
374             "process_type": "Type",
375             "replica_set_name": "ReplicaSet Name",
376             "replica_state": "ReplicaSet State"
377           }
378         }
379       },
380       {
381         "id": "groupBy",
382         "options": {
383           "fields": {
384             "Host": {
385               "aggregations": [],
386               "operation": "groupby"
387             },
388             "Host ": {
389               "aggregations": [],
390               "operation": "groupby"
391             },
392             "Port": {
393               "aggregations": [],
394               "operation": "groupby"
395             },
396             "Replica set state": {
397               "aggregations": [],
398               "operation": "groupby"
399             },
400             "ReplicaSet Name": {
401               "aggregations": [],
402               "operation": "groupby"
403             },
404             "ReplicaSet State": {
405               "aggregations": [],
406               "operation": "groupby"
407             },
408             "Type": {
409               "aggregations": [],
410               "operation": "groupby"
411             },
412             "host ": {
413               "aggregations": [],
414               "operation": "groupby"
415             },
416             "hostname": {
417               "aggregations": [],
418               "operation": "groupby"
419             },
420             "instance": {
421               "aggregations": [],
422               "operation": "groupby"
423             },
424             "port": {
425               "aggregations": [],
426               "operation": "groupby"
427             },
428             "process_port": {
429               "aggregations": [],
430               "operation": "groupby"
431             },
432             "process_type": {
433               "aggregations": [],
434               "operation": "groupby"
435             },
436             "replica set": {
437               "aggregations": [],
438               "operation": "groupby"
439             },
440             "replica set state": {
441               "aggregations": [],
442               "operation": "groupby"
443             },
444             "replica_set_name": {
445               "aggregations": [],
446               "operation": "groupby"
447             },
448             "replica_state": {
449               "aggregations": [],
450               "operation": "groupby"
451             }
452           }
453         }
454       }
455     ],
456     "type": "table"
457   },
458   {
459     "collapsed": false,
460     "datasource": null,
461     "gridPos": {
462       "h": 1,
463       "w": 24,
464       "x": 0,
465       "y": 6
466     },
467     "id": 8,
468     "panels": [],
469     "title": "System Memory",
470     "type": "row"
471   },
472   {
473     "datasource": null,
474     "description": "The number of kilobytes of used shared memory (shared between several processes, thus including RAM disks, SYS-V-IPC and BSD like SHMEM)",
475     "fieldConfig": {
476       "defaults": {
477         "color": {
478           "mode": "palette-classic"
479         },
480         "custom": {
481           "axisLabel": "",
482           "axisPlacement": "auto",
483           "barAlignment": 0,
484           "drawStyle": "line",
485           "fillOpacity": 0,
486           "gradientMode": "none",
487           "hideFrom": {
488             "legend": false,
489             "tooltip": false,
490             "viz": false
491           },
492           "lineInterpolation": "linear",
493           "lineWidth": 1,
494           "pointSize": 5,
495           "scaleDistribution": {
496             "type": "linear"
497           },
498           "showPoints": "auto",
499           "spanNulls": false,
500           "stacking": {
501             "group": "A",
502             "mode": "none"
503           },
504           "thresholdsStyle": {
505             "mode": "off"
506           }
507         },
508         "mappings": [],
509         "thresholds": {
510           "mode": "absolute",
511           "steps": [
512             {
513               "color": "green",
514               "value": null
515             },
516             {
517               "color": "red",
518               "value": 80
519             }
520           ]
521         },
522         "unit": "deckbytes"
523       },
524       "overrides": []
525     },
526     "gridPos": {
527       "h": 8,
528       "w": 6,
529       "x": 0,
530       "y": 7
531     },
532     "id": 2,
533     "options": {
534       "legend": {
535         "calcs": [],
536         "displayMode": "list",
537         "placement": "bottom"
538       },
539       "tooltip": {
540         "mode": "single"
541       }
542     },
543     "targets": [
544       {
545         "exemplar": true,
546         "expr": "label_replace(sum(hardware_system_memory_shared_mem_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
547         "interval": "",
548         "legendFormat": "host - {{hostname}}",
549         "refId": "A"
550       }
551     ],
552     "title": "System Memory - Shared",
553     "type": "timeseries"
554   },
555   {
556     "datasource": null,
557     "description": "The number of kilobytes of buffer cache, relatively temporary storage for raw disk blocks",
558     "fieldConfig": {
559       "defaults": {
560         "color": {
561           "mode": "palette-classic"
562         },
563         "custom": {
564           "axisLabel": "",
565           "axisPlacement": "auto",
566           "barAlignment": 0,
567           "drawStyle": "line",
568           "fillOpacity": 0,
569           "gradientMode": "none",
570           "hideFrom": {
571             "legend": false,
572             "tooltip": false,
573             "viz": false
574           },
575           "lineInterpolation": "linear",
576           "lineWidth": 1,
577           "pointSize": 5,
578           "scaleDistribution": {
579             "type": "linear"
580           },
581           "showPoints": "auto",
582           "spanNulls": false,
583           "stacking": {
584             "group": "A",
585             "mode": "none"
586           },
587           "thresholdsStyle": {
588             "mode": "off"
589           }
590         },
591         "mappings": [],
592         "thresholds": {
593           "mode": "absolute",
594           "steps": [
595             {
596               "color": "green",
597               "value": null
598             },
599             {
600               "color": "red",
601               "value": 80
602             }
603           ]
604         },
605         "unit": "deckbytes"
606       },
607       "overrides": []
608     },
609     "gridPos": {
610       "h": 8,
611       "w": 6,
612       "x": 6,
613       "y": 7
614     },
615     "id": 6,
616     "options": {
617       "legend": {
618         "calcs": [],
619         "displayMode": "list",
620         "placement": "bottom"
621       },
622       "tooltip": {
623         "mode": "single"
624       }
625     },
626     "targets": [
627       {
628         "exemplar": true,
629         "expr": "label_replace( sum(hardware_system_memory_buffers_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
630         "interval": "",
631         "legendFormat": "host - {{hostname}}",
632         "refId": "A"
633       }
634     ],
635     "title": "System Memory - Buffers",
636     "type": "timeseries"
637   },
638   {
639     "datasource": null,
640     "description": "The number of kilobytes in the page cache.",
641     "fieldConfig": {
642       "defaults": {
643         "color": {
644           "mode": "palette-classic"
645         },
646         "custom": {
647           "axisLabel": "",
648           "axisPlacement": "auto",
649           "barAlignment": 0,
650           "drawStyle": "line",
651           "fillOpacity": 0,
652           "gradientMode": "none",
653           "hideFrom": {
654             "legend": false,
655             "tooltip": false,
656             "viz": false
657           },
658           "lineInterpolation": "linear",
659           "lineWidth": 1,
660           "pointSize": 5,
661           "scaleDistribution": {
662             "type": "linear"
663           },
664           "showPoints": "auto",
665           "spanNulls": false,
666           "stacking": {
667             "group": "A",
668             "mode": "none"
669           },
670           "thresholdsStyle": {
671             "mode": "off"
672           }
673         },
674         "mappings": [],
675         "thresholds": {
676           "mode": "absolute",
677           "steps": [
678             {
679               "color": "green",
680               "value": null
681             },
682             {
683               "color": "red",
684               "value": 80
685             }
686           ]
687         },
688         "unit": "deckbytes"
689       },
690       "overrides": []
691     },
692     "gridPos": {
693       "h": 8,
694       "w": 6,
695       "x": 12,
696       "y": 7
697     },
698     "id": 11,
699     "options": {
700       "legend": {
701         "calcs": [],
702         "displayMode": "list",
703         "placement": "bottom"
704       },
705       "tooltip": {
706         "mode": "single"
707       }
708     },
709     "targets": [
710       {
711         "exemplar": true,
712         "expr": "label_replace (sum(hardware_system_memory_cached_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
713         "interval": "",
714         "legendFormat": "host - {{hostname}}",
715         "refId": "A"
716       }
717     ],
718     "title": "System Memory - Cached",
719     "type": "timeseries"
720   },
721   {
722     "datasource": null,
723     "description": "The number of kilobytes of physical memory in use\n",
724     "fieldConfig": {
725       "defaults": {
726         "color": {
727           "mode": "palette-classic"
728         },
729         "custom": {
730           "axisLabel": "",
731           "axisPlacement": "auto",
732           "barAlignment": 0,
733           "drawStyle": "line",
734           "fillOpacity": 0,
735           "gradientMode": "none",
736           "hideFrom": {
737             "legend": false,
738             "tooltip": false,
739             "viz": false
740           },
741           "lineInterpolation": "linear",
742           "lineWidth": 1,
743           "pointSize": 5,
744           "scaleDistribution": {
745             "type": "linear"
746           },
747           "showPoints": "auto",
748           "spanNulls": false,
749           "stacking": {
750             "group": "A",
751             "mode": "none"
752           },
753           "thresholdsStyle": {
754             "mode": "off"
755           }
756         },
757         "mappings": [],
758         "thresholds": {
759           "mode": "absolute",
760           "steps": [
761             {
762               "color": "green",
763               "value": null
764             },
765             {
766               "color": "red",
767               "value": 80
768             }
769           ]
770         },
771         "unit": "deckbytes"
772       },
773       "overrides": []
774     },
775     "gridPos": {
776       "h": 8,
777       "w": 6,
778       "x": 0,
779       "y": 15
780     },
781     "id": 13,
782     "options": {
783       "legend": {
784         "calcs": [],
785         "displayMode": "list",
786         "placement": "bottom"
787       },
788       "tooltip": {
789         "mode": "single"
790       }
791     },
792     "targets": [
793       {
794         "exemplar": true,
795         "expr": "label_replace( sum(hardware_system_memory_mem_total_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) - sum(hardware_system_memory_mem_free_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
796         "interval": "",
797         "legendFormat": "host - {{hostname}}",
798         "refId": "A"
799       }
800     ],
801     "title": "System Memory - Used",
802     "type": "timeseries"
803   },
804   {
805     "datasource": null,
806     "description": "The total amount of swap space in free and used, measured in kilobytes\n",
807     "fieldConfig": {
808       "defaults": {
809         "color": {
810           "mode": "palette-classic"
811         },
812         "custom": {
813           "axisLabel": "",
814           "axisPlacement": "auto",
815           "barAlignment": 0,
816           "drawStyle": "line",
817           "fillOpacity": 0,
818           "gradientMode": "none",
819           "hideFrom": {
820             "legend": false,
821             "tooltip": false,
822             "viz": false
823           },
824           "lineInterpolation": "linear",
825           "lineWidth": 1,
826           "pointSize": 5,
827           "scaleDistribution": {
828             "type": "linear"
829           },
830           "showPoints": "auto",
831           "spanNulls": false,
832           "stacking": {
833             "group": "A",
834             "mode": "none"
835           },
836           "thresholdsStyle": {
837             "mode": "off"
838           }
839         },
840         "mappings": [],
841         "thresholds": {
842           "mode": "absolute",
843           "steps": [
844             {
845               "color": "green",
846               "value": null
847             },
848             {
849               "color": "red",
850               "value": 80
851             }
852           ]
853         },
854         "unit": "deckbytes"
855       },
856       "overrides": []
857     },
858     "gridPos": {
859       "h": 8,
860       "w": 6,
861       "x": 6,
862       "y": 15
863     },
864     "id": 37,
865     "options": {
866       "legend": {
867         "calcs": [],
868         "displayMode": "list",
869         "placement": "bottom"
870       },
871       "tooltip": {
872         "mode": "single"
873       }
874     },
875     "targets": [
876       {
877         "exemplar": true,
878         "expr": "label_replace( sum(hardware_system_memory_swap_total_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) - sum(hardware_system_memory_swap_free_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
879         "interval": "",
880         "legendFormat": "swap used for host - {{hostname}}",
881         "refId": "A"
882       },
883       {
884         "exemplar": true,
885         "expr": "label_replace (sum(hardware_system_memory_swap_free_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
886         "hide": false,
887         "interval": "",
888         "legendFormat": "swap free for host - {{hostname}}",
889         "refId": "B"
890       }
891     ],
892     "title": "System Memory - Swap",
893     "type": "timeseries"
894   },
895   {
896     "datasource": null,
897     "description": "An estimate of the number of kilobytes of system memory available for running new applications, without swapping",
898     "fieldConfig": {
899       "defaults": {
900         "color": {
901           "mode": "palette-classic"
902         },
903         "custom": {
904           "axisLabel": "",
905           "axisPlacement": "auto",
906           "barAlignment": 0,
907           "drawStyle": "line",
908           "fillOpacity": 0,
909           "gradientMode": "none",
910           "hideFrom": {
911             "legend": false,
912             "tooltip": false,
913             "viz": false
914           },
915           "lineInterpolation": "linear",
916           "lineWidth": 1,
917           "pointSize": 5,
918           "scaleDistribution": {
919             "type": "linear"
920           },
921           "showPoints": "auto",
922           "spanNulls": false,
923           "stacking": {
924             "group": "A",
925             "mode": "none"
926           },
927           "thresholdsStyle": {
928             "mode": "off"
929           }
930         },
931         "mappings": [],
932         "thresholds": {
933           "mode": "absolute",
934           "steps": [
935             {
936               "color": "green",
937               "value": null
938             },
939             {
940               "color": "red",
941               "value": 80
942             }
943           ]
944         },
945         "unit": "deckbytes"
946       },
947       "overrides": []
948     },
949     "gridPos": {
950       "h": 8,
951       "w": 6,
952       "x": 12,
953       "y": 15
954     },
955     "id": 15,
956     "options": {
957       "legend": {
958         "calcs": [],
959         "displayMode": "list",
960         "placement": "bottom"
961       },
962       "tooltip": {
963         "mode": "single"
964       }
965     },
966     "targets": [
967       {
968         "exemplar": true,
969         "expr": "label_replace( sum(hardware_system_memory_mem_available_kilobytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
970         "interval": "",
971         "legendFormat": "host - {{hostname}}",
972         "refId": "A"
973       }
974     ],
975     "title": "System Memory - Available",
976     "type": "timeseries"
977   },
978   {
979     "collapsed": false,
980     "datasource": null,
981     "gridPos": {
982       "h": 1,
983       "w": 24,
984       "x": 0,
985       "y": 23
986     },
987     "id": 17,
988     "panels": [],
989     "title": "System CPU",
990     "type": "row"
991   },
992   {
993     "datasource": null,
994     "description": "The percentage of time the CPU had something runnable, but the hypervisor chose to run something else. For servers with more than 1 CPU core, this value can exceed 100%.\n",
995     "fieldConfig": {
996       "defaults": {
997         "color": {
998           "mode": "palette-classic"
999         },
1000         "custom": {
1001           "axisLabel": "",
1002           "axisPlacement": "auto",
1003           "barAlignment": 0,
1004           "drawStyle": "line",
1005           "fillOpacity": 0,
1006           "gradientMode": "none",
1007           "hideFrom": {
1008             "legend": false,
1009             "tooltip": false,
1010             "viz": false
1011           },
1012           "lineInterpolation": "linear",
1013           "lineWidth": 1,
1014           "pointSize": 5,
1015           "scaleDistribution": {
1016             "type": "linear"
1017           },
1018           "showPoints": "auto",
1019           "spanNulls": false,
1020           "stacking": {
1021             "group": "A",
1022             "mode": "none"
1023           },
1024           "thresholdsStyle": {
1025             "mode": "off"
1026           }
1027         },
1028         "mappings": [],
1029         "thresholds": {
1030           "mode": "absolute",
1031           "steps": [
1032             {
1033               "color": "green",
1034               "value": null
1035             },
1036             {
1037               "color": "red",
1038               "value": 80
1039             }
1040           ]
1041         },
1042         "unit": "percent"
1043       },
1044       "overrides": [
1045         {
1046           "__systemRef": "hideSeriesFrom",
1047           "matcher": {
1048             "id": "byNames",
1049             "options": {
1050               "mode": "exclude",
1051               "names": [
1052                 "host - banana-shard-00-01.faplr.mmscloudteam.com"
1053               ],
1054               "prefix": "All except:",
1055               "readOnly": true
1056             }
1057           },
1058           "properties": [
1059             {
1060               "id": "custom.hideFrom",
1061               "value": {
1062                 "legend": false,
1063                 "tooltip": false,
1064                 "viz": true
1065               }
1066             }
1067           ]
1068         }
1069       ]
1070     },
1071     "gridPos": {
1072       "h": 7,
1073       "w": 5,
1074       "x": 0,
1075       "y": 24
1076     },
1077     "id": 19,
1078     "options": {
1079       "legend": {
1080         "calcs": [],
1081         "displayMode": "list",
1082         "placement": "bottom"
1083       },
1084       "tooltip": {
1085         "mode": "single"
1086       }
1087     },
1088     "targets": [
1089       {
1090         "exemplar": true,
1091         "expr": "label_replace( sum(rate(hardware_system_cpu_steal_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1092         "interval": "",
1093         "legendFormat": "host - {{hostname}}",
1094         "refId": "A"
1095       }
1096     ],
1097     "title": "System cpu - steal",
1098     "type": "timeseries"
1099   },
1100   {
1101     "datasource": null,
1102     "description": "The percentage of time the CPU spent servicing guest, which is included in user. For servers with more than 1 CPU core, this value can exceed 100%.\n",
1103     "fieldConfig": {
1104       "defaults": {
1105         "color": {
1106           "mode": "palette-classic"
1107         },
1108         "custom": {
1109           "axisLabel": "",
1110           "axisPlacement": "auto",
1111           "barAlignment": 0,
1112           "drawStyle": "line",
1113           "fillOpacity": 0,
1114           "gradientMode": "none",
1115           "hideFrom": {
1116             "legend": false,
1117             "tooltip": false,
1118             "viz": false
1119           },
1120           "lineInterpolation": "linear",
1121           "lineWidth": 1,
1122           "pointSize": 5,
1123           "scaleDistribution": {
1124             "type": "linear"
1125           },
1126           "showPoints": "auto",
1127           "spanNulls": false,
1128           "stacking": {
1129             "group": "A",
1130             "mode": "none"
1131           },
1132           "thresholdsStyle": {
1133             "mode": "off"
1134           }
1135         },
1136         "mappings": [],
1137         "thresholds": {
1138           "mode": "absolute",
1139           "steps": [
1140             {
1141               "color": "green",
1142               "value": null
1143             },
1144             {
1145               "color": "red",
1146               "value": 80
1147             }
1148           ]
1149         },
1150         "unit": "percent"
1151       },
1152       "overrides": []
1153     },
1154     "gridPos": {
1155       "h": 7,
1156       "w": 5,
1157       "x": 5,
1158       "y": 24
1159     },
1160     "id": 20,
1161     "options": {
1162       "legend": {
1163         "calcs": [],
1164         "displayMode": "list",
1165         "placement": "bottom"
1166       },
1167       "tooltip": {
1168         "mode": "single"
1169       }
1170     },
1171     "targets": [
1172       {
1173         "exemplar": true,
1174         "expr": "label_replace( sum(rate(hardware_system_cpu_guest_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1175         "interval": "",
1176         "legendFormat": "host - {{hostname}}",
1177         "refId": "A"
1178       }
1179     ],
1180     "title": "System cpu - guest",
1181     "type": "timeseries"
1182   },
1183   {
1184     "datasource": null,
1185     "description": "The percentage of time the CPU spent performing software interrupts. For servers with more than 1 CPU core, this value can exceed 100%.\n",
1186     "fieldConfig": {
1187       "defaults": {
1188         "color": {
1189           "mode": "palette-classic"
1190         },
1191         "custom": {
1192           "axisLabel": "",
1193           "axisPlacement": "auto",
1194           "barAlignment": 0,
1195           "drawStyle": "line",
1196           "fillOpacity": 0,
1197           "gradientMode": "none",
1198           "hideFrom": {
1199             "legend": false,
1200             "tooltip": false,
1201             "viz": false
1202           },
1203           "lineInterpolation": "linear",
1204           "lineWidth": 1,
1205           "pointSize": 5,
1206           "scaleDistribution": {
1207             "type": "linear"
1208           },
1209           "showPoints": "auto",
1210           "spanNulls": false,
1211           "stacking": {
1212             "group": "A",
1213             "mode": "none"
1214           },
1215           "thresholdsStyle": {
1216             "mode": "off"
1217           }
1218         },
1219         "mappings": [],
1220         "thresholds": {
1221           "mode": "absolute",
1222           "steps": [
1223             {
1224               "color": "green",
1225               "value": null
1226             },
1227             {
1228               "color": "red",
1229               "value": 80
1230             }
1231           ]
1232         },
1233         "unit": "percent"
1234       },
1235       "overrides": []
1236     },
1237     "gridPos": {
1238       "h": 7,
1239       "w": 5,
1240       "x": 10,
1241       "y": 24
1242     },
1243     "id": 21,
1244     "options": {
1245       "legend": {
1246         "calcs": [],
1247         "displayMode": "list",
1248         "placement": "bottom"
1249       },
1250       "tooltip": {
1251         "mode": "single"
1252       }
1253     },
1254     "targets": [
1255       {
1256         "exemplar": true,
1257         "expr": "label_replace( sum(rate(hardware_system_cpu_soft_irq_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1258         "interval": "",
1259         "legendFormat": "host - {{hostname}}",
1260         "refId": "A"
1261       }
1262     ],
1263     "title": "System cpu - softirq",
1264     "type": "timeseries"
1265   },
1266   {
1267     "datasource": null,
1268     "description": "The percentage of time the CPU spent performing hardware interrupts. For servers with more than 1 CPU core, this value can exceed 100%.\n",
1269     "fieldConfig": {
1270       "defaults": {
1271         "color": {
1272           "mode": "palette-classic"
1273         },
1274         "custom": {
1275           "axisLabel": "",
1276           "axisPlacement": "auto",
1277           "barAlignment": 0,
1278           "drawStyle": "line",
1279           "fillOpacity": 0,
1280           "gradientMode": "none",
1281           "hideFrom": {
1282             "legend": false,
1283             "tooltip": false,
1284             "viz": false
1285           },
1286           "lineInterpolation": "linear",
1287           "lineWidth": 1,
1288           "pointSize": 5,
1289           "scaleDistribution": {
1290             "type": "linear"
1291           },
1292           "showPoints": "auto",
1293           "spanNulls": false,
1294           "stacking": {
1295             "group": "A",
1296             "mode": "none"
1297           },
1298           "thresholdsStyle": {
1299             "mode": "off"
1300           }
1301         },
1302         "mappings": [],
1303         "thresholds": {
1304           "mode": "absolute",
1305           "steps": [
1306             {
1307               "color": "green",
1308               "value": null
1309             },
1310             {
1311               "color": "red",
1312               "value": 80
1313             }
1314           ]
1315         },
1316         "unit": "percent"
1317       },
1318       "overrides": []
1319     },
1320     "gridPos": {
1321       "h": 7,
1322       "w": 5,
1323       "x": 15,
1324       "y": 24
1325     },
1326     "id": 22,
1327     "options": {
1328       "legend": {
1329         "calcs": [],
1330         "displayMode": "list",
1331         "placement": "bottom"
1332       },
1333       "tooltip": {
1334         "mode": "single"
1335       }
1336     },
1337     "targets": [
1338       {
1339         "exemplar": true,
1340         "expr": "label_replace( sum(rate(hardware_system_cpu_irq_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1341         "interval": "",
1342         "legendFormat": "host - {{hostname}}",
1343         "refId": "A"
1344       }
1345     ],
1346     "title": "System cpu - irq",
1347     "type": "timeseries"
1348   },
1349   {
1350     "datasource": null,
1351     "description": "The percentage of time the CPU spent waiting for IO operations to complete. For servers with more than 1 CPU core, this value can exceed 100%\n",
1352     "fieldConfig": {
1353       "defaults": {
1354         "color": {
1355           "mode": "palette-classic"
1356         },
1357         "custom": {
1358           "axisLabel": "",
1359           "axisPlacement": "auto",
1360           "barAlignment": 0,
1361           "drawStyle": "line",
1362           "fillOpacity": 0,
1363           "gradientMode": "none",
1364           "hideFrom": {
1365             "legend": false,
1366             "tooltip": false,
1367             "viz": false
1368           },
1369           "lineInterpolation": "linear",
1370           "lineWidth": 1,
1371           "pointSize": 5,
1372           "scaleDistribution": {
1373             "type": "linear"
1374           },
1375           "showPoints": "auto",
1376           "spanNulls": false,
1377           "stacking": {
1378             "group": "A",
1379             "mode": "none"
1380           },
1381           "thresholdsStyle": {
1382             "mode": "off"
1383           }
1384         },
1385         "mappings": [],
1386         "thresholds": {
1387           "mode": "absolute",
1388           "steps": [
1389             {
1390               "color": "green",
1391               "value": null
1392             },
1393             {
1394               "color": "red",
1395               "value": 80
1396             }
1397           ]
1398         },
1399         "unit": "percent"
1400       },
1401       "overrides": []
1402     },
1403     "gridPos": {
1404       "h": 7,
1405       "w": 5,
1406       "x": 0,
1407       "y": 31
1408     },
1409     "id": 23,
1410     "options": {
1411       "legend": {
1412         "calcs": [],
1413         "displayMode": "list",
1414         "placement": "bottom"
1415       },
1416       "tooltip": {
1417         "mode": "single"
1418       }
1419     },
1420     "targets": [
1421       {
1422         "exemplar": true,
1423         "expr": "label_replace(sum(rate(hardware_system_cpu_io_wait_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1424         "interval": "",
1425         "legendFormat": "host - {{hostname}}",
1426         "refId": "A"
1427       }
1428     ],
1429     "title": "System cpu - iowait",
1430     "type": "timeseries"
1431   },
1432   {
1433     "datasource": null,
1434     "description": "The percentage of time the CPU spent occupied by all processes with a positive nice value. For servers with more than 1 CPU core, this value can exceed 100%.\n",
1435     "fieldConfig": {
1436       "defaults": {
1437         "color": {
1438           "mode": "palette-classic"
1439         },
1440         "custom": {
1441           "axisLabel": "",
1442           "axisPlacement": "auto",
1443           "barAlignment": 0,
1444           "drawStyle": "line",
1445           "fillOpacity": 0,
1446           "gradientMode": "none",
1447           "hideFrom": {
1448             "legend": false,
1449             "tooltip": false,
1450             "viz": false
1451           },
1452           "lineInterpolation": "linear",
1453           "lineWidth": 1,
1454           "pointSize": 5,
1455           "scaleDistribution": {
1456             "type": "linear"
1457           },
1458           "showPoints": "auto",
1459           "spanNulls": false,
1460           "stacking": {
1461             "group": "A",
1462             "mode": "none"
1463           },
1464           "thresholdsStyle": {
1465             "mode": "off"
1466           }
1467         },
1468         "mappings": [],
1469         "thresholds": {
1470           "mode": "absolute",
1471           "steps": [
1472             {
1473               "color": "green",
1474               "value": null
1475             },
1476             {
1477               "color": "red",
1478               "value": 80
1479             }
1480           ]
1481         },
1482         "unit": "percent"
1483       },
1484       "overrides": []
1485     },
1486     "gridPos": {
1487       "h": 7,
1488       "w": 5,
1489       "x": 5,
1490       "y": 31
1491     },
1492     "id": 24,
1493     "options": {
1494       "legend": {
1495         "calcs": [],
1496         "displayMode": "list",
1497         "placement": "bottom"
1498       },
1499       "tooltip": {
1500         "mode": "single"
1501       }
1502     },
1503     "targets": [
1504       {
1505         "exemplar": true,
1506         "expr": "label_replace( sum(rate(hardware_system_cpu_nice_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1507         "interval": "",
1508         "legendFormat": "host - {{hostname}}",
1509         "refId": "A"
1510       }
1511     ],
1512     "title": "System cpu - nice",
1513     "type": "timeseries"
1514   },
1515   {
1516     "datasource": null,
1517     "description": "The percentage of time the CPU spent servicing operating system calls from all processes. For servers with more than 1 CPU core, this value can exceed 100%.\n",
1518     "fieldConfig": {
1519       "defaults": {
1520         "color": {
1521           "mode": "palette-classic"
1522         },
1523         "custom": {
1524           "axisLabel": "",
1525           "axisPlacement": "auto",
1526           "barAlignment": 0,
1527           "drawStyle": "line",
1528           "fillOpacity": 0,
1529           "gradientMode": "none",
1530           "hideFrom": {
1531             "legend": false,
1532             "tooltip": false,
1533             "viz": false
1534           },
1535           "lineInterpolation": "linear",
1536           "lineWidth": 1,
1537           "pointSize": 5,
1538           "scaleDistribution": {
1539             "type": "linear"
1540           },
1541           "showPoints": "auto",
1542           "spanNulls": false,
1543           "stacking": {
1544             "group": "A",
1545             "mode": "none"
1546           },
1547           "thresholdsStyle": {
1548             "mode": "off"
1549           }
1550         },
1551         "mappings": [],
1552         "thresholds": {
1553           "mode": "absolute",
1554           "steps": [
1555             {
1556               "color": "green",
1557               "value": null
1558             },
1559             {
1560               "color": "red",
1561               "value": 80
1562             }
1563           ]
1564         },
1565         "unit": "percent"
1566       },
1567       "overrides": []
1568     },
1569     "gridPos": {
1570       "h": 7,
1571       "w": 5,
1572       "x": 10,
1573       "y": 31
1574     },
1575     "id": 25,
1576     "options": {
1577       "legend": {
1578         "calcs": [],
1579         "displayMode": "list",
1580         "placement": "bottom"
1581       },
1582       "tooltip": {
1583         "mode": "single"
1584       }
1585     },
1586     "targets": [
1587       {
1588         "exemplar": true,
1589         "expr": "label_replace( sum(rate(hardware_system_cpu_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1590         "interval": "",
1591         "legendFormat": "host - {{hostname}}",
1592         "refId": "A"
1593       }
1594     ],
1595     "title": "System cpu - kernel",
1596     "type": "timeseries"
1597   },
1598   {
1599     "datasource": null,
1600     "description": "The percentage of time the CPU spent servicing all user applications (not just MongoDB processes). For servers with more than 1 CPU core, this value can exceed 100%.\n",
1601     "fieldConfig": {
1602       "defaults": {
1603         "color": {
1604           "mode": "palette-classic"
1605         },
1606         "custom": {
1607           "axisLabel": "",
1608           "axisPlacement": "auto",
1609           "barAlignment": 0,
1610           "drawStyle": "line",
1611           "fillOpacity": 0,
1612           "gradientMode": "none",
1613           "hideFrom": {
1614             "legend": false,
1615             "tooltip": false,
1616             "viz": false
1617           },
1618           "lineInterpolation": "linear",
1619           "lineWidth": 1,
1620           "pointSize": 5,
1621           "scaleDistribution": {
1622             "type": "linear"
1623           },
1624           "showPoints": "auto",
1625           "spanNulls": false,
1626           "stacking": {
1627             "group": "A",
1628             "mode": "none"
1629           },
1630           "thresholdsStyle": {
1631             "mode": "off"
1632           }
1633         },
1634         "mappings": [],
1635         "thresholds": {
1636           "mode": "absolute",
1637           "steps": [
1638             {
1639               "color": "green",
1640               "value": null
1641             },
1642             {
1643               "color": "red",
1644               "value": 80
1645             }
1646           ]
1647         },
1648         "unit": "percent"
1649       },
1650       "overrides": []
1651     },
1652     "gridPos": {
1653       "h": 7,
1654       "w": 5,
1655       "x": 15,
1656       "y": 31
1657     },
1658     "id": 26,
1659     "options": {
1660       "legend": {
1661         "calcs": [],
1662         "displayMode": "list",
1663         "placement": "bottom"
1664       },
1665       "tooltip": {
1666         "mode": "single"
1667       }
1668     },
1669     "targets": [
1670       {
1671         "exemplar": true,
1672         "expr": "label_replace( sum(rate(hardware_system_cpu_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / 10) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1673         "interval": "",
1674         "legendFormat": "host - {{hostname}}",
1675         "refId": "A"
1676       }
1677     ],
1678     "title": "System cpu - user",
1679     "type": "timeseries"
1680   },
1681   {
1682     "collapsed": false,
1683     "datasource": null,
1684     "gridPos": {
1685       "h": 1,
1686       "w": 24,
1687       "x": 0,
1688       "y": 38
1689     },
1690     "id": 44,
1691     "panels": [],
1692     "title": "Normalized System Cpu",
1693     "type": "row"
1694   },
1695   {
1696     "datasource": null,
1697     "description": "The percentage of time the CPU had something runnable, but the hypervisor chose to run something else. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
1698     "fieldConfig": {
1699       "defaults": {
1700         "color": {
1701           "mode": "palette-classic"
1702         },
1703         "custom": {
1704           "axisLabel": "",
1705           "axisPlacement": "auto",
1706           "barAlignment": 0,
1707           "drawStyle": "line",
1708           "fillOpacity": 0,
1709           "gradientMode": "none",
1710           "hideFrom": {
1711             "legend": false,
1712             "tooltip": false,
1713             "viz": false
1714           },
1715           "lineInterpolation": "linear",
1716           "lineWidth": 1,
1717           "pointSize": 5,
1718           "scaleDistribution": {
1719             "type": "linear"
1720           },
1721           "showPoints": "auto",
1722           "spanNulls": false,
1723           "stacking": {
1724             "group": "A",
1725             "mode": "none"
1726           },
1727           "thresholdsStyle": {
1728             "mode": "off"
1729           }
1730         },
1731         "mappings": [],
1732         "thresholds": {
1733           "mode": "absolute",
1734           "steps": [
1735             {
1736               "color": "green",
1737               "value": null
1738             },
1739             {
1740               "color": "red",
1741               "value": 80
1742             }
1743           ]
1744         },
1745         "unit": "percent"
1746       },
1747       "overrides": [
1748         {
1749           "__systemRef": "hideSeriesFrom",
1750           "matcher": {
1751             "id": "byNames",
1752             "options": {
1753               "mode": "exclude",
1754               "names": [
1755                 "host - banana-shard-00-01.faplr.mmscloudteam.com"
1756               ],
1757               "prefix": "All except:",
1758               "readOnly": true
1759             }
1760           },
1761           "properties": [
1762             {
1763               "id": "custom.hideFrom",
1764               "value": {
1765                 "legend": false,
1766                 "tooltip": false,
1767                 "viz": true
1768               }
1769             }
1770           ]
1771         }
1772       ]
1773     },
1774     "gridPos": {
1775       "h": 7,
1776       "w": 5,
1777       "x": 0,
1778       "y": 39
1779     },
1780     "id": 46,
1781     "options": {
1782       "legend": {
1783         "calcs": [],
1784         "displayMode": "list",
1785         "placement": "bottom"
1786       },
1787       "tooltip": {
1788         "mode": "single"
1789       }
1790     },
1791     "targets": [
1792       {
1793         "exemplar": true,
1794         "expr": "label_replace( sum(rate(hardware_system_cpu_steal_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1795         "interval": "",
1796         "legendFormat": "host - {{hostname}}",
1797         "refId": "A"
1798       }
1799     ],
1800     "title": "Normalized System cpu - steal",
1801     "type": "timeseries"
1802   },
1803   {
1804     "datasource": null,
1805     "description": "The percentage of time the CPU spent servicing guest, which is included in user. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
1806     "fieldConfig": {
1807       "defaults": {
1808         "color": {
1809           "mode": "palette-classic"
1810         },
1811         "custom": {
1812           "axisLabel": "",
1813           "axisPlacement": "auto",
1814           "barAlignment": 0,
1815           "drawStyle": "line",
1816           "fillOpacity": 0,
1817           "gradientMode": "none",
1818           "hideFrom": {
1819             "legend": false,
1820             "tooltip": false,
1821             "viz": false
1822           },
1823           "lineInterpolation": "linear",
1824           "lineWidth": 1,
1825           "pointSize": 5,
1826           "scaleDistribution": {
1827             "type": "linear"
1828           },
1829           "showPoints": "auto",
1830           "spanNulls": false,
1831           "stacking": {
1832             "group": "A",
1833             "mode": "none"
1834           },
1835           "thresholdsStyle": {
1836             "mode": "off"
1837           }
1838         },
1839         "mappings": [],
1840         "thresholds": {
1841           "mode": "absolute",
1842           "steps": [
1843             {
1844               "color": "green",
1845               "value": null
1846             },
1847             {
1848               "color": "red",
1849               "value": 80
1850             }
1851           ]
1852         },
1853         "unit": "percent"
1854       },
1855       "overrides": []
1856     },
1857     "gridPos": {
1858       "h": 7,
1859       "w": 5,
1860       "x": 5,
1861       "y": 39
1862     },
1863     "id": 47,
1864     "options": {
1865       "legend": {
1866         "calcs": [],
1867         "displayMode": "list",
1868         "placement": "bottom"
1869       },
1870       "tooltip": {
1871         "mode": "single"
1872       }
1873     },
1874     "targets": [
1875       {
1876         "exemplar": true,
1877         "expr": "label_replace( sum(rate(hardware_system_cpu_guest_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1878         "interval": "",
1879         "legendFormat": "host - {{hostname}}",
1880         "refId": "A"
1881       }
1882     ],
1883     "title": "Normalized System cpu - guest",
1884     "type": "timeseries"
1885   },
1886   {
1887     "datasource": null,
1888     "description": "The percentage of time the CPU spent performing software interrupts. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
1889     "fieldConfig": {
1890       "defaults": {
1891         "color": {
1892           "mode": "palette-classic"
1893         },
1894         "custom": {
1895           "axisLabel": "",
1896           "axisPlacement": "auto",
1897           "barAlignment": 0,
1898           "drawStyle": "line",
1899           "fillOpacity": 0,
1900           "gradientMode": "none",
1901           "hideFrom": {
1902             "legend": false,
1903             "tooltip": false,
1904             "viz": false
1905           },
1906           "lineInterpolation": "linear",
1907           "lineWidth": 1,
1908           "pointSize": 5,
1909           "scaleDistribution": {
1910             "type": "linear"
1911           },
1912           "showPoints": "auto",
1913           "spanNulls": false,
1914           "stacking": {
1915             "group": "A",
1916             "mode": "none"
1917           },
1918           "thresholdsStyle": {
1919             "mode": "off"
1920           }
1921         },
1922         "mappings": [],
1923         "thresholds": {
1924           "mode": "absolute",
1925           "steps": [
1926             {
1927               "color": "green",
1928               "value": null
1929             },
1930             {
1931               "color": "red",
1932               "value": 80
1933             }
1934           ]
1935         },
1936         "unit": "percent"
1937       },
1938       "overrides": []
1939     },
1940     "gridPos": {
1941       "h": 7,
1942       "w": 5,
1943       "x": 10,
1944       "y": 39
1945     },
1946     "id": 48,
1947     "options": {
1948       "legend": {
1949         "calcs": [],
1950         "displayMode": "list",
1951         "placement": "bottom"
1952       },
1953       "tooltip": {
1954         "mode": "single"
1955       }
1956     },
1957     "targets": [
1958       {
1959         "exemplar": true,
1960         "expr": "label_replace( sum(rate(hardware_system_cpu_soft_irq_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
1961         "interval": "",
1962         "legendFormat": "host - {{hostname}}",
1963         "refId": "A"
1964       }
1965     ],
1966     "title": "Normalized System cpu - softirq",
1967     "type": "timeseries"
1968   },
1969   {
1970     "datasource": null,
1971     "description": "The percentage of time the CPU spent performing hardware interrupts. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
1972     "fieldConfig": {
1973       "defaults": {
1974         "color": {
1975           "mode": "palette-classic"
1976         },
1977         "custom": {
1978           "axisLabel": "",
1979           "axisPlacement": "auto",
1980           "barAlignment": 0,
1981           "drawStyle": "line",
1982           "fillOpacity": 0,
1983           "gradientMode": "none",
1984           "hideFrom": {
1985             "legend": false,
1986             "tooltip": false,
1987             "viz": false
1988           },
1989           "lineInterpolation": "linear",
1990           "lineWidth": 1,
1991           "pointSize": 5,
1992           "scaleDistribution": {
1993             "type": "linear"
1994           },
1995           "showPoints": "auto",
1996           "spanNulls": false,
1997           "stacking": {
1998             "group": "A",
1999             "mode": "none"
2000           },
2001           "thresholdsStyle": {
2002             "mode": "off"
2003           }
2004         },
2005         "mappings": [],
2006         "thresholds": {
2007           "mode": "absolute",
2008           "steps": [
2009             {
2010               "color": "green",
2011               "value": null
2012             },
2013             {
2014               "color": "red",
2015               "value": 80
2016             }
2017           ]
2018         },
2019         "unit": "percent"
2020       },
2021       "overrides": []
2022     },
2023     "gridPos": {
2024       "h": 7,
2025       "w": 5,
2026       "x": 15,
2027       "y": 39
2028     },
2029     "id": 49,
2030     "options": {
2031       "legend": {
2032         "calcs": [],
2033         "displayMode": "list",
2034         "placement": "bottom"
2035       },
2036       "tooltip": {
2037         "mode": "single"
2038       }
2039     },
2040     "targets": [
2041       {
2042         "exemplar": true,
2043         "expr": "label_replace( sum(rate(hardware_system_cpu_irq_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2044         "interval": "",
2045         "legendFormat": "host - {{hostname}}",
2046         "refId": "A"
2047       }
2048     ],
2049     "title": "Normalized System cpu - irq",
2050     "type": "timeseries"
2051   },
2052   {
2053     "datasource": null,
2054     "description": "The percentage of time the CPU spent waiting for IO operations to complete. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
2055     "fieldConfig": {
2056       "defaults": {
2057         "color": {
2058           "mode": "palette-classic"
2059         },
2060         "custom": {
2061           "axisLabel": "",
2062           "axisPlacement": "auto",
2063           "barAlignment": 0,
2064           "drawStyle": "line",
2065           "fillOpacity": 0,
2066           "gradientMode": "none",
2067           "hideFrom": {
2068             "legend": false,
2069             "tooltip": false,
2070             "viz": false
2071           },
2072           "lineInterpolation": "linear",
2073           "lineWidth": 1,
2074           "pointSize": 5,
2075           "scaleDistribution": {
2076             "type": "linear"
2077           },
2078           "showPoints": "auto",
2079           "spanNulls": false,
2080           "stacking": {
2081             "group": "A",
2082             "mode": "none"
2083           },
2084           "thresholdsStyle": {
2085             "mode": "off"
2086           }
2087         },
2088         "mappings": [],
2089         "thresholds": {
2090           "mode": "absolute",
2091           "steps": [
2092             {
2093               "color": "green",
2094               "value": null
2095             },
2096             {
2097               "color": "red",
2098               "value": 80
2099             }
2100           ]
2101         },
2102         "unit": "percent"
2103       },
2104       "overrides": []
2105     },
2106     "gridPos": {
2107       "h": 7,
2108       "w": 5,
2109       "x": 0,
2110       "y": 46
2111     },
2112     "id": 51,
2113     "options": {
2114       "legend": {
2115         "calcs": [],
2116         "displayMode": "list",
2117         "placement": "bottom"
2118       },
2119       "tooltip": {
2120         "mode": "single"
2121       }
2122     },
2123     "targets": [
2124       {
2125         "exemplar": true,
2126         "expr": "label_replace(sum(rate(hardware_system_cpu_io_wait_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2127         "interval": "",
2128         "legendFormat": "host - {{hostname}}",
2129         "refId": "A"
2130       }
2131     ],
2132     "title": "Normalized System cpu - iowait",
2133     "type": "timeseries"
2134   },
2135   {
2136     "datasource": null,
2137     "description": "The percentage of time the CPU spent occupied by all processes with a positive nice value. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
2138     "fieldConfig": {
2139       "defaults": {
2140         "color": {
2141           "mode": "palette-classic"
2142         },
2143         "custom": {
2144           "axisLabel": "",
2145           "axisPlacement": "auto",
2146           "barAlignment": 0,
2147           "drawStyle": "line",
2148           "fillOpacity": 0,
2149           "gradientMode": "none",
2150           "hideFrom": {
2151             "legend": false,
2152             "tooltip": false,
2153             "viz": false
2154           },
2155           "lineInterpolation": "linear",
2156           "lineWidth": 1,
2157           "pointSize": 5,
2158           "scaleDistribution": {
2159             "type": "linear"
2160           },
2161           "showPoints": "auto",
2162           "spanNulls": false,
2163           "stacking": {
2164             "group": "A",
2165             "mode": "none"
2166           },
2167           "thresholdsStyle": {
2168             "mode": "off"
2169           }
2170         },
2171         "mappings": [],
2172         "thresholds": {
2173           "mode": "absolute",
2174           "steps": [
2175             {
2176               "color": "green",
2177               "value": null
2178             },
2179             {
2180               "color": "red",
2181               "value": 80
2182             }
2183           ]
2184         },
2185         "unit": "percent"
2186       },
2187       "overrides": []
2188     },
2189     "gridPos": {
2190       "h": 7,
2191       "w": 5,
2192       "x": 5,
2193       "y": 46
2194     },
2195     "id": 52,
2196     "options": {
2197       "legend": {
2198         "calcs": [],
2199         "displayMode": "list",
2200         "placement": "bottom"
2201       },
2202       "tooltip": {
2203         "mode": "single"
2204       }
2205     },
2206     "targets": [
2207       {
2208         "exemplar": true,
2209         "expr": "label_replace( sum(rate(hardware_system_cpu_nice_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2210         "interval": "",
2211         "legendFormat": "host - {{hostname}}",
2212         "refId": "A"
2213       }
2214     ],
2215     "title": "Normalized System cpu - nice",
2216     "type": "timeseries"
2217   },
2218   {
2219     "datasource": null,
2220     "description": "The percentage of time the CPU spent servicing operating system calls from all processes. It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
2221     "fieldConfig": {
2222       "defaults": {
2223         "color": {
2224           "mode": "palette-classic"
2225         },
2226         "custom": {
2227           "axisLabel": "",
2228           "axisPlacement": "auto",
2229           "barAlignment": 0,
2230           "drawStyle": "line",
2231           "fillOpacity": 0,
2232           "gradientMode": "none",
2233           "hideFrom": {
2234             "legend": false,
2235             "tooltip": false,
2236             "viz": false
2237           },
2238           "lineInterpolation": "linear",
2239           "lineWidth": 1,
2240           "pointSize": 5,
2241           "scaleDistribution": {
2242             "type": "linear"
2243           },
2244           "showPoints": "auto",
2245           "spanNulls": false,
2246           "stacking": {
2247             "group": "A",
2248             "mode": "none"
2249           },
2250           "thresholdsStyle": {
2251             "mode": "off"
2252           }
2253         },
2254         "mappings": [],
2255         "thresholds": {
2256           "mode": "absolute",
2257           "steps": [
2258             {
2259               "color": "green",
2260               "value": null
2261             },
2262             {
2263               "color": "red",
2264               "value": 80
2265             }
2266           ]
2267         },
2268         "unit": "percent"
2269       },
2270       "overrides": []
2271     },
2272     "gridPos": {
2273       "h": 7,
2274       "w": 5,
2275       "x": 10,
2276       "y": 46
2277     },
2278     "id": 53,
2279     "options": {
2280       "legend": {
2281         "calcs": [],
2282         "displayMode": "list",
2283         "placement": "bottom"
2284       },
2285       "tooltip": {
2286         "mode": "single"
2287       }
2288     },
2289     "targets": [
2290       {
2291         "exemplar": true,
2292         "expr": "label_replace( sum(rate(hardware_system_cpu_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2293         "interval": "",
2294         "legendFormat": "host - {{hostname}}",
2295         "refId": "A"
2296       }
2297     ],
2298     "title": "Normalized System cpu - kernel",
2299     "type": "timeseries"
2300   },
2301   {
2302     "datasource": null,
2303     "description": "The percentage of time the CPU spent servicing all user applications (not just MongoDB processes). It is scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
2304     "fieldConfig": {
2305       "defaults": {
2306         "color": {
2307           "mode": "palette-classic"
2308         },
2309         "custom": {
2310           "axisLabel": "",
2311           "axisPlacement": "auto",
2312           "barAlignment": 0,
2313           "drawStyle": "line",
2314           "fillOpacity": 0,
2315           "gradientMode": "none",
2316           "hideFrom": {
2317             "legend": false,
2318             "tooltip": false,
2319             "viz": false
2320           },
2321           "lineInterpolation": "linear",
2322           "lineWidth": 1,
2323           "pointSize": 5,
2324           "scaleDistribution": {
2325             "type": "linear"
2326           },
2327           "showPoints": "auto",
2328           "spanNulls": false,
2329           "stacking": {
2330             "group": "A",
2331             "mode": "none"
2332           },
2333           "thresholdsStyle": {
2334             "mode": "off"
2335           }
2336         },
2337         "mappings": [],
2338         "thresholds": {
2339           "mode": "absolute",
2340           "steps": [
2341             {
2342               "color": "green",
2343               "value": null
2344             },
2345             {
2346               "color": "red",
2347               "value": 80
2348             }
2349           ]
2350         },
2351         "unit": "percent"
2352       },
2353       "overrides": []
2354     },
2355     "gridPos": {
2356       "h": 7,
2357       "w": 5,
2358       "x": 15,
2359       "y": 46
2360     },
2361     "id": 50,
2362     "options": {
2363       "legend": {
2364         "calcs": [],
2365         "displayMode": "list",
2366         "placement": "bottom"
2367       },
2368       "tooltip": {
2369         "mode": "single"
2370       }
2371     },
2372     "targets": [
2373       {
2374         "exemplar": true,
2375         "expr": "label_replace( sum(rate(hardware_system_cpu_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / (10 * hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\"})) by (instance) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2376         "interval": "",
2377         "legendFormat": "host - {{hostname}}",
2378         "refId": "A"
2379       }
2380     ],
2381     "title": "Normalized System cpu - user",
2382     "type": "timeseries"
2383   },
2384   {
2385     "collapsed": false,
2386     "datasource": null,
2387     "gridPos": {
2388       "h": 1,
2389       "w": 24,
2390       "x": 0,
2391       "y": 53
2392     },
2393     "id": 28,
2394     "panels": [],
2395     "title": "System Network",
2396     "type": "row"
2397   },
2398   {
2399     "datasource": null,
2400     "description": "The average rate of physical bytes received per second by the eth0 network interface\n",
2401     "fieldConfig": {
2402       "defaults": {
2403         "color": {
2404           "mode": "palette-classic"
2405         },
2406         "custom": {
2407           "axisLabel": "",
2408           "axisPlacement": "auto",
2409           "barAlignment": 0,
2410           "drawStyle": "line",
2411           "fillOpacity": 0,
2412           "gradientMode": "none",
2413           "hideFrom": {
2414             "legend": false,
2415             "tooltip": false,
2416             "viz": false
2417           },
2418           "lineInterpolation": "linear",
2419           "lineWidth": 1,
2420           "pointSize": 5,
2421           "scaleDistribution": {
2422             "type": "linear"
2423           },
2424           "showPoints": "auto",
2425           "spanNulls": false,
2426           "stacking": {
2427             "group": "A",
2428             "mode": "none"
2429           },
2430           "thresholdsStyle": {
2431             "mode": "off"
2432           }
2433         },
2434         "mappings": [],
2435         "thresholds": {
2436           "mode": "absolute",
2437           "steps": [
2438             {
2439               "color": "green",
2440               "value": null
2441             },
2442             {
2443               "color": "red",
2444               "value": 80
2445             }
2446           ]
2447         },
2448         "unit": "Bps"
2449       },
2450       "overrides": []
2451     },
2452     "gridPos": {
2453       "h": 9,
2454       "w": 10,
2455       "x": 0,
2456       "y": 54
2457     },
2458     "id": 73,
2459     "options": {
2460       "legend": {
2461         "calcs": [],
2462         "displayMode": "list",
2463         "placement": "bottom"
2464       },
2465       "tooltip": {
2466         "mode": "single"
2467       }
2468     },
2469     "targets": [
2470       {
2471         "exemplar": true,
2472         "expr": "label_replace( sum(rate(hardware_system_network_eth0_bytes_in_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance) + sum(rate(hardware_system_network_lo_bytes_in_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2473         "interval": "",
2474         "legendFormat": "host - {{hostname}}",
2475         "refId": "A"
2476       }
2477     ],
2478     "title": "Network bytes In",
2479     "type": "timeseries"
2480   },
2481   {
2482     "datasource": null,
2483     "description": "The average rate of physical bytes transmitted per second by the eth0 network interface",
2484     "fieldConfig": {
2485       "defaults": {
2486         "color": {
2487           "mode": "palette-classic"
2488         },
2489         "custom": {
2490           "axisLabel": "",
2491           "axisPlacement": "auto",
2492           "barAlignment": 0,
2493           "drawStyle": "line",
2494           "fillOpacity": 0,
2495           "gradientMode": "none",
2496           "hideFrom": {
2497             "legend": false,
2498             "tooltip": false,
2499             "viz": false
2500           },
2501           "lineInterpolation": "linear",
2502           "lineWidth": 1,
2503           "pointSize": 5,
2504           "scaleDistribution": {
2505             "type": "linear"
2506           },
2507           "showPoints": "auto",
2508           "spanNulls": false,
2509           "stacking": {
2510             "group": "A",
2511             "mode": "none"
2512           },
2513           "thresholdsStyle": {
2514             "mode": "off"
2515           }
2516         },
2517         "mappings": [],
2518         "thresholds": {
2519           "mode": "absolute",
2520           "steps": [
2521             {
2522               "color": "green",
2523               "value": null
2524             },
2525             {
2526               "color": "red",
2527               "value": 80
2528             }
2529           ]
2530         },
2531         "unit": "Bps"
2532       },
2533       "overrides": []
2534     },
2535     "gridPos": {
2536       "h": 9,
2537       "w": 10,
2538       "x": 10,
2539       "y": 54
2540     },
2541     "id": 74,
2542     "options": {
2543       "legend": {
2544         "calcs": [],
2545         "displayMode": "list",
2546         "placement": "bottom"
2547       },
2548       "tooltip": {
2549         "mode": "single"
2550       }
2551     },
2552     "targets": [
2553       {
2554         "exemplar": true,
2555         "expr": "label_replace( sum(rate(hardware_system_network_eth0_bytes_out_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance) + sum(rate(hardware_system_network_lo_bytes_out_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2556         "interval": "",
2557         "legendFormat": "host - {{hostname}}",
2558         "refId": "A"
2559       }
2560     ],
2561     "title": "Network bytes Out",
2562     "type": "timeseries"
2563   },
2564   {
2565     "collapsed": false,
2566     "datasource": null,
2567     "gridPos": {
2568       "h": 1,
2569       "w": 24,
2570       "x": 0,
2571       "y": 63
2572     },
2573     "id": 30,
2574     "panels": [],
2575     "title": "System Disk",
2576     "type": "row"
2577   },
2578   {
2579     "datasource": null,
2580     "description": "The total bytes of free disk space on the disk partition used by MongoDB.\n",
2581     "fieldConfig": {
2582       "defaults": {
2583         "color": {
2584           "mode": "palette-classic"
2585         },
2586         "custom": {
2587           "axisLabel": "",
2588           "axisPlacement": "auto",
2589           "barAlignment": 0,
2590           "drawStyle": "line",
2591           "fillOpacity": 0,
2592           "gradientMode": "none",
2593           "hideFrom": {
2594             "legend": false,
2595             "tooltip": false,
2596             "viz": false
2597           },
2598           "lineInterpolation": "linear",
2599           "lineWidth": 1,
2600           "pointSize": 5,
2601           "scaleDistribution": {
2602             "type": "linear"
2603           },
2604           "showPoints": "auto",
2605           "spanNulls": false,
2606           "stacking": {
2607             "group": "A",
2608             "mode": "none"
2609           },
2610           "thresholdsStyle": {
2611             "mode": "off"
2612           }
2613         },
2614         "mappings": [],
2615         "thresholds": {
2616           "mode": "absolute",
2617           "steps": [
2618             {
2619               "color": "green",
2620               "value": null
2621             },
2622             {
2623               "color": "red",
2624               "value": 80
2625             }
2626           ]
2627         },
2628         "unit": "decbytes"
2629       },
2630       "overrides": []
2631     },
2632     "gridPos": {
2633       "h": 8,
2634       "w": 6,
2635       "x": 0,
2636       "y": 64
2637     },
2638     "id": 14,
2639     "options": {
2640       "legend": {
2641         "calcs": [],
2642         "displayMode": "list",
2643         "placement": "bottom"
2644       },
2645       "tooltip": {
2646         "mode": "single"
2647       }
2648     },
2649     "targets": [
2650       {
2651         "exemplar": true,
2652         "expr": "label_replace( sum(hardware_disk_metrics_disk_space_free_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance, disk_name) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2653         "interval": "",
2654         "legendFormat": "disk - {{disk_name}}, host - {{hostname}} ",
2655         "refId": "A"
2656       }
2657     ],
2658     "title": "System Disk - Free",
2659     "type": "timeseries"
2660   },
2661   {
2662     "datasource": null,
2663     "description": "The percent of free disk space on the partition used by MongoDB.\n",
2664     "fieldConfig": {
2665       "defaults": {
2666         "color": {
2667           "mode": "palette-classic"
2668         },
2669         "custom": {
2670           "axisLabel": "",
2671           "axisPlacement": "auto",
2672           "barAlignment": 0,
2673           "drawStyle": "line",
2674           "fillOpacity": 0,
2675           "gradientMode": "none",
2676           "hideFrom": {
2677             "legend": false,
2678             "tooltip": false,
2679             "viz": false
2680           },
2681           "lineInterpolation": "linear",
2682           "lineWidth": 1,
2683           "pointSize": 5,
2684           "scaleDistribution": {
2685             "type": "linear"
2686           },
2687           "showPoints": "auto",
2688           "spanNulls": false,
2689           "stacking": {
2690             "group": "A",
2691             "mode": "none"
2692           },
2693           "thresholdsStyle": {
2694             "mode": "off"
2695           }
2696         },
2697         "mappings": [],
2698         "thresholds": {
2699           "mode": "absolute",
2700           "steps": [
2701             {
2702               "color": "green",
2703               "value": null
2704             },
2705             {
2706               "color": "red",
2707               "value": 80
2708             }
2709           ]
2710         },
2711         "unit": "percent"
2712       },
2713       "overrides": []
2714     },
2715     "gridPos": {
2716       "h": 8,
2717       "w": 6,
2718       "x": 6,
2719       "y": 64
2720     },
2721     "id": 71,
2722     "options": {
2723       "legend": {
2724         "calcs": [],
2725         "displayMode": "list",
2726         "placement": "bottom"
2727       },
2728       "tooltip": {
2729         "mode": "single"
2730       }
2731     },
2732     "targets": [
2733       {
2734         "exemplar": true,
2735         "expr": "label_replace( sum(hardware_disk_metrics_disk_space_free_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"} / (hardware_disk_metrics_disk_space_used_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"} + hardware_disk_metrics_disk_space_free_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) * 100) by (instance, disk_name) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2736         "interval": "",
2737         "legendFormat": "disk - {{disk_name}}, host - {{hostname}} ",
2738         "refId": "A"
2739       }
2740     ],
2741     "title": "System Disk Percent Free",
2742     "type": "timeseries"
2743   },
2744   {
2745     "datasource": null,
2746     "description": "The total bytes of used disk space on the partition that runs MongoDB.\n",
2747     "fieldConfig": {
2748       "defaults": {
2749         "color": {
2750           "mode": "palette-classic"
2751         },
2752         "custom": {
2753           "axisLabel": "",
2754           "axisPlacement": "auto",
2755           "barAlignment": 0,
2756           "drawStyle": "line",
2757           "fillOpacity": 0,
2758           "gradientMode": "none",
2759           "hideFrom": {
2760             "legend": false,
2761             "tooltip": false,
2762             "viz": false
2763           },
2764           "lineInterpolation": "linear",
2765           "lineWidth": 1,
2766           "pointSize": 5,
2767           "scaleDistribution": {
2768             "type": "linear"
2769           },
2770           "showPoints": "auto",
2771           "spanNulls": false,
2772           "stacking": {
2773             "group": "A",
2774             "mode": "none"
2775           },
2776           "thresholdsStyle": {
2777             "mode": "off"
2778           }
2779         },
2780         "mappings": [],
2781         "thresholds": {
2782           "mode": "absolute",
2783           "steps": [
2784             {
2785               "color": "green",
2786               "value": null
2787             },
2788             {
2789               "color": "red",
2790               "value": 80
2791             }
2792           ]
2793         },
2794         "unit": "decbytes"
2795       },
2796       "overrides": []
2797     },
2798     "gridPos": {
2799       "h": 8,
2800       "w": 6,
2801       "x": 12,
2802       "y": 64
2803     },
2804     "id": 36,
2805     "options": {
2806       "legend": {
2807         "calcs": [],
2808         "displayMode": "list",
2809         "placement": "bottom"
2810       },
2811       "tooltip": {
2812         "mode": "single"
2813       }
2814     },
2815     "targets": [
2816       {
2817         "exemplar": true,
2818         "expr": "label_replace( sum(hardware_disk_metrics_disk_space_used_bytes{group_id=~\"$group_id\",  instance=~\"$host.*\"}) by (instance, disk_name) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2819         "interval": "",
2820         "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
2821         "refId": "A"
2822       }
2823     ],
2824     "title": "System Disk - Used",
2825     "type": "timeseries"
2826   },
2827   {
2828     "datasource": null,
2829     "description": "The write throughput of I/O operations per second for the disk partition used for MongoDB.\n",
2830     "fieldConfig": {
2831       "defaults": {
2832         "color": {
2833           "mode": "palette-classic"
2834         },
2835         "custom": {
2836           "axisLabel": "",
2837           "axisPlacement": "auto",
2838           "barAlignment": 0,
2839           "drawStyle": "line",
2840           "fillOpacity": 0,
2841           "gradientMode": "none",
2842           "hideFrom": {
2843             "legend": false,
2844             "tooltip": false,
2845             "viz": false
2846           },
2847           "lineInterpolation": "linear",
2848           "lineWidth": 1,
2849           "pointSize": 5,
2850           "scaleDistribution": {
2851             "type": "linear"
2852           },
2853           "showPoints": "auto",
2854           "spanNulls": false,
2855           "stacking": {
2856             "group": "A",
2857             "mode": "none"
2858           },
2859           "thresholdsStyle": {
2860             "mode": "off"
2861           }
2862         },
2863         "mappings": [],
2864         "thresholds": {
2865           "mode": "absolute",
2866           "steps": [
2867             {
2868               "color": "green",
2869               "value": null
2870             },
2871             {
2872               "color": "red",
2873               "value": 80
2874             }
2875           ]
2876         },
2877         "unit": "/ sec"
2878       },
2879       "overrides": []
2880     },
2881     "gridPos": {
2882       "h": 8,
2883       "w": 6,
2884       "x": 18,
2885       "y": 64
2886     },
2887     "id": 63,
2888     "options": {
2889       "legend": {
2890         "calcs": [],
2891         "displayMode": "list",
2892         "placement": "bottom"
2893       },
2894       "tooltip": {
2895         "mode": "single"
2896       }
2897     },
2898     "targets": [
2899       {
2900         "exemplar": true,
2901         "expr": "label_replace( sum(rate(hardware_disk_metrics_write_count{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance, disk_name) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2902         "hide": false,
2903         "interval": "",
2904         "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
2905         "refId": "B"
2906       }
2907     ],
2908     "title": "System Disk Write IOPS",
2909     "type": "timeseries"
2910   },
2911   {
2912     "datasource": null,
2913     "description": "The write latency in milliseconds of the disk partition used by MongoDB.\n",
2914     "fieldConfig": {
2915       "defaults": {
2916         "color": {
2917           "mode": "palette-classic"
2918         },
2919         "custom": {
2920           "axisLabel": "",
2921           "axisPlacement": "auto",
2922           "barAlignment": 0,
2923           "drawStyle": "line",
2924           "fillOpacity": 0,
2925           "gradientMode": "none",
2926           "hideFrom": {
2927             "legend": false,
2928             "tooltip": false,
2929             "viz": false
2930           },
2931           "lineInterpolation": "linear",
2932           "lineWidth": 1,
2933           "pointSize": 5,
2934           "scaleDistribution": {
2935             "type": "linear"
2936           },
2937           "showPoints": "auto",
2938           "spanNulls": false,
2939           "stacking": {
2940             "group": "A",
2941             "mode": "none"
2942           },
2943           "thresholdsStyle": {
2944             "mode": "off"
2945           }
2946         },
2947         "mappings": [],
2948         "thresholds": {
2949           "mode": "absolute",
2950           "steps": [
2951             {
2952               "color": "green",
2953               "value": null
2954             },
2955             {
2956               "color": "red",
2957               "value": 80
2958             }
2959           ]
2960         },
2961         "unit": "ms"
2962       },
2963       "overrides": []
2964     },
2965     "gridPos": {
2966       "h": 8,
2967       "w": 6,
2968       "x": 0,
2969       "y": 72
2970     },
2971     "id": 64,
2972     "options": {
2973       "legend": {
2974         "calcs": [],
2975         "displayMode": "list",
2976         "placement": "bottom"
2977       },
2978       "tooltip": {
2979         "mode": "single"
2980       }
2981     },
2982     "targets": [
2983       {
2984         "exemplar": true,
2985         "expr": "label_replace( sum(rate(hardware_disk_metrics_write_time_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / rate(hardware_disk_metrics_write_count{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance, disk_name), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
2986         "hide": false,
2987         "interval": "",
2988         "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
2989         "refId": "B"
2990       }
2991     ],
2992     "title": "System Disk Write Latency",
2993     "type": "timeseries"
2994   },
2995   {
2996     "datasource": null,
2997     "description": "The Read latency in milliseconds of the disk partition used by MongoDB.\n",
2998     "fieldConfig": {
2999       "defaults": {
3000         "color": {
3001           "mode": "palette-classic"
3002         },
3003         "custom": {
3004           "axisLabel": "",
3005           "axisPlacement": "auto",
3006           "barAlignment": 0,
3007           "drawStyle": "line",
3008           "fillOpacity": 0,
3009           "gradientMode": "none",
3010           "hideFrom": {
3011             "legend": false,
3012             "tooltip": false,
3013             "viz": false
3014           },
3015           "lineInterpolation": "linear",
3016           "lineWidth": 1,
3017           "pointSize": 5,
3018           "scaleDistribution": {
3019             "type": "linear"
3020           },
3021           "showPoints": "auto",
3022           "spanNulls": false,
3023           "stacking": {
3024             "group": "A",
3025             "mode": "none"
3026           },
3027           "thresholdsStyle": {
3028             "mode": "off"
3029           }
3030         },
3031         "mappings": [],
3032         "thresholds": {
3033           "mode": "absolute",
3034           "steps": [
3035             {
3036               "color": "green",
3037               "value": null
3038             },
3039             {
3040               "color": "red",
3041               "value": 80
3042             }
3043           ]
3044         },
3045         "unit": "ms"
3046       },
3047       "overrides": []
3048     },
3049     "gridPos": {
3050       "h": 8,
3051       "w": 6,
3052       "x": 6,
3053       "y": 72
3054     },
3055     "id": 65,
3056     "options": {
3057       "legend": {
3058         "calcs": [],
3059         "displayMode": "list",
3060         "placement": "bottom"
3061       },
3062       "tooltip": {
3063         "mode": "single"
3064       }
3065     },
3066     "targets": [
3067       {
3068         "exemplar": true,
3069         "expr": "label_replace( sum(rate(hardware_disk_metrics_read_time_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) / rate(hardware_disk_metrics_read_count{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance, disk_name), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3070         "hide": false,
3071         "interval": "",
3072         "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
3073         "refId": "B"
3074       }
3075     ],
3076     "title": "System Disk Read Latency",
3077     "type": "timeseries"
3078   },
3079   {
3080     "datasource": null,
3081     "description": "The read throughput of I/O operations per second for the disk partition used for MongoDB.\n",
3082     "fieldConfig": {
3083       "defaults": {
3084         "color": {
3085           "mode": "palette-classic"
3086         },
3087         "custom": {
3088           "axisLabel": "",
3089           "axisPlacement": "auto",
3090           "barAlignment": 0,
3091           "drawStyle": "line",
3092           "fillOpacity": 0,
3093           "gradientMode": "none",
3094           "hideFrom": {
3095             "legend": false,
3096             "tooltip": false,
3097             "viz": false
3098           },
3099           "lineInterpolation": "linear",
3100           "lineWidth": 1,
3101           "pointSize": 5,
3102           "scaleDistribution": {
3103             "type": "linear"
3104           },
3105           "showPoints": "auto",
3106           "spanNulls": false,
3107           "stacking": {
3108             "group": "A",
3109             "mode": "none"
3110           },
3111           "thresholdsStyle": {
3112             "mode": "off"
3113           }
3114         },
3115         "mappings": [],
3116         "thresholds": {
3117           "mode": "absolute",
3118           "steps": [
3119             {
3120               "color": "green",
3121               "value": null
3122             },
3123             {
3124               "color": "red",
3125               "value": 80
3126             }
3127           ]
3128         },
3129         "unit": "/ sec"
3130       },
3131       "overrides": []
3132     },
3133     "gridPos": {
3134       "h": 8,
3135       "w": 6,
3136       "x": 12,
3137       "y": 72
3138     },
3139     "id": 62,
3140     "options": {
3141       "legend": {
3142         "calcs": [],
3143         "displayMode": "list",
3144         "placement": "bottom"
3145       },
3146       "tooltip": {
3147         "mode": "single"
3148       }
3149     },
3150     "targets": [
3151       {
3152         "exemplar": true,
3153         "expr": "label_replace( sum(rate(hardware_disk_metrics_read_count{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval])) by (instance, disk_name) , \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3154         "interval": "",
3155         "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
3156         "refId": "A"
3157       }
3158     ],
3159     "title": "System Disk Read IOPS",
3160     "type": "timeseries"
3161   },
3162   {
3163     "datasource": null,
3164     "description": "The percentage of time during which requests are being issued to and serviced by the partition. This includes requests from any process, not just MongoDB processes.\n",
3165     "fieldConfig": {
3166       "defaults": {
3167         "color": {
3168           "mode": "palette-classic"
3169         },
3170         "custom": {
3171           "axisLabel": "",
3172           "axisPlacement": "auto",
3173           "barAlignment": 0,
3174           "drawStyle": "line",
3175           "fillOpacity": 0,
3176           "gradientMode": "none",
3177           "hideFrom": {
3178             "legend": false,
3179             "tooltip": false,
3180             "viz": false
3181           },
3182           "lineInterpolation": "linear",
3183           "lineWidth": 1,
3184           "pointSize": 5,
3185           "scaleDistribution": {
3186             "type": "linear"
3187           },
3188           "showPoints": "auto",
3189           "spanNulls": false,
3190           "stacking": {
3191             "group": "A",
3192             "mode": "none"
3193           },
3194           "thresholdsStyle": {
3195             "mode": "off"
3196           }
3197         },
3198         "mappings": [],
3199         "thresholds": {
3200           "mode": "absolute",
3201           "steps": [
3202             {
3203               "color": "green",
3204               "value": null
3205             },
3206             {
3207               "color": "red",
3208               "value": 80
3209             }
3210           ]
3211         },
3212         "unit": "percent"
3213       },
3214       "overrides": []
3215     },
3216     "gridPos": {
3217       "h": 8,
3218       "w": 6,
3219       "x": 18,
3220       "y": 72
3221     },
3222     "id": 67,
3223     "options": {
3224       "legend": {
3225         "calcs": [],
3226         "displayMode": "list",
3227         "placement": "bottom"
3228       },
3229       "tooltip": {
3230         "mode": "single"
3231       }
3232     },
3233     "targets": [
3234       {
3235         "exemplar": true,
3236         "expr": "label_replace( sum(rate(hardware_disk_metrics_total_time_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) ) by (instance, disk_name) / 10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3237         "hide": false,
3238         "interval": "",
3239         "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
3240         "refId": "B"
3241       }
3242     ],
3243     "title": "System Disk Util %",
3244     "type": "timeseries"
3245   },
3246   {
3247     "datasource": null,
3248     "description": "The average length of queue of requests issued to the disk partition used by MongoDB.\n",
3249     "fieldConfig": {
3250       "defaults": {
3251         "color": {
3252           "mode": "palette-classic"
3253         },
3254         "custom": {
3255           "axisLabel": "",
3256           "axisPlacement": "auto",
3257           "barAlignment": 0,
3258           "drawStyle": "line",
3259           "fillOpacity": 0,
3260           "gradientMode": "none",
3261           "hideFrom": {
3262             "legend": false,
3263             "tooltip": false,
3264             "viz": false
3265           },
3266           "lineInterpolation": "linear",
3267           "lineWidth": 1,
3268           "pointSize": 5,
3269           "scaleDistribution": {
3270             "type": "linear"
3271           },
3272           "showPoints": "auto",
3273           "spanNulls": false,
3274           "stacking": {
3275             "group": "A",
3276             "mode": "none"
3277           },
3278           "thresholdsStyle": {
3279             "mode": "off"
3280           }
3281         },
3282         "mappings": [],
3283         "thresholds": {
3284           "mode": "absolute",
3285           "steps": [
3286             {
3287               "color": "green",
3288               "value": null
3289             },
3290             {
3291               "color": "red",
3292               "value": 80
3293             }
3294           ]
3295         },
3296         "unit": "ms"
3297       },
3298       "overrides": []
3299     },
3300     "gridPos": {
3301       "h": 8,
3302       "w": 6,
3303       "x": 0,
3304       "y": 80
3305     },
3306     "id": 66,
3307     "options": {
3308       "legend": {
3309         "calcs": [],
3310         "displayMode": "list",
3311         "placement": "bottom"
3312       },
3313       "tooltip": {
3314         "mode": "single"
3315       }
3316     },
3317     "targets": [
3318       {
3319         "exemplar": true,
3320         "expr": "label_replace( sum(rate(hardware_disk_metrics_weighted_time_io_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\"}[$interval]) ) by (instance, DiskName), \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3321         "hide": false,
3322         "interval": "",
3323         "legendFormat": "disk - {{disk_name}} host - {{hostname}} ",
3324         "refId": "B"
3325       }
3326     ],
3327     "title": "System Disk Queue Depth",
3328     "type": "timeseries"
3329   },
3330   {
3331     "collapsed": false,
3332     "datasource": null,
3333     "gridPos": {
3334       "h": 1,
3335       "w": 24,
3336       "x": 0,
3337       "y": 88
3338     },
3339     "id": 32,
3340     "panels": [],
3341     "title": "Process CPU",
3342     "type": "row"
3343   },
3344   {
3345     "datasource": null,
3346     "description": "The percentage of time the CPU spent servicing this MongoDB process, scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
3347     "fieldConfig": {
3348       "defaults": {
3349         "color": {
3350           "mode": "palette-classic"
3351         },
3352         "custom": {
3353           "axisLabel": "",
3354           "axisPlacement": "auto",
3355           "barAlignment": 0,
3356           "drawStyle": "line",
3357           "fillOpacity": 0,
3358           "gradientMode": "none",
3359           "hideFrom": {
3360             "legend": false,
3361             "tooltip": false,
3362             "viz": false
3363           },
3364           "lineInterpolation": "linear",
3365           "lineWidth": 1,
3366           "pointSize": 5,
3367           "scaleDistribution": {
3368             "type": "linear"
3369           },
3370           "showPoints": "auto",
3371           "spanNulls": false,
3372           "stacking": {
3373             "group": "A",
3374             "mode": "none"
3375           },
3376           "thresholdsStyle": {
3377             "mode": "off"
3378           }
3379         },
3380         "mappings": [],
3381         "thresholds": {
3382           "mode": "absolute",
3383           "steps": [
3384             {
3385               "color": "green",
3386               "value": null
3387             },
3388             {
3389               "color": "red",
3390               "value": 80
3391             }
3392           ]
3393         },
3394         "unit": "percent"
3395       },
3396       "overrides": []
3397     },
3398     "gridPos": {
3399       "h": 7,
3400       "w": 6,
3401       "x": 0,
3402       "y": 89
3403     },
3404     "id": 54,
3405     "options": {
3406       "legend": {
3407         "calcs": [],
3408         "displayMode": "list",
3409         "placement": "bottom"
3410       },
3411       "tooltip": {
3412         "mode": "single"
3413       }
3414     },
3415     "targets": [
3416       {
3417         "exemplar": true,
3418         "expr": "label_replace((sum(rate(hardware_process_cpu_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / on(instance) group_left  hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\" })/10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3419         "interval": "",
3420         "legendFormat": "host - {{hostname}} port - {{process_port}}",
3421         "refId": "A"
3422       }
3423     ],
3424     "title": "Normalized Process cpu - user",
3425     "type": "timeseries"
3426   },
3427   {
3428     "datasource": null,
3429     "description": "",
3430     "fieldConfig": {
3431       "defaults": {
3432         "color": {
3433           "mode": "palette-classic"
3434         },
3435         "custom": {
3436           "axisLabel": "",
3437           "axisPlacement": "auto",
3438           "barAlignment": 0,
3439           "drawStyle": "line",
3440           "fillOpacity": 0,
3441           "gradientMode": "none",
3442           "hideFrom": {
3443             "legend": false,
3444             "tooltip": false,
3445             "viz": false
3446           },
3447           "lineInterpolation": "linear",
3448           "lineWidth": 1,
3449           "pointSize": 5,
3450           "scaleDistribution": {
3451             "type": "linear"
3452           },
3453           "showPoints": "auto",
3454           "spanNulls": false,
3455           "stacking": {
3456             "group": "A",
3457             "mode": "none"
3458           },
3459           "thresholdsStyle": {
3460             "mode": "off"
3461           }
3462         },
3463         "mappings": [],
3464         "thresholds": {
3465           "mode": "absolute",
3466           "steps": [
3467             {
3468               "color": "green",
3469               "value": null
3470             },
3471             {
3472               "color": "red",
3473               "value": 80
3474             }
3475           ]
3476         },
3477         "unit": "percent"
3478       },
3479       "overrides": []
3480     },
3481     "gridPos": {
3482       "h": 7,
3483       "w": 6,
3484       "x": 6,
3485       "y": 89
3486     },
3487     "id": 58,
3488     "options": {
3489       "legend": {
3490         "calcs": [],
3491         "displayMode": "list",
3492         "placement": "bottom"
3493       },
3494       "tooltip": {
3495         "mode": "single"
3496       }
3497     },
3498     "targets": [
3499       {
3500         "exemplar": true,
3501         "expr": "label_replace((sum(rate(hardware_process_cpu_children_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / on(instance) group_left  hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\" })/10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3502         "interval": "",
3503         "legendFormat": "host - {{hostname}} port - {{process_port}}",
3504         "refId": "A"
3505       }
3506     ],
3507     "title": "Normalized Process cpu - children user",
3508     "type": "timeseries"
3509   },
3510   {
3511     "datasource": null,
3512     "description": "The percentage of time the CPU spent servicing operating system calls for this MongoDB process, scaled to a range of 0-100% by dividing by the number of CPU cores.\n",
3513     "fieldConfig": {
3514       "defaults": {
3515         "color": {
3516           "mode": "palette-classic"
3517         },
3518         "custom": {
3519           "axisLabel": "",
3520           "axisPlacement": "auto",
3521           "barAlignment": 0,
3522           "drawStyle": "line",
3523           "fillOpacity": 0,
3524           "gradientMode": "none",
3525           "hideFrom": {
3526             "legend": false,
3527             "tooltip": false,
3528             "viz": false
3529           },
3530           "lineInterpolation": "linear",
3531           "lineWidth": 1,
3532           "pointSize": 5,
3533           "scaleDistribution": {
3534             "type": "linear"
3535           },
3536           "showPoints": "auto",
3537           "spanNulls": false,
3538           "stacking": {
3539             "group": "A",
3540             "mode": "none"
3541           },
3542           "thresholdsStyle": {
3543             "mode": "off"
3544           }
3545         },
3546         "mappings": [],
3547         "thresholds": {
3548           "mode": "absolute",
3549           "steps": [
3550             {
3551               "color": "green",
3552               "value": null
3553             },
3554             {
3555               "color": "red",
3556               "value": 80
3557             }
3558           ]
3559         },
3560         "unit": "percent"
3561       },
3562       "overrides": []
3563     },
3564     "gridPos": {
3565       "h": 7,
3566       "w": 6,
3567       "x": 12,
3568       "y": 89
3569     },
3570     "id": 55,
3571     "options": {
3572       "legend": {
3573         "calcs": [],
3574         "displayMode": "list",
3575         "placement": "bottom"
3576       },
3577       "tooltip": {
3578         "mode": "single"
3579       }
3580     },
3581     "targets": [
3582       {
3583         "exemplar": true,
3584         "expr": "label_replace((sum(rate(hardware_process_cpu_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / on(instance) group_left  hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\" })/10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3585         "interval": "",
3586         "legendFormat": "host - {{hostname}} port - {{process_port}}",
3587         "refId": "A"
3588       }
3589     ],
3590     "title": "Normalized Process cpu - kernel",
3591     "type": "timeseries"
3592   },
3593   {
3594     "datasource": null,
3595     "description": "",
3596     "fieldConfig": {
3597       "defaults": {
3598         "color": {
3599           "mode": "palette-classic"
3600         },
3601         "custom": {
3602           "axisLabel": "",
3603           "axisPlacement": "auto",
3604           "barAlignment": 0,
3605           "drawStyle": "line",
3606           "fillOpacity": 0,
3607           "gradientMode": "none",
3608           "hideFrom": {
3609             "legend": false,
3610             "tooltip": false,
3611             "viz": false
3612           },
3613           "lineInterpolation": "linear",
3614           "lineWidth": 1,
3615           "pointSize": 5,
3616           "scaleDistribution": {
3617             "type": "linear"
3618           },
3619           "showPoints": "auto",
3620           "spanNulls": false,
3621           "stacking": {
3622             "group": "A",
3623             "mode": "none"
3624           },
3625           "thresholdsStyle": {
3626             "mode": "off"
3627           }
3628         },
3629         "mappings": [],
3630         "thresholds": {
3631           "mode": "absolute",
3632           "steps": [
3633             {
3634               "color": "green",
3635               "value": null
3636             },
3637             {
3638               "color": "red",
3639               "value": 80
3640             }
3641           ]
3642         },
3643         "unit": "percent"
3644       },
3645       "overrides": []
3646     },
3647     "gridPos": {
3648       "h": 7,
3649       "w": 6,
3650       "x": 18,
3651       "y": 89
3652     },
3653     "id": 57,
3654     "options": {
3655       "legend": {
3656         "calcs": [],
3657         "displayMode": "list",
3658         "placement": "bottom"
3659       },
3660       "tooltip": {
3661         "mode": "single"
3662       }
3663     },
3664     "targets": [
3665       {
3666         "exemplar": true,
3667         "expr": "label_replace((sum(rate(hardware_process_cpu_children_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / on(instance) group_left  hardware_platform_num_logical_cpus{group_id=~\"$group_id\",  instance=~\"$host.*\" })/10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3668         "interval": "",
3669         "legendFormat": "host - {{hostname}} port - {{process_port}}",
3670         "refId": "A"
3671       }
3672     ],
3673     "title": "Normalized Process cpu - children kernel",
3674     "type": "timeseries"
3675   },
3676   {
3677     "datasource": null,
3678     "description": "The percentage of time the CPU spent servicing this MongoDB process. For servers with more than 1 CPU core, this value can exceed 100%.\n",
3679     "fieldConfig": {
3680       "defaults": {
3681         "color": {
3682           "mode": "palette-classic"
3683         },
3684         "custom": {
3685           "axisLabel": "",
3686           "axisPlacement": "auto",
3687           "barAlignment": 0,
3688           "drawStyle": "line",
3689           "fillOpacity": 0,
3690           "gradientMode": "none",
3691           "hideFrom": {
3692             "legend": false,
3693             "tooltip": false,
3694             "viz": false
3695           },
3696           "lineInterpolation": "linear",
3697           "lineWidth": 1,
3698           "pointSize": 5,
3699           "scaleDistribution": {
3700             "type": "linear"
3701           },
3702           "showPoints": "auto",
3703           "spanNulls": false,
3704           "stacking": {
3705             "group": "A",
3706             "mode": "none"
3707           },
3708           "thresholdsStyle": {
3709             "mode": "off"
3710           }
3711         },
3712         "mappings": [],
3713         "thresholds": {
3714           "mode": "absolute",
3715           "steps": [
3716             {
3717               "color": "green",
3718               "value": null
3719             },
3720             {
3721               "color": "red",
3722               "value": 80
3723             }
3724           ]
3725         },
3726         "unit": "percent"
3727       },
3728       "overrides": []
3729     },
3730     "gridPos": {
3731       "h": 7,
3732       "w": 6,
3733       "x": 0,
3734       "y": 96
3735     },
3736     "id": 56,
3737     "options": {
3738       "legend": {
3739         "calcs": [],
3740         "displayMode": "list",
3741         "placement": "bottom"
3742       },
3743       "tooltip": {
3744         "mode": "single"
3745       }
3746     },
3747     "targets": [
3748       {
3749         "exemplar": true,
3750         "expr": "label_replace(sum(rate(hardware_process_cpu_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / 10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3751         "interval": "",
3752         "legendFormat": "host - {{hostname}} port - {{process_port}}",
3753         "refId": "A"
3754       }
3755     ],
3756     "title": "Process cpu - user",
3757     "type": "timeseries"
3758   },
3759   {
3760     "datasource": null,
3761     "description": "",
3762     "fieldConfig": {
3763       "defaults": {
3764         "color": {
3765           "mode": "palette-classic"
3766         },
3767         "custom": {
3768           "axisLabel": "",
3769           "axisPlacement": "auto",
3770           "barAlignment": 0,
3771           "drawStyle": "line",
3772           "fillOpacity": 0,
3773           "gradientMode": "none",
3774           "hideFrom": {
3775             "legend": false,
3776             "tooltip": false,
3777             "viz": false
3778           },
3779           "lineInterpolation": "linear",
3780           "lineWidth": 1,
3781           "pointSize": 5,
3782           "scaleDistribution": {
3783             "type": "linear"
3784           },
3785           "showPoints": "auto",
3786           "spanNulls": false,
3787           "stacking": {
3788             "group": "A",
3789             "mode": "none"
3790           },
3791           "thresholdsStyle": {
3792             "mode": "off"
3793           }
3794         },
3795         "mappings": [],
3796         "thresholds": {
3797           "mode": "absolute",
3798           "steps": [
3799             {
3800               "color": "green",
3801               "value": null
3802             },
3803             {
3804               "color": "red",
3805               "value": 80
3806             }
3807           ]
3808         },
3809         "unit": "percent"
3810       },
3811       "overrides": []
3812     },
3813     "gridPos": {
3814       "h": 7,
3815       "w": 6,
3816       "x": 6,
3817       "y": 96
3818     },
3819     "id": 59,
3820     "options": {
3821       "legend": {
3822         "calcs": [],
3823         "displayMode": "list",
3824         "placement": "bottom"
3825       },
3826       "tooltip": {
3827         "mode": "single"
3828       }
3829     },
3830     "targets": [
3831       {
3832         "exemplar": true,
3833         "expr": "label_replace(sum(rate(hardware_process_cpu_children_user_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / 10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3834         "interval": "",
3835         "legendFormat": "host - {{hostname}} port - {{process_port}}",
3836         "refId": "A"
3837       }
3838     ],
3839     "title": "Process cpu - child user",
3840     "type": "timeseries"
3841   },
3842   {
3843     "datasource": null,
3844     "description": "The percentage of time the CPU spent servicing operating system calls for this MongoDB process. For servers with more than 1 CPU core, this value can exceed 100%.\n",
3845     "fieldConfig": {
3846       "defaults": {
3847         "color": {
3848           "mode": "palette-classic"
3849         },
3850         "custom": {
3851           "axisLabel": "",
3852           "axisPlacement": "auto",
3853           "barAlignment": 0,
3854           "drawStyle": "line",
3855           "fillOpacity": 0,
3856           "gradientMode": "none",
3857           "hideFrom": {
3858             "legend": false,
3859             "tooltip": false,
3860             "viz": false
3861           },
3862           "lineInterpolation": "linear",
3863           "lineWidth": 1,
3864           "pointSize": 5,
3865           "scaleDistribution": {
3866             "type": "linear"
3867           },
3868           "showPoints": "auto",
3869           "spanNulls": false,
3870           "stacking": {
3871             "group": "A",
3872             "mode": "none"
3873           },
3874           "thresholdsStyle": {
3875             "mode": "off"
3876           }
3877         },
3878         "mappings": [],
3879         "thresholds": {
3880           "mode": "absolute",
3881           "steps": [
3882             {
3883               "color": "green",
3884               "value": null
3885             },
3886             {
3887               "color": "red",
3888               "value": 80
3889             }
3890           ]
3891         },
3892         "unit": "percent"
3893       },
3894       "overrides": []
3895     },
3896     "gridPos": {
3897       "h": 7,
3898       "w": 6,
3899       "x": 12,
3900       "y": 96
3901     },
3902     "id": 60,
3903     "options": {
3904       "legend": {
3905         "calcs": [],
3906         "displayMode": "list",
3907         "placement": "bottom"
3908       },
3909       "tooltip": {
3910         "mode": "single"
3911       }
3912     },
3913     "targets": [
3914       {
3915         "exemplar": true,
3916         "expr": "label_replace(sum(rate(hardware_process_cpu_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / 10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
3917         "interval": "",
3918         "legendFormat": "host - {{hostname}} port - {{process_port}}",
3919         "refId": "A"
3920       }
3921     ],
3922     "title": "Process cpu - kernel",
3923     "type": "timeseries"
3924   },
3925   {
3926     "datasource": null,
3927     "description": "",
3928     "fieldConfig": {
3929       "defaults": {
3930         "color": {
3931           "mode": "palette-classic"
3932         },
3933         "custom": {
3934           "axisLabel": "",
3935           "axisPlacement": "auto",
3936           "barAlignment": 0,
3937           "drawStyle": "line",
3938           "fillOpacity": 0,
3939           "gradientMode": "none",
3940           "hideFrom": {
3941             "legend": false,
3942             "tooltip": false,
3943             "viz": false
3944           },
3945           "lineInterpolation": "linear",
3946           "lineWidth": 1,
3947           "pointSize": 5,
3948           "scaleDistribution": {
3949             "type": "linear"
3950           },
3951           "showPoints": "auto",
3952           "spanNulls": false,
3953           "stacking": {
3954             "group": "A",
3955             "mode": "none"
3956           },
3957           "thresholdsStyle": {
3958             "mode": "off"
3959           }
3960         },
3961         "mappings": [],
3962         "thresholds": {
3963           "mode": "absolute",
3964           "steps": [
3965             {
3966               "color": "green",
3967               "value": null
3968             },
3969             {
3970               "color": "red",
3971               "value": 80
3972             }
3973           ]
3974         },
3975         "unit": "percent"
3976       },
3977       "overrides": []
3978     },
3979     "gridPos": {
3980       "h": 7,
3981       "w": 6,
3982       "x": 18,
3983       "y": 96
3984     },
3985     "id": 61,
3986     "options": {
3987       "legend": {
3988         "calcs": [],
3989         "displayMode": "list",
3990         "placement": "bottom"
3991       },
3992       "tooltip": {
3993         "mode": "single"
3994       }
3995     },
3996     "targets": [
3997       {
3998         "exemplar": true,
3999         "expr": "label_replace(sum(rate(hardware_process_cpu_children_kernel_milliseconds{group_id=~\"$group_id\",  instance=~\"$host.*\", process_port=~\"$process_port\" } [$interval])) by (instance, process_port)  / 10, \"hostname\", \"$1\", \"instance\", \"(.*):.*\")",
4000         "interval": "",
4001         "legendFormat": "host - {{hostname}} port - {{process_port}}",
4002         "refId": "A"
4003       }
4004     ],
4005     "title": "Process cpu - children kernel",
4006     "type": "timeseries"
4007   }
4008 ],
4009 "refresh": false,
4010 "schemaVersion": 31,
4011 "style": "dark",
4012 "tags": [],
4013 "templating": {
4014   "list": [
4015     {
4016       "current": {
4017         "selected": false,
4018         "text": "Prometheus",
4019         "value": "Prometheus"
4020       },
4021       "description": null,
4022       "error": null,
4023       "hide": 0,
4024       "includeAll": false,
4025       "label": null,
4026       "multi": false,
4027       "name": "Datasource",
4028       "options": [],
4029       "query": "prometheus",
4030       "queryValue": "",
4031       "refresh": 1,
4032       "regex": "",
4033       "skipUrlSync": false,
4034       "type": "datasource"
4035     },
4036     {
4037       "allValue": null,
4038       "current": {
4039         "selected": false,
4040         "text": "611c15fc5851c22d37e3f351",
4041         "value": "611c15fc5851c22d37e3f351"
4042       },
4043       "datasource": null,
4044       "definition": "label_values(group_id)",
4045       "description": null,
4046       "error": null,
4047       "hide": 0,
4048       "includeAll": false,
4049       "label": "Group Id",
4050       "multi": false,
4051       "name": "group_id",
4052       "options": [],
4053       "query": {
4054         "query": "label_values(group_id)",
4055         "refId": "StandardVariableQuery"
4056       },
4057       "refresh": 1,
4058       "regex": "",
4059       "skipUrlSync": false,
4060       "sort": 0,
4061       "type": "query"
4062     },
4063     {
4064       "allValue": null,
4065       "current": {
4066         "selected": false,
4067         "text": "Cluster0",
4068         "value": "Cluster0"
4069       },
4070       "datasource": null,
4071       "definition": "label_values(mongodb_up{group_id='$group_id'}, cluster_name)",
4072       "description": null,
4073       "error": null,
4074       "hide": 0,
4075       "includeAll": false,
4076       "label": "Cluster Name",
4077       "multi": false,
4078       "name": "cluster_name",
4079       "options": [],
4080       "query": {
4081         "query": "label_values(mongodb_up{group_id='$group_id'}, cluster_name)",
4082         "refId": "StandardVariableQuery"
4083       },
4084       "refresh": 2,
4085       "regex": "",
4086       "skipUrlSync": false,
4087       "sort": 0,
4088       "type": "query"
4089     },
4090     {
4091       "allValue": null,
4092       "current": {
4093         "selected": true,
4094         "text": [
4095           "All"
4096         ],
4097         "value": [
4098           "$__all"
4099         ]
4100       },
4101       "datasource": null,
4102       "definition": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name'}, replica_set_name)",
4103       "description": null,
4104       "error": null,
4105       "hide": 0,
4106       "includeAll": true,
4107       "label": "Replica set name",
4108       "multi": true,
4109       "name": "replica_set_name",
4110       "options": [],
4111       "query": {
4112         "query": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name'}, replica_set_name)",
4113         "refId": "StandardVariableQuery"
4114       },
4115       "refresh": 2,
4116       "regex": "",
4117       "skipUrlSync": false,
4118       "sort": 0,
4119       "type": "query"
4120     },
4121     {
4122       "allValue": null,
4123       "current": {
4124         "selected": true,
4125         "text": [
4126           "All"
4127         ],
4128         "value": [
4129           "$__all"
4130         ]
4131       },
4132       "datasource": null,
4133       "definition": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name',replica_set_name='$replica_set_name'},instance)",
4134       "description": null,
4135       "error": null,
4136       "hide": 0,
4137       "includeAll": true,
4138       "label": null,
4139       "multi": true,
4140       "name": "host",
4141       "options": [],
4142       "query": {
4143         "query": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name',replica_set_name='$replica_set_name'},instance)",
4144         "refId": "StandardVariableQuery"
4145       },
4146       "refresh": 2,
4147       "regex": "(.*):.*",
4148       "skipUrlSync": false,
4149       "sort": 0,
4150       "type": "query"
4151     },
4152     {
4153       "allValue": null,
4154       "current": {
4155         "selected": true,
4156         "text": [
4157           "All"
4158         ],
4159         "value": [
4160           "$__all"
4161         ]
4162       },
4163       "datasource": null,
4164       "definition": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name',replica_set_name='$replica_set_name'},process_port)",
4165       "description": "Only applicable for process level metrics",
4166       "error": null,
4167       "hide": 0,
4168       "includeAll": true,
4169       "label": "Process Port",
4170       "multi": true,
4171       "name": "process_port",
4172       "options": [],
4173       "query": {
4174         "query": "label_values(mongodb_up{group_id='$group_id', cluster_name='$cluster_name',replica_set_name='$replica_set_name'},process_port)",
4175         "refId": "StandardVariableQuery"
4176       },
4177       "refresh": 1,
4178       "regex": "",
4179       "skipUrlSync": false,
4180       "sort": 0,
4181       "type": "query"
4182     },
4183     {
4184       "auto": true,
4185       "auto_count": 30,
4186       "auto_min": "10s",
4187       "current": {
4188         "selected": false,
4189         "text": "1m",
4190         "value": "1m"
4191       },
4192       "description": null,
4193       "error": null,
4194       "hide": 0,
4195       "label": "Interval",
4196       "name": "interval",
4197       "options": [
4198         {
4199           "selected": false,
4200           "text": "auto",
4201           "value": "$__auto_interval_interval"
4202         },
4203         {
4204           "selected": false,
4205           "text": "30s",
4206           "value": "30s"
4207         },
4208         {
4209           "selected": true,
4210           "text": "1m",
4211           "value": "1m"
4212         },
4213         {
4214           "selected": false,
4215           "text": "5m",
4216           "value": "5m"
4217         },
4218         {
4219           "selected": false,
4220           "text": "30m",
4221           "value": "30m"
4222         },
4223         {
4224           "selected": false,
4225           "text": "1h",
4226           "value": "1h"
4227         },
4228         {
4229           "selected": false,
4230           "text": "1d",
4231           "value": "1d"
4232         }
4233       ],
4234       "query": "30s,1m,5m,30m,1h,1d",
4235       "queryValue": "",
4236       "refresh": 2,
4237       "skipUrlSync": false,
4238       "type": "interval"
4239     }
4240   ]
4241 },
4242 "time": {
4243   "from": "now-30m",
4244   "to": "now"
4245 },
4246 "timepicker": {},
4247 "timezone": "",
4248 "title": "Hardware Metrics - Atlas - new",
4249 "uid": "7LTNNcpnzsasddsd",
4250 "version": 1
4251}

To learn more about importing Grafana dashboards, see the Grafana documentation.

Performance Metrics Available to Prometheus

The following metrics are available when you use the Prometheus integration with your MongoDB Atlas cluster:

MongoDB Metric Labels

Each MongoDB metric contains the following labels:

Label
Description

group_id

Unique hexadecimal digit string that identifies the project.

org_id

Unique hexadecimal digit string that identifies the organization.

cl_role

Human readable label that defines the cluster role.

cl_name

Human-readable label that identifies the cluster.

rs_nm

Human-readable label that identifies the replica set.

rs_state

Number that indicates the replica set state.

process_port

Port on which the process runs.

MongoDB Information Metrics

mongodb_info is a gauge that always has the value of 1. This metric contains all the MongoDB Metric Labels and also the following labels:

Label
Description

mongodb_version

String that represents the major, minor, and patch versions.

replica_state_name

String that indicates the replica set member status.

process_type

String that indicates the process running. Its values can be mongod, mongos, or config.

Hardware Metrics

Note

You can also view descriptions of each hardware metric in the Prometheus expression browser.

Name
Operating System
Type
Description

hardware_system_cpu_nice

Unix, Darwin

Counter

Time spent in user mode with low priority.

hardware_system_cpu_io_wait

Unix

Counter

Time waiting for I/O to complete.

hardware_system_cpu_irq

Unix

Counter

Time spent servicing interrupts.

hardware_system_cpu_soft_irq

Unix

Counter

Time spent servicing softirq's.

hardware_system_cpu_steal

Unix

Counter

Time spent in other operating systems when running in a virtual environment.

hardware_system_cpu_guest

Unix

Counter

Time spent running a virtual CPU for the guest operating systems under the control of the Linux kernel.

hardware_system_cpu_guest_nice

Unix

Counter

Time spent running a guest with an adjusted niceness.

hardware_system_cpu_kernel_milliseconds

All

Counter

Time spent in system mode.

hardware_system_cpu_user_milliseconds

All

Counter

Time spent in user mode.

hardware_disk_metrics_weighted_time_io

Unix

Counter

Weighted time spent doing I/O's.

hardware_disk_metrics_physical_write_count

Unix

Counter

Number of physical write I/O's processed.

hardware_disk_metrics_physical_read_count

Unix

Counter

Number of physical read I/O's processed.

hardware_disk_metrics_total_time

Unix

Counter

Total time this block device is active.

hardware_disk_metrics_idle_time

Windows

Counter

Time spent in the idle task.

hardware_disk_metrics_disk_space_free_bytes

All

Gauge

Disk space available in the mounted file system.

hardware_disk_metrics_disk_space_used_bytes

All

Gauge

Disk space used in the mounted file system.

hardware_disk_metrics_read_count

All

Counter

Number of read I/O's processed.

hardware_disk_metrics_read_time_milliseconds

All

Counter

Total wait time for read requests.

hardware_disk_metrics_write_count

All

Counter

Number of write I/O's processed.

hardware_disk_metrics_write_time_milliseconds

All

Counter

Total wait time for write requests.

hardware_process_cpu_children_user

Unix

Counter

Amount of time scheduled in user mode for this process to wait for children.

hardware_process_cpu_children_kernel

Unix

Counter

Amount of time scheduled in kernel mode for this process to wait for children.

hardware_process_cpu_kernel_milliseconds

All

Counter

Amount of time scheduled in kernel mode for this process.

hardware_process_cpu_user_milliseconds

All

Counter

Amount of time scheduled in user mode for this process.

hardware_system_vm_page_swap_in

Unix

Counter

Number of pages the system has swapped in from disk.

hardware_system_vm_page_swap_out

Unix

Counter

Number of pages the system has swapped out to disk.

hardware_system_memory_mem_total

Unix

Gauge

Total usable RAM (physical RAM minus a few reserved bits and the kernel binary code).

hardware_system_memory_mem_free

Unix

Gauge

Sum of LowFree + HighFree.

hardware_system_memory_mem_available

Unix

Gauge

An estimate of how much memory is available for starting new applications, without swapping.

hardware_system_memory_buffers

Unix

Gauge

Temporary storage for raw disk blocks that shouldn't get tremendously large.

hardware_system_memory_cached

Unix

Gauge

In-memory cache for files read from the disk. This doesn't include SwapCached.

hardware_system_memory_swap_total

Unix

Gauge

Total amount of swap space available.

hardware_system_memory_swap_free

Unix

Gauge

Total amount of swap space unused.

hardware_system_memory_shared_mem

Unix

Gauge

Amount of memory consumed in file systems whose contents reside in virtual memory.

hardware_system_memory_swap_free_kilobytes

All

Gauge

Total amount of swap space unused.

hardware_system_memory_swap_total_kilobytes

All

Gauge

Total amount of swap space available.

hardware_platform_num_logical_cpus

All

Gauge

Number of logical CPUs usable by the current process.

hardware_system_network_eth0_bytes_in_bytes

All

Counter

Number of bytes of data received by the interface.

hardware_system_network_eth0_bytes_out_bytes

All

Counter

Number of bytes of data transmitted by the interface.

hardware_system_network_lo_bytes_in_bytes

All

Counter

Number of bytes of data received by the interface.

hardware_system_network_lo_bytes_out_bytes

All

Counter

Number of bytes of data transmitted by the interface.

Hardware Metric Labels

Each hardware metric contains the following labels:

Label
Description

group_id

Unique hexadecimal digit string that identifies the project.

org_id

Unique hexadecimal digit string that identifies the organization.

process_port

Port on which the process runs.

disk_name

Human-readable label that identifies the disk.

Back

PagerDuty

Next

View, Retrieve, and Manage Logs